Sep 09 23:58:16.633217 ip-10-0-130-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 23:58:16.633380 ip-10-0-130-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 23:58:16.633458 ip-10-0-130-253 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 23:58:16.633778 ip-10-0-130-253 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 23:58:26.705859 ip-10-0-130-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 23:58:26.705879 ip-10-0-130-253 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a7e9f88f9ee945b199d9d048dded5849 -- Sep 10 00:00:15.225409 ip-10-0-130-253 systemd[1]: Starting Kubernetes Kubelet... Sep 10 00:00:15.640484 ip-10-0-130-253 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:00:15.640484 ip-10-0-130-253 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 00:00:15.640484 ip-10-0-130-253 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:00:15.640484 ip-10-0-130-253 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 00:00:15.640484 ip-10-0-130-253 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:00:15.641232 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.640543 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 00:00:15.645336 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645318 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:00:15.645336 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645334 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645338 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645342 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645346 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645349 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645352 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645355 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645358 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645366 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645369 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645372 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645375 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645377 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645380 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645382 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645385 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645387 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645390 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645392 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645395 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:00:15.645406 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645397 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645400 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645402 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645405 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645408 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645411 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645414 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645416 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645419 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645422 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645426 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645429 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645432 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645434 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645437 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645439 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645442 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645444 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645447 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645449 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:00:15.645880 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645452 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645454 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645457 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645459 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645464 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645467 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645470 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645473 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645476 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645479 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645482 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645484 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645487 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645489 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645492 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645495 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645498 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645501 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645503 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:00:15.646674 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645506 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645510 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645514 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645517 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645520 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645524 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645527 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645530 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645533 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645535 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645538 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645541 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645544 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645547 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645550 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645552 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645555 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645557 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645560 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:00:15.647180 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645562 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645565 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645568 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645571 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645574 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645577 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645579 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645581 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645585 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645588 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645591 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645593 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645596 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645598 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645601 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645604 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645606 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645609 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645611 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:00:15.647675 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.645614 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647712 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647722 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647726 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647729 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647732 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647735 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647738 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647741 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647743 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647746 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647749 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647752 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647756 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647760 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647763 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647766 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647768 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647771 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647773 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:00:15.648241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647776 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647779 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647781 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647784 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647786 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647789 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647792 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647794 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647796 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647799 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647801 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647804 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647807 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647809 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647813 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647815 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647818 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647820 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647823 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647825 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:00:15.648740 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647828 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647830 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647833 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647835 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647838 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647840 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647843 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647846 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647848 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647851 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647853 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647856 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647858 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647861 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647865 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647871 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647874 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647878 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647880 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:00:15.649245 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647883 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647886 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647888 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647891 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647894 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647897 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647900 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647904 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647907 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647910 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647912 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647915 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647919 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647921 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647924 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647926 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647929 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647931 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647934 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:00:15.649708 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647936 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647939 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647941 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647944 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647947 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647949 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647953 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647955 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647958 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647960 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647963 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647965 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647968 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647970 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647972 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647975 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647978 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647980 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647983 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:00:15.650205 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647985 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647988 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.647991 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648393 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648398 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648401 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648404 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648407 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648410 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648413 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648415 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648418 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648421 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648423 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648426 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648428 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648431 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648433 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648436 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648439 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:00:15.650696 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648442 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648445 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648447 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648450 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648452 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648455 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648457 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648460 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648462 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648465 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648467 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648470 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648472 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648476 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648478 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648480 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648483 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648486 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648488 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648491 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:00:15.651191 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648500 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648503 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648506 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648508 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648510 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648513 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648516 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648518 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648522 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648526 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648529 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648531 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648535 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648538 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648540 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648542 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648545 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648547 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648550 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:00:15.651679 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648554 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648557 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648560 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648562 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648565 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648568 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648571 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648573 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648576 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648579 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648582 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648584 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648589 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648592 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648595 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648597 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648600 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648603 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648605 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:00:15.652187 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648608 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648610 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648613 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648615 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648617 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648620 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648622 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648626 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648628 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648631 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648633 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648635 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648638 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648640 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648643 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648645 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648647 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648650 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648655 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648658 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:00:15.652653 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648661 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648663 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648666 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.648668 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648765 2568 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648815 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648823 2568 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648828 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648832 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648835 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648839 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648844 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648847 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648850 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648854 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648858 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648861 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648864 2568 flags.go:64] FLAG: --cgroup-root="" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648866 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648869 2568 flags.go:64] FLAG: --client-ca-file="" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648874 2568 flags.go:64] FLAG: --cloud-provider="external" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648877 2568 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648881 2568 flags.go:64] FLAG: --cluster-domain="" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648884 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 00:00:15.653156 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648887 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648890 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648894 2568 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648898 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648901 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648904 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648908 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648911 2568 flags.go:64] FLAG: --contention-profiling="false" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648914 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648918 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648921 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648923 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648927 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648931 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648934 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648937 2568 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648940 2568 flags.go:64] FLAG: --enable-server="true" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648943 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648948 2568 flags.go:64] FLAG: --event-burst="100" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648951 2568 flags.go:64] FLAG: --event-qps="50" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648954 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648957 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648960 2568 flags.go:64] FLAG: --eviction-hard="" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648964 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 00:00:15.653728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648966 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648969 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648972 2568 flags.go:64] FLAG: --eviction-soft="" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648975 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648978 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648982 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648985 2568 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648988 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648991 2568 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648994 2568 flags.go:64] FLAG: --feature-gates="" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.648999 2568 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649002 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649005 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649008 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649011 2568 flags.go:64] FLAG: --healthz-port="10248" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649015 2568 flags.go:64] FLAG: --help="false" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649017 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649020 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649023 2568 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649026 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649030 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649033 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649036 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 00:00:15.654330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649039 2568 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649041 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649044 2568 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649047 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649050 2568 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649053 2568 flags.go:64] FLAG: --kube-reserved="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649055 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649058 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649061 2568 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649064 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649067 2568 flags.go:64] FLAG: --lock-file="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649070 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649073 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649076 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649081 2568 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649084 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649102 2568 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649105 2568 flags.go:64] FLAG: --logging-format="text" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649108 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649113 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649116 2568 flags.go:64] FLAG: --manifest-url="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649119 2568 flags.go:64] FLAG: --manifest-url-header="" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649126 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649129 2568 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649133 2568 flags.go:64] FLAG: --max-pods="110" Sep 10 00:00:15.654919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649137 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649140 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649143 2568 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649146 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649149 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649151 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649154 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649162 2568 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649165 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649168 2568 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649171 2568 flags.go:64] FLAG: --pod-cidr="" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649174 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649179 2568 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649182 2568 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649185 2568 flags.go:64] FLAG: --pods-per-core="0" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649188 2568 flags.go:64] FLAG: --port="10250" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649190 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649194 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc76028163a224ae" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649197 2568 flags.go:64] FLAG: --qos-reserved="" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649200 2568 flags.go:64] FLAG: --read-only-port="10255" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649203 2568 flags.go:64] FLAG: --register-node="true" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649206 2568 flags.go:64] FLAG: --register-with-taints="" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649209 2568 flags.go:64] FLAG: --registry-burst="10" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649213 2568 flags.go:64] FLAG: --registry-qps="5" Sep 10 00:00:15.655549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649216 2568 flags.go:64] FLAG: --reserved-cpus="" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649219 2568 flags.go:64] FLAG: --reserved-memory="" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649222 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649227 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649230 2568 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649232 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649236 2568 flags.go:64] FLAG: --runonce="false" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649239 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649242 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649245 2568 flags.go:64] FLAG: --seccomp-default="false" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649249 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649252 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649255 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649258 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649261 2568 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649264 2568 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649267 2568 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649270 2568 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649273 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649276 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649279 2568 flags.go:64] FLAG: --system-cgroups="" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649282 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649287 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649290 2568 flags.go:64] FLAG: --tls-cert-file="" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649293 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 00:00:15.656216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649296 2568 flags.go:64] FLAG: --tls-min-version="" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649299 2568 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649302 2568 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649304 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649307 2568 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649310 2568 flags.go:64] FLAG: --v="2" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649314 2568 flags.go:64] FLAG: --version="false" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649319 2568 flags.go:64] FLAG: --vmodule="" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649322 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.649326 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649448 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649452 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649454 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649459 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649461 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649464 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649469 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649473 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649475 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649478 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649481 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649484 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:00:15.656861 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649486 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649490 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649492 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649495 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649498 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649500 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649503 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649505 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649508 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649510 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649513 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649515 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649518 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649521 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649523 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649526 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649528 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649531 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649534 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649536 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:00:15.657414 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649540 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649543 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649545 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649549 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649552 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649554 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649557 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649561 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649565 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649568 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649571 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649574 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649577 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649579 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649582 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649585 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649588 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649590 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649592 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649595 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:00:15.657923 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649598 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649601 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649603 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649606 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649608 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649611 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649613 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649616 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649618 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649621 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649624 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649629 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649633 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649636 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649638 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649642 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649645 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649647 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649650 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:00:15.658480 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649652 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649655 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649657 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649660 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649662 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649665 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649667 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649670 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649673 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649675 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649678 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649680 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649683 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649685 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649688 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649690 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649693 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649695 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649698 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:00:15.658940 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649701 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649703 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649706 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649708 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649711 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649713 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649718 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649721 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.649725 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.650241 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.657582 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.657599 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.658575 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.658584 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 00:00:15.659462 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658652 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658659 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658663 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658667 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658670 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658673 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658675 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658678 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658681 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658684 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658686 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658689 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658693 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658695 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658698 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658700 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658703 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658706 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658709 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:00:15.659817 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658711 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658714 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658716 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658719 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658721 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658724 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658727 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658729 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658732 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658735 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658744 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658747 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658750 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658753 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658756 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658758 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658761 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658764 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658766 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658768 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:00:15.660307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658771 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658773 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658776 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658778 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658781 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658783 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658786 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658789 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658791 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658794 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658796 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658799 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658801 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658804 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658808 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658812 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658815 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658818 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658821 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658823 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:00:15.660797 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658826 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658829 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658832 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658840 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658845 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658848 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658851 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658854 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658857 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658859 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658862 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658864 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658867 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658869 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658872 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658874 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658877 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658880 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658882 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658885 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:00:15.661304 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658888 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658890 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658893 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658895 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658898 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658901 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658903 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658906 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658908 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658911 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658913 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658916 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658919 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658921 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658925 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658928 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658935 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658938 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658941 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:00:15.661789 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.658944 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.658949 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659111 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659119 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659123 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659126 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659129 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659132 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659134 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659137 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659140 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659142 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659146 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659150 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659153 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:00:15.662307 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659156 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659159 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659161 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659164 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659167 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659170 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659173 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659175 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659178 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659180 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659183 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659185 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659188 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659191 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659194 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659202 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659205 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659208 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659210 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659213 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:00:15.662690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659215 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659218 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659220 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659223 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659225 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659228 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659230 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659233 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659235 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659238 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659241 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659249 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659252 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659254 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659256 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659259 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659261 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659264 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659266 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659269 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:00:15.663200 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659271 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659274 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659277 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659280 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659283 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659285 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659288 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659292 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659301 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659304 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659306 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659309 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659312 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659314 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659317 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659320 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659322 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659325 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659327 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:00:15.663690 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659330 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659332 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659335 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659337 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659340 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659342 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659345 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659347 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659349 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659352 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659354 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659361 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659364 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659367 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659370 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659373 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659377 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659380 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659382 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:00:15.664179 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659385 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659388 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659390 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659398 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659401 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659404 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659406 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:15.659409 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.659414 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.659570 2568 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.661896 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.662777 2568 server.go:1019] "Starting client certificate rotation" Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.662906 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 00:00:15.664636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.662968 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 00:00:15.665454 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.665436 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 00:00:15.666873 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.666855 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 00:00:15.675877 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.675855 2568 log.go:25] "Validated CRI v1 runtime API" Sep 10 00:00:15.678778 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.678759 2568 log.go:25] "Validated CRI v1 image API" Sep 10 00:00:15.681972 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.681952 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 00:00:15.687473 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.687450 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9b5f83fa-ec80-4480-84b9-ddd9dd8d3e90:/dev/nvme0n1p4 b7e0deaf-afed-4c07-a269-4c3eacd6d68b:/dev/nvme0n1p3] Sep 10 00:00:15.687558 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.687472 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 00:00:15.691027 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.691007 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 00:00:15.694254 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.694131 2568 manager.go:216] Machine: {Timestamp:2026-09-10 00:00:15.691731076 +0000 UTC m=+0.345401166 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099950 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5f076b9ab8caf68ab0e47fd27f66 SystemUUID:ec2e5f07-6b9a-b8ca-f68a-b0e47fd27f66 BootID:a7e9f88f-9ee9-45b1-99d9-d048dded5849 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a7:88:31:0a:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a7:88:31:0a:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:0b:99:17:de:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 00:00:15.694254 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.694249 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 00:00:15.694383 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.694352 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 00:00:15.697177 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.697151 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 00:00:15.697337 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.697181 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 00:00:15.697974 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.697964 2568 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 00:00:15.698009 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.697977 2568 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 00:00:15.698009 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.697991 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 00:00:15.698601 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.698590 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 00:00:15.699375 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.699365 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 00:00:15.703049 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703036 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 10 00:00:15.703181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703171 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 00:00:15.703214 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703203 2568 kubelet.go:486] "Attempting to sync node with API server" Sep 10 00:00:15.703247 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703218 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 00:00:15.703247 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703237 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 00:00:15.703310 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703250 2568 kubelet.go:398] "Adding apiserver pod source" Sep 10 00:00:15.703310 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703262 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 00:00:15.703823 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703808 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 00:00:15.703901 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.703834 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 00:00:15.706439 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.706421 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 00:00:15.708904 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.708885 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 00:00:15.708978 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.708938 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 00:00:15.709768 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709754 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 00:00:15.709814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709775 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 00:00:15.709814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709786 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 00:00:15.709814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709793 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 00:00:15.709814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709801 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 00:00:15.709814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709807 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 00:00:15.709946 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709926 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 00:00:15.709946 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709942 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 00:00:15.709997 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709948 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 00:00:15.709997 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709954 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 00:00:15.709997 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709969 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 00:00:15.709997 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.709977 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 00:00:15.711223 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.711212 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 00:00:15.711223 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.711222 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 00:00:15.713427 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.713408 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 00:00:15.713553 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.713515 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 00:00:15.713730 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.713694 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 00:00:15.714938 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.714922 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qqll9" Sep 10 00:00:15.715644 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.715624 2568 server.go:1268] "Started kubelet" Sep 10 00:00:15.715839 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.715782 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 00:00:15.715897 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.715869 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 00:00:15.716521 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.716491 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 00:00:15.716535 ip-10-0-130-253 systemd[1]: Started Kubernetes Kubelet. Sep 10 00:00:15.718147 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.718117 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 00:00:15.720556 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.720536 2568 server.go:310] "Adding debug handlers to kubelet server" Sep 10 00:00:15.721785 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.721763 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qqll9" Sep 10 00:00:15.723465 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.723443 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 00:00:15.725409 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.724382 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-253.ec2.internal.18d3cc94a076f6ca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-253.ec2.internal,UID:ip-10-0-130-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-253.ec2.internal,},FirstTimestamp:2026-09-10 00:00:15.715595978 +0000 UTC m=+0.369266069,LastTimestamp:2026-09-10 00:00:15.715595978 +0000 UTC m=+0.369266069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-253.ec2.internal,}" Sep 10 00:00:15.725514 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.725439 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 00:00:15.725580 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.725515 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 00:00:15.725635 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.725593 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:15.725997 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.725978 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 00:00:15.725997 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.725997 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 00:00:15.726154 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726147 2568 reconstruct.go:97] "Volume reconstruction finished" Sep 10 00:00:15.726204 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726156 2568 reconciler.go:29] "Reconciler: start to sync state" Sep 10 00:00:15.726411 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726397 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 00:00:15.726497 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726476 2568 factory.go:55] Registering systemd factory Sep 10 00:00:15.726553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726501 2568 factory.go:223] Registration of the systemd container factory successfully Sep 10 00:00:15.726748 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726733 2568 factory.go:153] Registering CRI-O factory Sep 10 00:00:15.726825 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726753 2568 factory.go:223] Registration of the crio container factory successfully Sep 10 00:00:15.726825 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726807 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 00:00:15.726924 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726827 2568 factory.go:103] Registering Raw factory Sep 10 00:00:15.726924 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.726843 2568 manager.go:1196] Started watching for new ooms in manager Sep 10 00:00:15.727353 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.727338 2568 manager.go:349] Starting recovery of all containers Sep 10 00:00:15.732493 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.732463 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:00:15.735961 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.735929 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.737663 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.737637 2568 manager.go:354] Recovery completed Sep 10 00:00:15.742527 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.742513 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.744381 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.744363 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.744451 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.744410 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.744451 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.744425 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.745047 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.745032 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 00:00:15.745047 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.745046 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.745195 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.745046 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 00:00:15.745195 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.745156 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 10 00:00:15.746204 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.746185 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.746264 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.746222 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.746264 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.746235 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.747264 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.747251 2568 policy_none.go:49] "None policy: Start" Sep 10 00:00:15.747329 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.747271 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 00:00:15.747329 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.747284 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 00:00:15.749270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.749256 2568 policy_none.go:47] "Start" Sep 10 00:00:15.825742 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.825672 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:15.838920 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.838894 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 00:00:15.840043 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.840023 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 00:00:15.840166 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.840082 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 00:00:15.840166 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.840123 2568 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 00:00:15.840266 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.840170 2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 10 00:00:15.842786 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.842762 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:00:15.846726 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.846713 2568 manager.go:337] "Starting Device Plugin manager" Sep 10 00:00:15.846821 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.846756 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 00:00:15.846821 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.846766 2568 server.go:87] "Starting device plugin registration server" Sep 10 00:00:15.847023 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.847011 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 00:00:15.847108 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.847024 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 00:00:15.847171 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.847143 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 00:00:15.847230 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.847223 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 00:00:15.847278 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.847234 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 00:00:15.848332 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.848121 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 00:00:15.848453 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.848360 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:15.940576 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.940439 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal"] Sep 10 00:00:15.940576 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.940564 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.941613 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.941596 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.941711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.941624 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.941711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.941635 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.945437 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.945423 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.945590 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.945573 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.945647 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.945605 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.947086 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947072 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.947637 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947619 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.947637 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947627 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.947766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947646 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.947766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947651 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.947766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947663 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.947766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947667 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.947897 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947804 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.947897 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947832 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.947897 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947842 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.947897 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.947860 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.950079 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.950065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.950138 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.950106 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:00:15.952835 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.952726 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:00:15.952835 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.952756 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:00:15.952835 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.952770 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:00:15.954833 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:15.954816 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.954905 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.954837 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-253.ec2.internal\": node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:15.967784 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.967763 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Sep 10 00:00:15.967873 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.967860 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:15.973588 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:15.973572 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.027441 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.027410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bba311649d377e124ea7f98d7dc491df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"bba311649d377e124ea7f98d7dc491df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.027554 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.027445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba311649d377e124ea7f98d7dc491df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"bba311649d377e124ea7f98d7dc491df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.027554 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.027464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e526b43fd5ad3b0e4f031d75eb1c3ee9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"e526b43fd5ad3b0e4f031d75eb1c3ee9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.068154 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.068125 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.127737 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.127702 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bba311649d377e124ea7f98d7dc491df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"bba311649d377e124ea7f98d7dc491df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.127737 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.127737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba311649d377e124ea7f98d7dc491df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"bba311649d377e124ea7f98d7dc491df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.127898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.127763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e526b43fd5ad3b0e4f031d75eb1c3ee9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"e526b43fd5ad3b0e4f031d75eb1c3ee9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.127898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.127811 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e526b43fd5ad3b0e4f031d75eb1c3ee9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"e526b43fd5ad3b0e4f031d75eb1c3ee9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.127898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.127823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba311649d377e124ea7f98d7dc491df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"bba311649d377e124ea7f98d7dc491df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.127898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.127811 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bba311649d377e124ea7f98d7dc491df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"bba311649d377e124ea7f98d7dc491df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.169080 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.169050 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.269995 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.269907 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.271124 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.271088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.276801 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.276242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Sep 10 00:00:16.371907 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.371857 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.473926 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.473882 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.575863 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.575812 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.664112 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.664064 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 00:00:16.664568 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.664267 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 00:00:16.664568 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.664274 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 00:00:16.676270 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.676220 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.726805 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.726767 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:55:15 +0000 UTC" deadline="2028-03-09 09:52:23.226516634 +0000 UTC" Sep 10 00:00:16.726805 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.726804 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13113h52m6.499717946s" Sep 10 00:00:16.777578 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.777519 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.880223 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.880137 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.981261 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:16.981228 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Sep 10 00:00:16.988740 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:16.988566 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:00:17.026128 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.026078 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Sep 10 00:00:17.038136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.038094 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 00:00:17.040177 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.040151 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Sep 10 00:00:17.047229 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.047209 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 00:00:17.097886 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:17.097849 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba311649d377e124ea7f98d7dc491df.slice/crio-c6f6c72eefd443f2bc0a240b8b27ce2981b067f020621c435d7e44cdc096a028 WatchSource:0}: Error finding container c6f6c72eefd443f2bc0a240b8b27ce2981b067f020621c435d7e44cdc096a028: Status 404 returned error can't find the container with id c6f6c72eefd443f2bc0a240b8b27ce2981b067f020621c435d7e44cdc096a028 Sep 10 00:00:17.098331 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:17.098304 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode526b43fd5ad3b0e4f031d75eb1c3ee9.slice/crio-f0ae06b380d0602404ec1a75e50be041c38acbf90dbe95a9c47e404424975916 WatchSource:0}: Error finding container f0ae06b380d0602404ec1a75e50be041c38acbf90dbe95a9c47e404424975916: Status 404 returned error can't find the container with id f0ae06b380d0602404ec1a75e50be041c38acbf90dbe95a9c47e404424975916 Sep 10 00:00:17.102694 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.102678 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:00:17.287692 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.287597 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:00:17.704732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.704703 2568 apiserver.go:52] "Watching apiserver" Sep 10 00:00:17.712673 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.712638 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 00:00:17.713035 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.713012 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-qvbjl","openshift-ovn-kubernetes/ovnkube-node-8k5x7","kube-system/global-pull-secret-syncer-lgw5s","kube-system/konnectivity-agent-r6z7n","kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bt2ts","openshift-image-registry/node-ca-qv2wk","openshift-multus/network-metrics-daemon-wm5p2","openshift-network-operator/iptables-alerter-d2fjg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz","openshift-dns/node-resolver-4klxw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal","openshift-multus/multus-6j8tv","openshift-multus/multus-additional-cni-plugins-xqj6h"] Sep 10 00:00:17.717094 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.717075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.719191 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.719151 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.721141 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.721120 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.721417 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.721393 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.721512 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.721449 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.721512 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.721475 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:17.722638 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.721897 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wv68c\"" Sep 10 00:00:17.722638 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.722212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.722638 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.722293 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2gx9r\"" Sep 10 00:00:17.722638 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.722460 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 00:00:17.722638 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.722330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.724416 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.724145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.726200 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.726167 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 00:00:17.726712 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.726559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.726813 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.726738 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 00:00:17.727131 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.727113 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 00:00:17.727309 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.727294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dqkdl\"" Sep 10 00:00:17.728779 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.728757 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.730051 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.730032 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 00:00:17.730152 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.730039 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ghxck\"" Sep 10 00:00:17.730567 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.730549 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 00:00:17.730805 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.730791 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.730931 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.730917 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 00:00:17.731044 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.731025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.732596 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.732579 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.733199 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.733181 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.733277 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.733201 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hkv9s\"" Sep 10 00:00:17.733602 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.733585 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.733690 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.733675 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.733805 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.733770 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 00:00:17.733962 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.733943 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.736235 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.736597 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-systemd\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736709 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736606 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-run\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736709 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffda525e-3a3a-448e-990a-c4fdea467742-etc-tuned\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736709 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eea4d69e-4262-4ada-883d-414366774ac0-agent-certs\") pod \"konnectivity-agent-r6z7n\" (UID: \"eea4d69e-4262-4ada-883d-414366774ac0\") " pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.736709 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736689 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736721 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-kubernetes\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-sys\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736784 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-lib-modules\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-host\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/711e44ff-c988-4cda-8ebe-a352a005b596-host\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8q67\" (UniqueName: \"kubernetes.io/projected/4c51a859-b066-4e25-93f1-101b4ab1bae3-kube-api-access-w8q67\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736873 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-kubelet-config\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.736919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-var-lib-kubelet\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzbh9\" (UniqueName: \"kubernetes.io/projected/711e44ff-c988-4cda-8ebe-a352a005b596-kube-api-access-kzbh9\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-modprobe-d\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.736998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-system-cni-dir\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737023 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c51a859-b066-4e25-93f1-101b4ab1bae3-hosts-file\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c51a859-b066-4e25-93f1-101b4ab1bae3-tmp-dir\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-dbus\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysctl-conf\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gkmh\" (UniqueName: \"kubernetes.io/projected/ffda525e-3a3a-448e-990a-c4fdea467742-kube-api-access-6gkmh\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/711e44ff-c988-4cda-8ebe-a352a005b596-serviceca\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.737226 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737218 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eea4d69e-4262-4ada-883d-414366774ac0-konnectivity-ca\") pod \"konnectivity-agent-r6z7n\" (UID: \"eea4d69e-4262-4ada-883d-414366774ac0\") " pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cnibin\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysconfig\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffda525e-3a3a-448e-990a-c4fdea467742-tmp\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcdqz\" (UniqueName: \"kubernetes.io/projected/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-kube-api-access-pcdqz\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.737587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.737380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysctl-d\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.738916 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.738897 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.739171 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.739152 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.739327 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.739306 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 00:00:17.740516 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.740496 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 00:00:17.740516 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.740510 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c4zmz\"" Sep 10 00:00:17.740925 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.740907 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 00:00:17.741467 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.741444 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:17.741546 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.741519 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:17.744116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.744098 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:17.744211 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.744190 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:17.746991 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.746973 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748531 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748556 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748592 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748635 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748674 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748634 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n6z72\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748730 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wz2jl\"" Sep 10 00:00:17.748763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.748743 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 00:00:17.749419 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.749403 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hm4t\"" Sep 10 00:00:17.756760 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.756741 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 00:00:17.780829 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.780808 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-84g9d" Sep 10 00:00:17.787335 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.786850 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-84g9d" Sep 10 00:00:17.828004 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.827971 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 00:00:17.838469 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.838469 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-cni-binary-copy\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.838711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-multus-certs\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.838711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-cni-bin\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.838711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-cni-netd\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.838711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-socket-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.838711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c51a859-b066-4e25-93f1-101b4ab1bae3-tmp-dir\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.838711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysctl-conf\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gkmh\" (UniqueName: \"kubernetes.io/projected/ffda525e-3a3a-448e-990a-c4fdea467742-kube-api-access-6gkmh\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-socket-dir-parent\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-kubelet\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-log-socket\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.838995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cnibin\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.839030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysconfig\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffda525e-3a3a-448e-990a-c4fdea467742-tmp\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-slash\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839105 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-run-netns\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-systemd\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.839148 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-registration-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c51a859-b066-4e25-93f1-101b4ab1bae3-tmp-dir\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839077 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysctl-conf\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cnibin\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.839239 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:00:18.339216715 +0000 UTC m=+2.992886817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839155 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysconfig\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcdqz\" (UniqueName: \"kubernetes.io/projected/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-kube-api-access-pcdqz\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839318 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysctl-d\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839284 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-cni-bin\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.839404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-systemd-units\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839441 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-node-log\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-etc-selinux\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839498 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-sysctl-d\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-kubernetes\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-lib-modules\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839555 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-kubernetes\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/711e44ff-c988-4cda-8ebe-a352a005b596-host\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839566 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-netns\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839683 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/711e44ff-c988-4cda-8ebe-a352a005b596-host\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839690 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839686 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-lib-modules\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839735 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-cni-multus\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839752 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2rp\" (UniqueName: \"kubernetes.io/projected/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-kube-api-access-2f2rp\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.840287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839832 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8q67\" (UniqueName: \"kubernetes.io/projected/4c51a859-b066-4e25-93f1-101b4ab1bae3-kube-api-access-w8q67\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzbh9\" (UniqueName: \"kubernetes.io/projected/711e44ff-c988-4cda-8ebe-a352a005b596-kube-api-access-kzbh9\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.839976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovnkube-config\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840006 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsbz\" (UniqueName: \"kubernetes.io/projected/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-kube-api-access-svsbz\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-modprobe-d\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-etc-kubernetes\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovnkube-script-lib\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-host-slash\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgjxq\" (UniqueName: \"kubernetes.io/projected/01d0e490-e4b3-452f-b6b1-70827b5f9469-kube-api-access-pgjxq\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840217 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-modprobe-d\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c51a859-b066-4e25-93f1-101b4ab1bae3-hosts-file\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-cnibin\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.841158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-device-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nd2x\" (UniqueName: \"kubernetes.io/projected/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-kube-api-access-6nd2x\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840370 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c51a859-b066-4e25-93f1-101b4ab1bae3-hosts-file\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-dbus\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/711e44ff-c988-4cda-8ebe-a352a005b596-serviceca\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eea4d69e-4262-4ada-883d-414366774ac0-konnectivity-ca\") pod \"konnectivity-agent-r6z7n\" (UID: \"eea4d69e-4262-4ada-883d-414366774ac0\") " pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-ovn\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-systemd\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840539 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-run\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffda525e-3a3a-448e-990a-c4fdea467742-etc-tuned\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-conf-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-daemon-config\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eea4d69e-4262-4ada-883d-414366774ac0-agent-certs\") pod \"konnectivity-agent-r6z7n\" (UID: \"eea4d69e-4262-4ada-883d-414366774ac0\") " pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-sys\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-host\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.841953 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-hostroot\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841016 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-etc-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-kubelet-config\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841070 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-var-lib-kubelet\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841084 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/711e44ff-c988-4cda-8ebe-a352a005b596-serviceca\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-k8s-cni-cncf-io\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovn-node-metrics-cert\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.840727 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-dbus\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841229 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-sys\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841242 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-run\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4f5x\" (UniqueName: \"kubernetes.io/projected/e95b0252-566a-4352-b9d1-afcabb4c5e56-kube-api-access-w4f5x\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-system-cni-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841309 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-kubelet-config\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-cni-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841329 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-var-lib-kubelet\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-kubelet\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841375 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-etc-systemd\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.842814 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841384 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffda525e-3a3a-448e-990a-c4fdea467742-host\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-var-lib-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-env-overrides\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-sys-fs\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-iptables-alerter-script\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-system-cni-dir\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841673 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eea4d69e-4262-4ada-883d-414366774ac0-konnectivity-ca\") pod \"konnectivity-agent-r6z7n\" (UID: \"eea4d69e-4262-4ada-883d-414366774ac0\") " pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841690 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-system-cni-dir\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.843636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.841741 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.844550 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.844524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffda525e-3a3a-448e-990a-c4fdea467742-tmp\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.844870 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.844845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffda525e-3a3a-448e-990a-c4fdea467742-etc-tuned\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.845085 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.845057 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eea4d69e-4262-4ada-883d-414366774ac0-agent-certs\") pod \"konnectivity-agent-r6z7n\" (UID: \"eea4d69e-4262-4ada-883d-414366774ac0\") " pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:17.845962 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.845913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" event={"ID":"e526b43fd5ad3b0e4f031d75eb1c3ee9","Type":"ContainerStarted","Data":"f0ae06b380d0602404ec1a75e50be041c38acbf90dbe95a9c47e404424975916"} Sep 10 00:00:17.847347 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.847319 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"bba311649d377e124ea7f98d7dc491df","Type":"ContainerStarted","Data":"c6f6c72eefd443f2bc0a240b8b27ce2981b067f020621c435d7e44cdc096a028"} Sep 10 00:00:17.850607 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.850583 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gkmh\" (UniqueName: \"kubernetes.io/projected/ffda525e-3a3a-448e-990a-c4fdea467742-kube-api-access-6gkmh\") pod \"tuned-bt2ts\" (UID: \"ffda525e-3a3a-448e-990a-c4fdea467742\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:17.851843 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.851819 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8q67\" (UniqueName: \"kubernetes.io/projected/4c51a859-b066-4e25-93f1-101b4ab1bae3-kube-api-access-w8q67\") pod \"node-resolver-4klxw\" (UID: \"4c51a859-b066-4e25-93f1-101b4ab1bae3\") " pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:17.852471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.852447 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzbh9\" (UniqueName: \"kubernetes.io/projected/711e44ff-c988-4cda-8ebe-a352a005b596-kube-api-access-kzbh9\") pod \"node-ca-qv2wk\" (UID: \"711e44ff-c988-4cda-8ebe-a352a005b596\") " pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:17.852616 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.852447 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcdqz\" (UniqueName: \"kubernetes.io/projected/6c48cabe-0dbf-44e8-9bf7-8121f2e586fa-kube-api-access-pcdqz\") pod \"multus-additional-cni-plugins-xqj6h\" (UID: \"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa\") " pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:17.942891 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.942854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-ovn\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.942891 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.942893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.942912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-conf-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.942930 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-daemon-config\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.942972 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-ovn\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943001 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-conf-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-hostroot\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943039 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-hostroot\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943053 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-etc-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943079 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-etc-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-k8s-cni-cncf-io\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943181 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovn-node-metrics-cert\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4f5x\" (UniqueName: \"kubernetes.io/projected/e95b0252-566a-4352-b9d1-afcabb4c5e56-kube-api-access-w4f5x\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943218 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-k8s-cni-cncf-io\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943229 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-system-cni-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-cni-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943280 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-kubelet\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943305 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-var-lib-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943334 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-system-cni-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-cni-dir\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943376 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-var-lib-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943379 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-kubelet\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943404 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-openvswitch\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-env-overrides\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943443 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-sys-fs\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-iptables-alerter-script\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-daemon-config\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-cni-binary-copy\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.943732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-sys-fs\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943531 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-multus-certs\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943570 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-multus-certs\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-cni-bin\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-cni-netd\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-socket-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943665 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-cni-bin\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943675 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-cni-netd\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943686 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-socket-dir-parent\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943719 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-kubelet\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-log-socket\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-slash\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943795 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-socket-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943811 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-run-netns\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-systemd\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-registration-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-cni-bin\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.944710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-slash\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-systemd-units\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943978 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-env-overrides\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944001 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-iptables-alerter-script\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-node-log\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944016 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-node-log\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944026 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-run-systemd\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943743 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-multus-socket-dir-parent\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.943982 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-systemd-units\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944071 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-cni-bin\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944085 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-registration-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-cni-binary-copy\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-etc-selinux\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944095 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-kubelet\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944098 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-run-netns\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944141 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-log-socket\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944169 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-etc-selinux\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-netns\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.945626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944210 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-cni-multus\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944215 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-run-netns\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2rp\" (UniqueName: \"kubernetes.io/projected/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-kube-api-access-2f2rp\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944247 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-host-var-lib-cni-multus\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovnkube-config\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsbz\" (UniqueName: \"kubernetes.io/projected/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-kube-api-access-svsbz\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944355 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944367 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944390 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-etc-kubernetes\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944396 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944438 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-etc-kubernetes\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944446 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.944471 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovnkube-script-lib\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.946557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-host-slash\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgjxq\" (UniqueName: \"kubernetes.io/projected/01d0e490-e4b3-452f-b6b1-70827b5f9469-kube-api-access-pgjxq\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.944569 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:18.444550573 +0000 UTC m=+3.098220652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944590 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-host-slash\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.945002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-cnibin\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.945195 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovnkube-config\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.944597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-cnibin\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.945323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-device-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.945363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nd2x\" (UniqueName: \"kubernetes.io/projected/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-kube-api-access-6nd2x\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.945472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovnkube-script-lib\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.947393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.945724 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01d0e490-e4b3-452f-b6b1-70827b5f9469-device-dir\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.949320 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.949290 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-ovn-node-metrics-cert\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.949459 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.949440 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:17.949533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.949466 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:17.949533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.949481 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:17.949638 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:17.949560 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:00:18.449539425 +0000 UTC m=+3.103209539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:17.951782 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.951753 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2rp\" (UniqueName: \"kubernetes.io/projected/497d9d9c-412d-4ca9-9fa5-6d2fe9963189-kube-api-access-2f2rp\") pod \"multus-6j8tv\" (UID: \"497d9d9c-412d-4ca9-9fa5-6d2fe9963189\") " pod="openshift-multus/multus-6j8tv" Sep 10 00:00:17.951915 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.951897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4f5x\" (UniqueName: \"kubernetes.io/projected/e95b0252-566a-4352-b9d1-afcabb4c5e56-kube-api-access-w4f5x\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:17.952711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.952690 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsbz\" (UniqueName: \"kubernetes.io/projected/3c666a1b-ae08-4cfa-8356-6b7f175f4bbf-kube-api-access-svsbz\") pod \"ovnkube-node-8k5x7\" (UID: \"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:17.955635 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.955577 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nd2x\" (UniqueName: \"kubernetes.io/projected/4bd3ad82-5bf3-4c26-bced-80fd62222a0c-kube-api-access-6nd2x\") pod \"iptables-alerter-d2fjg\" (UID: \"4bd3ad82-5bf3-4c26-bced-80fd62222a0c\") " pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:17.956411 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.956394 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgjxq\" (UniqueName: \"kubernetes.io/projected/01d0e490-e4b3-452f-b6b1-70827b5f9469-kube-api-access-pgjxq\") pod \"aws-ebs-csi-driver-node-l75tz\" (UID: \"01d0e490-e4b3-452f-b6b1-70827b5f9469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:17.981648 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.981618 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:00:17.990780 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:17.990758 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:00:18.029483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.029437 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qv2wk" Sep 10 00:00:18.036660 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.036622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4klxw" Sep 10 00:00:18.042151 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.042118 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711e44ff_c988_4cda_8ebe_a352a005b596.slice/crio-2c1e420408739cfc50d81d3402bd24ace43f3c5820e22c6d403acdf107a66fb1 WatchSource:0}: Error finding container 2c1e420408739cfc50d81d3402bd24ace43f3c5820e22c6d403acdf107a66fb1: Status 404 returned error can't find the container with id 2c1e420408739cfc50d81d3402bd24ace43f3c5820e22c6d403acdf107a66fb1 Sep 10 00:00:18.044367 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.044291 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:18.048778 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.048753 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c51a859_b066_4e25_93f1_101b4ab1bae3.slice/crio-d51bc37f48668b6c81cf282a9ac31b6d6fa32c5ccaac565715d4e9bfeb68731d WatchSource:0}: Error finding container d51bc37f48668b6c81cf282a9ac31b6d6fa32c5ccaac565715d4e9bfeb68731d: Status 404 returned error can't find the container with id d51bc37f48668b6c81cf282a9ac31b6d6fa32c5ccaac565715d4e9bfeb68731d Sep 10 00:00:18.049854 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.049831 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" Sep 10 00:00:18.056386 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.056247 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" Sep 10 00:00:18.056775 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.056748 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea4d69e_4262_4ada_883d_414366774ac0.slice/crio-91ce853f09b132688cd2d1fdeb052307e4ce28fa2aff8f552ce4bb4351fcf1db WatchSource:0}: Error finding container 91ce853f09b132688cd2d1fdeb052307e4ce28fa2aff8f552ce4bb4351fcf1db: Status 404 returned error can't find the container with id 91ce853f09b132688cd2d1fdeb052307e4ce28fa2aff8f552ce4bb4351fcf1db Sep 10 00:00:18.062920 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.062851 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d2fjg" Sep 10 00:00:18.065720 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.065691 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c48cabe_0dbf_44e8_9bf7_8121f2e586fa.slice/crio-75323e46d0e8530cb7a77833d141efd656f5142a4b0b79d2f76e7f4b073ffb98 WatchSource:0}: Error finding container 75323e46d0e8530cb7a77833d141efd656f5142a4b0b79d2f76e7f4b073ffb98: Status 404 returned error can't find the container with id 75323e46d0e8530cb7a77833d141efd656f5142a4b0b79d2f76e7f4b073ffb98 Sep 10 00:00:18.068869 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.068846 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6j8tv" Sep 10 00:00:18.069241 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.069214 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffda525e_3a3a_448e_990a_c4fdea467742.slice/crio-dc1169e5c68d3ef870ece313c9947cca1f1cbce84f40428beb391d1fc5ceac77 WatchSource:0}: Error finding container dc1169e5c68d3ef870ece313c9947cca1f1cbce84f40428beb391d1fc5ceac77: Status 404 returned error can't find the container with id dc1169e5c68d3ef870ece313c9947cca1f1cbce84f40428beb391d1fc5ceac77 Sep 10 00:00:18.074716 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.074696 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:18.074936 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.074913 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd3ad82_5bf3_4c26_bced_80fd62222a0c.slice/crio-1822a02d60748a90fd11317b3ea0d332f70fc31e1a892553690c8ee7c2e10afa WatchSource:0}: Error finding container 1822a02d60748a90fd11317b3ea0d332f70fc31e1a892553690c8ee7c2e10afa: Status 404 returned error can't find the container with id 1822a02d60748a90fd11317b3ea0d332f70fc31e1a892553690c8ee7c2e10afa Sep 10 00:00:18.079680 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.079659 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" Sep 10 00:00:18.080337 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.080112 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497d9d9c_412d_4ca9_9fa5_6d2fe9963189.slice/crio-f8e7b512bd233d27ef1ae4ba643f7e9f37463bd7b5b376d280816494542a0e39 WatchSource:0}: Error finding container f8e7b512bd233d27ef1ae4ba643f7e9f37463bd7b5b376d280816494542a0e39: Status 404 returned error can't find the container with id f8e7b512bd233d27ef1ae4ba643f7e9f37463bd7b5b376d280816494542a0e39 Sep 10 00:00:18.088962 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.088933 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c666a1b_ae08_4cfa_8356_6b7f175f4bbf.slice/crio-d228c1c006873bed6d8454b74a2ab6644f13c0afa35a9682b813228469a406e9 WatchSource:0}: Error finding container d228c1c006873bed6d8454b74a2ab6644f13c0afa35a9682b813228469a406e9: Status 404 returned error can't find the container with id d228c1c006873bed6d8454b74a2ab6644f13c0afa35a9682b813228469a406e9 Sep 10 00:00:18.093612 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:18.093577 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d0e490_e4b3_452f_b6b1_70827b5f9469.slice/crio-4c1ac1b37fd95de9912158425ea0752029e3d16a99b741a2216cc8a3a98ddc39 WatchSource:0}: Error finding container 4c1ac1b37fd95de9912158425ea0752029e3d16a99b741a2216cc8a3a98ddc39: Status 404 returned error can't find the container with id 4c1ac1b37fd95de9912158425ea0752029e3d16a99b741a2216cc8a3a98ddc39 Sep 10 00:00:18.349836 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.349653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:18.349836 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.349800 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:18.350098 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.349876 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:00:19.349854795 +0000 UTC m=+4.003524883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:18.450662 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.450627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:18.450845 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.450672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:18.450845 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.450795 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:18.450845 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.450811 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:18.450845 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.450826 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:18.450845 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.450838 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:18.451045 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.450870 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:19.450849437 +0000 UTC m=+4.104519535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:18.451045 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.450889 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:00:19.450879623 +0000 UTC m=+4.104549713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:18.791065 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.791006 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:55:17 +0000 UTC" deadline="2028-03-01 04:15:01.589254607 +0000 UTC" Sep 10 00:00:18.791808 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.791068 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12916h14m42.798195569s" Sep 10 00:00:18.840600 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.840567 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:18.840736 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:18.840715 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:18.851650 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.851617 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d2fjg" event={"ID":"4bd3ad82-5bf3-4c26-bced-80fd62222a0c","Type":"ContainerStarted","Data":"1822a02d60748a90fd11317b3ea0d332f70fc31e1a892553690c8ee7c2e10afa"} Sep 10 00:00:18.853214 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.853177 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerStarted","Data":"75323e46d0e8530cb7a77833d141efd656f5142a4b0b79d2f76e7f4b073ffb98"} Sep 10 00:00:18.854670 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.854639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6z7n" event={"ID":"eea4d69e-4262-4ada-883d-414366774ac0","Type":"ContainerStarted","Data":"91ce853f09b132688cd2d1fdeb052307e4ce28fa2aff8f552ce4bb4351fcf1db"} Sep 10 00:00:18.855940 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.855915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4klxw" event={"ID":"4c51a859-b066-4e25-93f1-101b4ab1bae3","Type":"ContainerStarted","Data":"d51bc37f48668b6c81cf282a9ac31b6d6fa32c5ccaac565715d4e9bfeb68731d"} Sep 10 00:00:18.858326 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.858281 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qv2wk" event={"ID":"711e44ff-c988-4cda-8ebe-a352a005b596","Type":"ContainerStarted","Data":"2c1e420408739cfc50d81d3402bd24ace43f3c5820e22c6d403acdf107a66fb1"} Sep 10 00:00:18.864211 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.864176 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" event={"ID":"01d0e490-e4b3-452f-b6b1-70827b5f9469","Type":"ContainerStarted","Data":"4c1ac1b37fd95de9912158425ea0752029e3d16a99b741a2216cc8a3a98ddc39"} Sep 10 00:00:18.866778 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.866745 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"d228c1c006873bed6d8454b74a2ab6644f13c0afa35a9682b813228469a406e9"} Sep 10 00:00:18.868200 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.868164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6j8tv" event={"ID":"497d9d9c-412d-4ca9-9fa5-6d2fe9963189","Type":"ContainerStarted","Data":"f8e7b512bd233d27ef1ae4ba643f7e9f37463bd7b5b376d280816494542a0e39"} Sep 10 00:00:18.869464 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:18.869436 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" event={"ID":"ffda525e-3a3a-448e-990a-c4fdea467742","Type":"ContainerStarted","Data":"dc1169e5c68d3ef870ece313c9947cca1f1cbce84f40428beb391d1fc5ceac77"} Sep 10 00:00:19.357517 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.357476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:19.357735 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.357713 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:19.357817 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.357789 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:00:21.357770076 +0000 UTC m=+6.011440171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:19.458420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.458381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:19.458607 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.458440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:19.458607 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.458587 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:19.458607 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.458606 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:19.458761 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.458620 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:19.458761 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.458678 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:00:21.458658675 +0000 UTC m=+6.112328755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:19.459131 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.459109 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:19.459214 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.459169 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:21.459153049 +0000 UTC m=+6.112823142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:19.791636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.791515 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:55:17 +0000 UTC" deadline="2028-05-18 15:26:27.34390983 +0000 UTC" Sep 10 00:00:19.791636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.791560 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14799h26m7.552354597s" Sep 10 00:00:19.843425 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.843393 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:19.843609 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.843535 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:19.843951 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.843934 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:19.844051 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:19.844032 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:19.880418 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:19.880377 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"bba311649d377e124ea7f98d7dc491df","Type":"ContainerStarted","Data":"161c8b6bc3baa8202b0476aa88e739adefb8fe6dc0329bad7b3488367836fd95"} Sep 10 00:00:20.841405 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:20.841049 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:20.841897 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:20.841528 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:21.371284 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.371238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:21.371482 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.371441 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:21.371559 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.371508 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:00:25.371488441 +0000 UTC m=+10.025158587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.471700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.471757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.471910 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.471927 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.471939 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.471999 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:00:25.471980964 +0000 UTC m=+10.125651066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.472427 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:21.472533 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.472482 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:25.472466503 +0000 UTC m=+10.126136586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:21.840916 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.840876 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:21.841118 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.841041 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:21.841118 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.841073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:21.841290 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:21.841218 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:21.888335 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.888287 2568 generic.go:356] "Generic (PLEG): container finished" podID="bba311649d377e124ea7f98d7dc491df" containerID="161c8b6bc3baa8202b0476aa88e739adefb8fe6dc0329bad7b3488367836fd95" exitCode=0 Sep 10 00:00:21.888335 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:21.888338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"bba311649d377e124ea7f98d7dc491df","Type":"ContainerDied","Data":"161c8b6bc3baa8202b0476aa88e739adefb8fe6dc0329bad7b3488367836fd95"} Sep 10 00:00:22.841108 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:22.840599 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:22.841108 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:22.840729 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:23.840649 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:23.840609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:23.841128 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:23.840767 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:23.841128 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:23.841002 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:23.841260 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:23.841133 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:24.840884 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:24.840836 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:24.841277 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:24.840988 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:25.406705 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:25.406661 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:25.406976 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.406847 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:25.406976 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.406922 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:00:33.406903681 +0000 UTC m=+18.060573762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:25.508137 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:25.508059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:25.508137 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:25.508129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:25.508378 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.508213 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:25.508378 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.508253 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:25.508378 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.508268 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:25.508378 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.508280 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:25.508378 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.508286 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:33.508265725 +0000 UTC m=+18.161935818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:25.508378 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.508313 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:00:33.508304156 +0000 UTC m=+18.161974249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:25.841287 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:25.841251 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:25.841699 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.841389 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:25.846119 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:25.844971 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:25.846119 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:25.845155 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:26.841540 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:26.841013 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:26.841540 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:26.841172 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:27.841347 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:27.841309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:27.841569 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:27.841365 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:27.841569 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:27.841454 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:27.841910 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:27.841628 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:28.840345 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:28.840309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:28.840519 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:28.840434 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:29.841300 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:29.841262 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:29.841769 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:29.841409 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:29.841769 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:29.841469 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:29.841769 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:29.841590 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:30.841074 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:30.841036 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:30.841242 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:30.841188 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:31.841079 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:31.841038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:31.841544 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:31.841038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:31.841544 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:31.841207 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:31.841544 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:31.841309 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:32.840552 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:32.840514 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:32.840762 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:32.840649 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:33.464748 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:33.464704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:33.465234 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.464839 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:33.465234 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.464905 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:00:49.464890353 +0000 UTC m=+34.118560431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:33.565579 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:33.565535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:33.565770 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.565716 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:33.565770 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.565747 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:33.565770 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:33.565749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:33.565770 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.565761 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:33.565956 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.565818 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:00:49.565798587 +0000 UTC m=+34.219468666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:33.565956 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.565867 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:33.565956 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.565928 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:49.565911351 +0000 UTC m=+34.219581450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:33.841306 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:33.841270 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:33.841483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:33.841270 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:33.841483 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.841409 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:33.841598 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:33.841487 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:34.840863 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:34.840824 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:34.841319 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:34.840969 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:35.841671 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:35.841626 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:35.842127 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:35.841775 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:35.842211 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:35.842163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:35.842313 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:35.842286 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:36.841004 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.840977 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:36.841126 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:36.841085 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:36.923370 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.923331 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"bba311649d377e124ea7f98d7dc491df","Type":"ContainerStarted","Data":"91ba425f3ed3978012788f3d84d6ea03baa5bbc31e7d2649bf2a303e3eee430b"} Sep 10 00:00:36.924893 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.924868 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" event={"ID":"01d0e490-e4b3-452f-b6b1-70827b5f9469","Type":"ContainerStarted","Data":"4375733c69dd9f57dd70a5e74f8df7ccf789099018cc76d3aaf579ecf928ce0f"} Sep 10 00:00:36.927494 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.927471 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"43aa5df6adcbd2dad5e6062673dc794d2b94eca84641e7a926ba18361569088e"} Sep 10 00:00:36.927596 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.927530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"86945b46510ad6762cd93596e57f5fef0d177c3e0c9cb64c91238f26f7fb6f08"} Sep 10 00:00:36.927641 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.927584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"1e41fb5f5b7d4a7b246672b3e9c06d97f61cc5ae2d290c976680d2ff2112efab"} Sep 10 00:00:36.927641 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.927628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"e4e2288af13b458a321631a540298d74a21edaff490319be9ef245afb8a6a7a8"} Sep 10 00:00:36.928925 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.928902 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6j8tv" event={"ID":"497d9d9c-412d-4ca9-9fa5-6d2fe9963189","Type":"ContainerStarted","Data":"9e7a859c827ec7e71f9631085bc183ecaad788373ca0265d194e6d7c68249a8d"} Sep 10 00:00:36.930420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.930394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" event={"ID":"ffda525e-3a3a-448e-990a-c4fdea467742","Type":"ContainerStarted","Data":"f809161f7a14cc8750647c39fb25aefe00a48687ac513903712a9eefb765bf91"} Sep 10 00:00:36.931810 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.931788 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" event={"ID":"e526b43fd5ad3b0e4f031d75eb1c3ee9","Type":"ContainerStarted","Data":"da1088451f5d990cea7ba4f7feda5f068047e059dbe627567144096e1dd850ea"} Sep 10 00:00:36.935457 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.935429 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c48cabe-0dbf-44e8-9bf7-8121f2e586fa" containerID="b7da200c2e2166cd1157e62d59a0d0cf83a3e00b0c72c35b0a5ec124bd98bb12" exitCode=0 Sep 10 00:00:36.935562 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.935518 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerDied","Data":"b7da200c2e2166cd1157e62d59a0d0cf83a3e00b0c72c35b0a5ec124bd98bb12"} Sep 10 00:00:36.937265 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.937206 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6z7n" event={"ID":"eea4d69e-4262-4ada-883d-414366774ac0","Type":"ContainerStarted","Data":"9c85feff34ea1ff96a183112b97f4f624765f366edfb782f0df601d6c25a2c9b"} Sep 10 00:00:36.938007 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.937951 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" podStartSLOduration=19.937936234 podStartE2EDuration="19.937936234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:36.937935801 +0000 UTC m=+21.591605902" watchObservedRunningTime="2026-09-10 00:00:36.937936234 +0000 UTC m=+21.591606336" Sep 10 00:00:36.939157 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.939135 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4klxw" event={"ID":"4c51a859-b066-4e25-93f1-101b4ab1bae3","Type":"ContainerStarted","Data":"25010caaa4755c3b09812ad187d3883c3cb007cd475a501dd68bdfa8f5a1004d"} Sep 10 00:00:36.940596 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.940572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qv2wk" event={"ID":"711e44ff-c988-4cda-8ebe-a352a005b596","Type":"ContainerStarted","Data":"4b921b1d7bf5e84c5e834fa8c88143d4636c63f823905cd86730dcb2b8f2a9e9"} Sep 10 00:00:36.951733 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.951694 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r6z7n" podStartSLOduration=2.798806391 podStartE2EDuration="20.951682859s" totalImagesPullingTime="18.152876468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:36.95164891 +0000 UTC m=+21.605319010" watchObservedRunningTime="2026-09-10 00:00:36.951682859 +0000 UTC m=+21.605352958" Sep 10 00:00:36.977015 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.976892 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r6z7n_eea4d69e-4262-4ada-883d-414366774ac0/konnectivity-agent/0.log" limit=1024 Sep 10 00:00:36.983313 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.983263 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6j8tv" podStartSLOduration=2.795305442 podStartE2EDuration="20.98324726s" totalImagesPullingTime="18.187941818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:36.982967439 +0000 UTC m=+21.636637539" watchObservedRunningTime="2026-09-10 00:00:36.98324726 +0000 UTC m=+21.636917360" Sep 10 00:00:36.998641 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:36.998594 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bt2ts" podStartSLOduration=2.821929464 podStartE2EDuration="20.998578271s" totalImagesPullingTime="18.176648807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:36.998147261 +0000 UTC m=+21.651817361" watchObservedRunningTime="2026-09-10 00:00:36.998578271 +0000 UTC m=+21.652248369" Sep 10 00:00:37.011062 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.011006 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" podStartSLOduration=20.010985338 podStartE2EDuration="20.010985338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:37.010407042 +0000 UTC m=+21.664077141" watchObservedRunningTime="2026-09-10 00:00:37.010985338 +0000 UTC m=+21.664655441" Sep 10 00:00:37.023210 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.023156 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qv2wk" podStartSLOduration=2.853983144 podStartE2EDuration="21.023134792s" totalImagesPullingTime="18.169151648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:37.022683032 +0000 UTC m=+21.676353132" watchObservedRunningTime="2026-09-10 00:00:37.023134792 +0000 UTC m=+21.676804894" Sep 10 00:00:37.037870 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.037816 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4klxw" podStartSLOduration=2.876017796 podStartE2EDuration="21.037795918s" totalImagesPullingTime="18.161778122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:37.037601727 +0000 UTC m=+21.691271827" watchObservedRunningTime="2026-09-10 00:00:37.037795918 +0000 UTC m=+21.691466017" Sep 10 00:00:37.126054 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.126014 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r6z7n_eea4d69e-4262-4ada-883d-414366774ac0/konnectivity-agent/0.log" limit=1024 Sep 10 00:00:37.159194 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.159139 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:37.159787 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.159766 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:37.177708 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.177658 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r6z7n_eea4d69e-4262-4ada-883d-414366774ac0/konnectivity-agent/0.log" limit=1024 Sep 10 00:00:37.779201 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.779172 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 00:00:37.840713 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.840674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:37.840713 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.840714 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:37.840950 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:37.840817 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:37.841010 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:37.840943 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:37.858497 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.858395 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T00:00:37.779193399Z","UUID":"dcacfc08-ccc1-4cb4-86b0-2cf870f7b68b","Handler":null,"Name":"","Endpoint":""} Sep 10 00:00:37.860055 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.860034 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 00:00:37.860224 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.860067 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 00:00:37.945202 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.945105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d2fjg" event={"ID":"4bd3ad82-5bf3-4c26-bced-80fd62222a0c","Type":"ContainerStarted","Data":"7817eb055fa03a3f1f9a10af5f6446ba574626a5c67bf8ba5aec41c05cceb46e"} Sep 10 00:00:37.947444 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.947411 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" event={"ID":"01d0e490-e4b3-452f-b6b1-70827b5f9469","Type":"ContainerStarted","Data":"23381d6d900d330e4ce41077eec8d7999472bd2442d99585181e78bf79807a52"} Sep 10 00:00:37.951496 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.951461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"663e1081f671c281bdfaf3f5592e8af2e2411d8663e541e46c71b6a331408dc4"} Sep 10 00:00:37.951631 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.951549 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"02067c87eed1ccded430574bd9388a3129a21794ca3c303cb8b4789cc5bbb540"} Sep 10 00:00:37.958435 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:37.958386 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d2fjg" podStartSLOduration=3.822058764 podStartE2EDuration="21.958366448s" totalImagesPullingTime="18.136307684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:37.958230215 +0000 UTC m=+22.611900316" watchObservedRunningTime="2026-09-10 00:00:37.958366448 +0000 UTC m=+22.612036551" Sep 10 00:00:38.075459 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:38.075422 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r6z7n_eea4d69e-4262-4ada-883d-414366774ac0/konnectivity-agent/0.log" limit=1024 Sep 10 00:00:38.125776 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:38.125741 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r6z7n_eea4d69e-4262-4ada-883d-414366774ac0/konnectivity-agent/0.log" limit=1024 Sep 10 00:00:38.840895 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:38.840859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:38.841128 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:38.840998 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:38.954278 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:38.954249 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 00:00:39.841467 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:39.841280 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:39.841659 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:39.841325 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:39.841659 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:39.841580 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:39.841659 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:39.841643 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:39.961184 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:39.961131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"8aea13b858a98b74c0dde5252ab525ed28043dfc96a0679e120548ce6e600d47"} Sep 10 00:00:39.963604 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:39.963574 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" event={"ID":"01d0e490-e4b3-452f-b6b1-70827b5f9469","Type":"ContainerStarted","Data":"453f1e67f22008d2b9d2aabd240c01b65e9e71d82ce495092425ee113e1c8e95"} Sep 10 00:00:39.980067 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:39.980009 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l75tz" podStartSLOduration=3.623427905 podStartE2EDuration="23.97999364s" totalImagesPullingTime="20.356565735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:39.979529274 +0000 UTC m=+24.633199388" watchObservedRunningTime="2026-09-10 00:00:39.97999364 +0000 UTC m=+24.633663759" Sep 10 00:00:40.840529 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:40.840494 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:40.840768 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:40.840619 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:41.840608 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:41.840574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:41.841196 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:41.840574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:41.841196 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:41.840720 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:41.841196 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:41.840776 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:42.841415 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.841229 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:42.842012 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:42.841494 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:42.972929 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.972893 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c48cabe-0dbf-44e8-9bf7-8121f2e586fa" containerID="69dc3e48f49aeafa67dbf0f1249bb094727310bafc958cd80433076b45cb6907" exitCode=0 Sep 10 00:00:42.973116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.972982 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerDied","Data":"69dc3e48f49aeafa67dbf0f1249bb094727310bafc958cd80433076b45cb6907"} Sep 10 00:00:42.979772 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.979748 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" event={"ID":"3c666a1b-ae08-4cfa-8356-6b7f175f4bbf","Type":"ContainerStarted","Data":"15b2b9cfe625433c1f0d122aad27d32285eaa067cec41e8c6ca5073e268139bc"} Sep 10 00:00:42.980069 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.980041 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:42.980241 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.980142 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:42.980241 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.980189 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:42.995801 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.995774 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:42.995947 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:42.995897 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:00:43.017554 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.017505 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" podStartSLOduration=8.70757214 podStartE2EDuration="27.017490178s" totalImagesPullingTime="18.309918038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:43.017416347 +0000 UTC m=+27.671086447" watchObservedRunningTime="2026-09-10 00:00:43.017490178 +0000 UTC m=+27.671160278" Sep 10 00:00:43.840532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.840505 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:43.840635 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:43.840619 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:43.840688 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.840668 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:43.840776 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:43.840759 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:43.929788 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.929750 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lgw5s"] Sep 10 00:00:43.930225 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.929883 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:43.930225 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:43.929989 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:43.933439 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.933411 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wm5p2"] Sep 10 00:00:43.933989 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.933966 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qvbjl"] Sep 10 00:00:43.984741 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.984650 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c48cabe-0dbf-44e8-9bf7-8121f2e586fa" containerID="28890f52f848044f7002b9396e2c38413b7c0a26cea94bf01a98a9e837167310" exitCode=0 Sep 10 00:00:43.984741 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.984737 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:43.984943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.984775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerDied","Data":"28890f52f848044f7002b9396e2c38413b7c0a26cea94bf01a98a9e837167310"} Sep 10 00:00:43.984992 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:43.984955 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:43.985032 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:43.985004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:43.985109 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:43.985076 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:44.989382 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:44.989187 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c48cabe-0dbf-44e8-9bf7-8121f2e586fa" containerID="da6e74439234f53382d97f1c420575158c3159e8d8fc34502b3c512b13cc7058" exitCode=0 Sep 10 00:00:44.989743 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:44.989269 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerDied","Data":"da6e74439234f53382d97f1c420575158c3159e8d8fc34502b3c512b13cc7058"} Sep 10 00:00:45.841675 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:45.841645 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:45.841857 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:45.841726 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:45.841857 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:45.841754 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:45.841966 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:45.841870 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:45.841966 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:45.841909 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:45.842054 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:45.842011 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:47.642175 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:47.642135 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:47.642817 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:47.642317 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 00:00:47.642817 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:47.642786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r6z7n" Sep 10 00:00:47.841229 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:47.841196 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:47.841403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:47.841196 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:47.841403 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:47.841324 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5s" podUID="6189b315-17ce-45d6-9e93-6a7c3c0a2fdc" Sep 10 00:00:47.841525 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:47.841426 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:00:47.841525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:47.841196 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:47.841525 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:47.841516 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qvbjl" podUID="34257945-300d-4d9c-a93c-18e0970f605c" Sep 10 00:00:49.190587 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.190507 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeReady" Sep 10 00:00:49.191322 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.190669 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 00:00:49.222393 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.222356 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dfbf9d9-vqfws"] Sep 10 00:00:49.252158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.252125 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xsn67"] Sep 10 00:00:49.252338 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.252222 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.255123 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.254848 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 00:00:49.255123 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.254951 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5nl5z\"" Sep 10 00:00:49.255330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.255160 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 00:00:49.255330 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.255227 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 00:00:49.260136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.260085 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 00:00:49.268165 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.268142 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qbc9z"] Sep 10 00:00:49.268301 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.268257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.271771 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.271745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 00:00:49.272523 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.272493 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 00:00:49.272664 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.272642 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f86ng\"" Sep 10 00:00:49.286219 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.286185 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dfbf9d9-vqfws"] Sep 10 00:00:49.286219 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.286225 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xsn67"] Sep 10 00:00:49.286434 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.286258 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbc9z"] Sep 10 00:00:49.286434 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.286355 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.288888 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.288816 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 00:00:49.288888 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.288834 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 00:00:49.288888 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.288864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cvsfg\"" Sep 10 00:00:49.289145 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.288957 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 00:00:49.377882 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.377839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-bound-sa-token\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378070 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.377890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952debcd-1153-4dc7-92b5-bc974b35aeeb-tmp-dir\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.378070 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.377980 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378070 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzt72\" (UniqueName: \"kubernetes.io/projected/ada8f14a-4200-4ffd-b094-943cd129508d-kube-api-access-nzt72\") pod \"ingress-canary-qbc9z\" (UID: \"ada8f14a-4200-4ffd-b094-943cd129508d\") " pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.378270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-image-registry-private-configuration\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378149 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-certificates\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-trusted-ca\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378209 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ada8f14a-4200-4ffd-b094-943cd129508d-cert\") pod \"ingress-canary-qbc9z\" (UID: \"ada8f14a-4200-4ffd-b094-943cd129508d\") " pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.378270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kpt\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-kube-api-access-d4kpt\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wmz\" (UniqueName: \"kubernetes.io/projected/952debcd-1153-4dc7-92b5-bc974b35aeeb-kube-api-access-v4wmz\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.378478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/595a5151-f9b3-4edd-9fc8-70ae08410244-ca-trust-extracted\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.378478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-installation-pull-secrets\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.378478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.378427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/952debcd-1153-4dc7-92b5-bc974b35aeeb-config-volume\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.479246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-bound-sa-token\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.479246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952debcd-1153-4dc7-92b5-bc974b35aeeb-tmp-dir\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.479471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.479471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:49.479471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzt72\" (UniqueName: \"kubernetes.io/projected/ada8f14a-4200-4ffd-b094-943cd129508d-kube-api-access-nzt72\") pod \"ingress-canary-qbc9z\" (UID: \"ada8f14a-4200-4ffd-b094-943cd129508d\") " pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.479471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-image-registry-private-configuration\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.479479 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-certificates\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.479499 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479521 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952debcd-1153-4dc7-92b5-bc974b35aeeb-tmp-dir\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.479543 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.479584 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:49.979564347 +0000 UTC m=+34.633234425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.479610 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret podName:6189b315-17ce-45d6-9e93-6a7c3c0a2fdc nodeName:}" failed. No retries permitted until 2026-09-10 00:01:21.479591677 +0000 UTC m=+66.133261770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret") pod "global-pull-secret-syncer-lgw5s" (UID: "6189b315-17ce-45d6-9e93-6a7c3c0a2fdc") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:00:49.479660 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-trusted-ca\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ada8f14a-4200-4ffd-b094-943cd129508d-cert\") pod \"ingress-canary-qbc9z\" (UID: \"ada8f14a-4200-4ffd-b094-943cd129508d\") " pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479701 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kpt\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-kube-api-access-d4kpt\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wmz\" (UniqueName: \"kubernetes.io/projected/952debcd-1153-4dc7-92b5-bc974b35aeeb-kube-api-access-v4wmz\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/595a5151-f9b3-4edd-9fc8-70ae08410244-ca-trust-extracted\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-installation-pull-secrets\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.480064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.479863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/952debcd-1153-4dc7-92b5-bc974b35aeeb-config-volume\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.480450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.480207 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-certificates\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.480450 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.480258 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:00:49.480450 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.480318 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:00:49.980301996 +0000 UTC m=+34.633972089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:00:49.480450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.480392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/952debcd-1153-4dc7-92b5-bc974b35aeeb-config-volume\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.480633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.480463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/595a5151-f9b3-4edd-9fc8-70ae08410244-ca-trust-extracted\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.480633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.480557 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-trusted-ca\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.484397 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.484372 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ada8f14a-4200-4ffd-b094-943cd129508d-cert\") pod \"ingress-canary-qbc9z\" (UID: \"ada8f14a-4200-4ffd-b094-943cd129508d\") " pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.488347 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.488321 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wmz\" (UniqueName: \"kubernetes.io/projected/952debcd-1153-4dc7-92b5-bc974b35aeeb-kube-api-access-v4wmz\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.488478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.488362 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-bound-sa-token\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.488478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.488392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzt72\" (UniqueName: \"kubernetes.io/projected/ada8f14a-4200-4ffd-b094-943cd129508d-kube-api-access-nzt72\") pod \"ingress-canary-qbc9z\" (UID: \"ada8f14a-4200-4ffd-b094-943cd129508d\") " pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.488712 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.488691 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kpt\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-kube-api-access-d4kpt\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.492187 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.492158 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-installation-pull-secrets\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.492187 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.492176 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-image-registry-private-configuration\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.581085 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.581038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:49.581293 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.581121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:49.581293 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.581235 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:49.581398 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.581296 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:00:49.581398 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.581322 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:00:49.581398 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.581331 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:01:21.581309477 +0000 UTC m=+66.234979571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:00:49.581398 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.581335 2568 projected.go:196] Error preparing data for projected volume kube-api-access-chzsn for pod openshift-network-diagnostics/network-check-target-qvbjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:49.581594 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.581402 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn podName:34257945-300d-4d9c-a93c-18e0970f605c nodeName:}" failed. No retries permitted until 2026-09-10 00:01:21.581387614 +0000 UTC m=+66.235057710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-chzsn" (UniqueName: "kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn") pod "network-check-target-qvbjl" (UID: "34257945-300d-4d9c-a93c-18e0970f605c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:00:49.597978 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.597948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbc9z" Sep 10 00:00:49.840672 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.840632 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:00:49.840860 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.840678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:00:49.840860 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.840678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:00:49.843778 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.843753 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 00:00:49.844005 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.843802 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 00:00:49.844005 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.843937 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 00:00:49.844005 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.843972 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 00:00:49.844398 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.844380 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bf5p9\"" Sep 10 00:00:49.844762 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.844745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s66cg\"" Sep 10 00:00:49.984671 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.984635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:49.984861 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:49.984749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:49.984861 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.984811 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:00:49.984861 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.984830 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:00:49.985022 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.984879 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:00:49.985022 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.984902 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:50.984882102 +0000 UTC m=+35.638552199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:00:49.985022 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:49.984935 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:00:50.984917184 +0000 UTC m=+35.638587275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:00:50.472170 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:50.471894 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbc9z"] Sep 10 00:00:50.475140 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:00:50.475111 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada8f14a_4200_4ffd_b094_943cd129508d.slice/crio-bb87eabd47a21f42afd295b7fc82003696f10a984176586a2562b171521d9bc1 WatchSource:0}: Error finding container bb87eabd47a21f42afd295b7fc82003696f10a984176586a2562b171521d9bc1: Status 404 returned error can't find the container with id bb87eabd47a21f42afd295b7fc82003696f10a984176586a2562b171521d9bc1 Sep 10 00:00:50.993184 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:50.993079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:50.993184 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:50.993141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:50.993357 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:50.993241 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:00:50.993357 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:50.993273 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:00:50.993357 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:50.993284 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:00:50.993357 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:50.993306 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:00:52.993291315 +0000 UTC m=+37.646961393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:00:50.993357 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:50.993323 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:52.993312683 +0000 UTC m=+37.646982761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:00:51.007630 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:51.007594 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c48cabe-0dbf-44e8-9bf7-8121f2e586fa" containerID="0b0e5e35141389f360246f9a0f22d85824e6ee6be4c9297a94546db1a3269ac2" exitCode=0 Sep 10 00:00:51.007795 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:51.007667 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerDied","Data":"0b0e5e35141389f360246f9a0f22d85824e6ee6be4c9297a94546db1a3269ac2"} Sep 10 00:00:51.008857 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:51.008833 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbc9z" event={"ID":"ada8f14a-4200-4ffd-b094-943cd129508d","Type":"ContainerStarted","Data":"bb87eabd47a21f42afd295b7fc82003696f10a984176586a2562b171521d9bc1"} Sep 10 00:00:52.015383 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:52.015342 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c48cabe-0dbf-44e8-9bf7-8121f2e586fa" containerID="86bfee0f0871eefc3e6dc812265dfadd46c0feac8c4aa01db36e5f3db3200dd6" exitCode=0 Sep 10 00:00:52.015936 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:52.015418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerDied","Data":"86bfee0f0871eefc3e6dc812265dfadd46c0feac8c4aa01db36e5f3db3200dd6"} Sep 10 00:00:53.010788 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:53.010534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:53.010960 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:53.010721 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:00:53.010960 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:53.010897 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:00:53.010960 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:53.010907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:53.011115 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:53.010976 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:00:57.010956353 +0000 UTC m=+41.664626453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:00:53.011115 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:53.011050 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:00:53.011220 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:53.011119 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:00:57.011104643 +0000 UTC m=+41.664774725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:00:53.022368 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:53.022333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" event={"ID":"6c48cabe-0dbf-44e8-9bf7-8121f2e586fa","Type":"ContainerStarted","Data":"e8b43a56500a429054dba8fcc2b4a42d190123f73eb56319196217793668bfc6"} Sep 10 00:00:53.042346 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:53.042286 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xqj6h" podStartSLOduration=6.508007462 podStartE2EDuration="37.042263067s" totalImagesPullingTime="30.534255605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:53.040695651 +0000 UTC m=+37.694365768" watchObservedRunningTime="2026-09-10 00:00:53.042263067 +0000 UTC m=+37.695933199" Sep 10 00:00:54.026762 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:54.026720 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbc9z" event={"ID":"ada8f14a-4200-4ffd-b094-943cd129508d","Type":"ContainerStarted","Data":"ff7e0e0d23f47722ffd16918ee31807f701b69135dc121f63e743e24aa0ab914"} Sep 10 00:00:54.043014 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:54.042964 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qbc9z" podStartSLOduration=2.021243646 podStartE2EDuration="5.04294253s" totalImagesPullingTime="3.021698884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:54.041403179 +0000 UTC m=+38.695073278" watchObservedRunningTime="2026-09-10 00:00:54.04294253 +0000 UTC m=+38.696612631" Sep 10 00:00:57.040821 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:57.040782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:00:57.041317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:00:57.040829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:00:57.041317 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:57.040912 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:00:57.041317 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:57.040914 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:00:57.041317 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:57.040968 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:01:05.040953083 +0000 UTC m=+49.694623161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:00:57.041317 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:57.040922 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:00:57.041317 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:00:57.041032 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:01:05.041020852 +0000 UTC m=+49.694690930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:01:05.116817 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:05.116774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:01:05.117350 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:05.116828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:01:05.117350 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:05.116925 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:01:05.117350 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:05.116936 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:01:05.117350 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:05.116942 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:01:05.117350 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:05.116983 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:01:21.116970512 +0000 UTC m=+65.770640604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:01:05.117350 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:05.117026 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:01:21.117005189 +0000 UTC m=+65.770675267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:01:14.999772 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:14.999732 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k5x7" Sep 10 00:01:21.133421 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.133374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:01:21.133421 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.133428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:01:21.133961 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.133550 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:01:21.133961 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.133554 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:01:21.133961 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.133562 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:01:21.133961 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.133678 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:01:53.133652575 +0000 UTC m=+97.787322660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:01:21.133961 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.133700 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:01:53.133687255 +0000 UTC m=+97.787357332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:01:21.536557 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.536466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:01:21.539153 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.539129 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 00:01:21.550781 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.550748 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6189b315-17ce-45d6-9e93-6a7c3c0a2fdc-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5s\" (UID: \"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc\") " pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:01:21.637168 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.637121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:01:21.637347 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.637219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:01:21.639522 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.639488 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 00:01:21.639616 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.639601 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 00:01:21.647592 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.647568 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 00:01:21.647663 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:21.647649 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:02:25.647631312 +0000 UTC m=+130.301301408 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : secret "metrics-daemon-secret" not found Sep 10 00:01:21.649635 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.649617 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 00:01:21.660452 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.660423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzsn\" (UniqueName: \"kubernetes.io/projected/34257945-300d-4d9c-a93c-18e0970f605c-kube-api-access-chzsn\") pod \"network-check-target-qvbjl\" (UID: \"34257945-300d-4d9c-a93c-18e0970f605c\") " pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:01:21.666322 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.666298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5s" Sep 10 00:01:21.935233 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.935200 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lgw5s"] Sep 10 00:01:21.938464 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:01:21.938433 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6189b315_17ce_45d6_9e93_6a7c3c0a2fdc.slice/crio-60543f1638fe5fb182d4c8115f20e0242e82dd6d315e4f988c5c091790ef31d7 WatchSource:0}: Error finding container 60543f1638fe5fb182d4c8115f20e0242e82dd6d315e4f988c5c091790ef31d7: Status 404 returned error can't find the container with id 60543f1638fe5fb182d4c8115f20e0242e82dd6d315e4f988c5c091790ef31d7 Sep 10 00:01:21.954493 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.954468 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bf5p9\"" Sep 10 00:01:21.962600 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:21.962574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:01:22.095377 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:22.095335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lgw5s" event={"ID":"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc","Type":"ContainerStarted","Data":"60543f1638fe5fb182d4c8115f20e0242e82dd6d315e4f988c5c091790ef31d7"} Sep 10 00:01:22.227936 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:22.227854 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qvbjl"] Sep 10 00:01:22.231496 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:01:22.231465 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34257945_300d_4d9c_a93c_18e0970f605c.slice/crio-e3d37aea4b04bbcb73d5c99572670ecba4b283a031fb90db6931d51116d4661a WatchSource:0}: Error finding container e3d37aea4b04bbcb73d5c99572670ecba4b283a031fb90db6931d51116d4661a: Status 404 returned error can't find the container with id e3d37aea4b04bbcb73d5c99572670ecba4b283a031fb90db6931d51116d4661a Sep 10 00:01:23.099635 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:23.099596 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qvbjl" event={"ID":"34257945-300d-4d9c-a93c-18e0970f605c","Type":"ContainerStarted","Data":"e3d37aea4b04bbcb73d5c99572670ecba4b283a031fb90db6931d51116d4661a"} Sep 10 00:01:28.115747 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:28.115707 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lgw5s" event={"ID":"6189b315-17ce-45d6-9e93-6a7c3c0a2fdc","Type":"ContainerStarted","Data":"42db2a10f99de509d83bdbd9bb16e92f4288e2a8a88029d0e75f8d2ad9300e98"} Sep 10 00:01:28.117268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:28.117243 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qvbjl" event={"ID":"34257945-300d-4d9c-a93c-18e0970f605c","Type":"ContainerStarted","Data":"95a640a512940d42f4a1ff01c9570459343bf996e7499ace34683a003fd46c4c"} Sep 10 00:01:28.117377 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:28.117364 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:01:28.131257 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:28.131208 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lgw5s" podStartSLOduration=66.476170529 podStartE2EDuration="1m12.131194912s" totalImagesPullingTime="5.655024383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:01:28.130461018 +0000 UTC m=+72.784131120" watchObservedRunningTime="2026-09-10 00:01:28.131194912 +0000 UTC m=+72.784865003" Sep 10 00:01:28.144719 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:28.144654 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qvbjl" podStartSLOduration=66.783275438 podStartE2EDuration="1m12.144626323s" totalImagesPullingTime="5.361350885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:01:28.143836153 +0000 UTC m=+72.797506253" watchObservedRunningTime="2026-09-10 00:01:28.144626323 +0000 UTC m=+72.798296425" Sep 10 00:01:38.630671 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.630542 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb"] Sep 10 00:01:38.633031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.633009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.635391 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.635369 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 00:01:38.636490 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.636458 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 00:01:38.636490 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.636486 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 00:01:38.636636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.636558 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 00:01:38.641151 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.641123 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb"] Sep 10 00:01:38.667616 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.667579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-tmp\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.667616 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.667612 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.667829 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.667650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2blgv\" (UniqueName: \"kubernetes.io/projected/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-kube-api-access-2blgv\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.768444 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.768406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2blgv\" (UniqueName: \"kubernetes.io/projected/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-kube-api-access-2blgv\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.768554 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.768475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-tmp\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.768554 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.768492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.768868 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.768844 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-tmp\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.771148 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.771115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.776540 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.776508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2blgv\" (UniqueName: \"kubernetes.io/projected/d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54-kube-api-access-2blgv\") pod \"klusterlet-addon-workmgr-6b9cc7844b-lcwdb\" (UID: \"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:38.942821 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:38.942729 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:39.210158 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:39.210065 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb"] Sep 10 00:01:39.213416 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:01:39.213386 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7dc8ae5_8a55_4fbd_8f3d_8357e3356d54.slice/crio-4898eca9215e08f5660841a8d00d1802cc4b080b50ae3caeb6ab5f2b1de50dd5 WatchSource:0}: Error finding container 4898eca9215e08f5660841a8d00d1802cc4b080b50ae3caeb6ab5f2b1de50dd5: Status 404 returned error can't find the container with id 4898eca9215e08f5660841a8d00d1802cc4b080b50ae3caeb6ab5f2b1de50dd5 Sep 10 00:01:40.147109 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:40.147056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" event={"ID":"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54","Type":"ContainerStarted","Data":"4898eca9215e08f5660841a8d00d1802cc4b080b50ae3caeb6ab5f2b1de50dd5"} Sep 10 00:01:46.166002 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:46.165901 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" event={"ID":"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54","Type":"ContainerStarted","Data":"785041003f42585e051aeb63bfb9720374d4d4e74445de453f053f8426bff27a"} Sep 10 00:01:46.166462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:46.166110 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:46.167825 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:46.167802 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:01:46.180355 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:46.180301 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" podStartSLOduration=1.589514785 podStartE2EDuration="8.180287036s" totalImagesPullingTime="6.590772251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:01:46.179302292 +0000 UTC m=+90.832972393" watchObservedRunningTime="2026-09-10 00:01:46.180287036 +0000 UTC m=+90.833957162" Sep 10 00:01:53.176752 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:53.176703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:01:53.177215 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:53.176778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:01:53.177215 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:53.176867 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:01:53.177215 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:53.176947 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:02:57.176931175 +0000 UTC m=+161.830601253 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:01:53.177215 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:53.176877 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:01:53.177215 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:53.176974 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:01:53.177215 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:01:53.177023 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:02:57.177011879 +0000 UTC m=+161.830681957 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:01:59.122148 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:01:59.122113 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qvbjl" Sep 10 00:02:25.701898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:02:25.701852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:02:25.702404 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:25.701979 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 00:02:25.702404 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:25.702045 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:27.70202946 +0000 UTC m=+252.355699538 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : secret "metrics-daemon-secret" not found Sep 10 00:02:52.264492 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:52.264433 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" podUID="595a5151-f9b3-4edd-9fc8-70ae08410244" Sep 10 00:02:52.281668 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:52.281640 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xsn67" podUID="952debcd-1153-4dc7-92b5-bc974b35aeeb" Sep 10 00:02:52.329741 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:02:52.329714 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:02:52.329873 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:02:52.329719 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsn67" Sep 10 00:02:52.859880 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:52.859828 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:02:57.221510 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:02:57.221445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:02:57.221510 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:02:57.221516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") pod \"image-registry-7dfbf9d9-vqfws\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:02:57.221964 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:57.221610 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:02:57.221964 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:57.221614 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:02:57.221964 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:57.221699 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls podName:952debcd-1153-4dc7-92b5-bc974b35aeeb nodeName:}" failed. No retries permitted until 2026-09-10 00:04:59.221680791 +0000 UTC m=+283.875350869 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls") pod "dns-default-xsn67" (UID: "952debcd-1153-4dc7-92b5-bc974b35aeeb") : secret "dns-default-metrics-tls" not found Sep 10 00:02:57.221964 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:57.221621 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfbf9d9-vqfws: secret "image-registry-tls" not found Sep 10 00:02:57.221964 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:02:57.221767 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls podName:595a5151-f9b3-4edd-9fc8-70ae08410244 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:59.221753577 +0000 UTC m=+283.875423655 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls") pod "image-registry-7dfbf9d9-vqfws" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244") : secret "image-registry-tls" not found Sep 10 00:03:06.840999 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:06.840951 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:03:46.167136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:46.166988 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" podUID="d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Sep 10 00:03:46.460468 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:46.460378 2568 generic.go:356] "Generic (PLEG): container finished" podID="d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54" containerID="785041003f42585e051aeb63bfb9720374d4d4e74445de453f053f8426bff27a" exitCode=1 Sep 10 00:03:46.460468 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:46.460445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" event={"ID":"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54","Type":"ContainerDied","Data":"785041003f42585e051aeb63bfb9720374d4d4e74445de453f053f8426bff27a"} Sep 10 00:03:46.460822 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:46.460808 2568 scope.go:117] "RemoveContainer" containerID="785041003f42585e051aeb63bfb9720374d4d4e74445de453f053f8426bff27a" Sep 10 00:03:47.465217 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:47.465182 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" event={"ID":"d7dc8ae5-8a55-4fbd-8f3d-8357e3356d54","Type":"ContainerStarted","Data":"c12cfbf35f736087b56271f4a0a005c1806865653aff7df87f688069ba4bc714"} Sep 10 00:03:47.465594 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:47.465479 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:03:47.466061 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:03:47.466040 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9cc7844b-lcwdb" Sep 10 00:04:27.766746 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:27.766691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:04:27.767264 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:27.766834 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 00:04:27.767264 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:27.766909 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs podName:e95b0252-566a-4352-b9d1-afcabb4c5e56 nodeName:}" failed. No retries permitted until 2026-09-10 00:06:29.766893509 +0000 UTC m=+374.420563590 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs") pod "network-metrics-daemon-wm5p2" (UID: "e95b0252-566a-4352-b9d1-afcabb4c5e56") : secret "metrics-daemon-secret" not found Sep 10 00:04:30.589428 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.589391 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf"] Sep 10 00:04:30.591442 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.591417 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" Sep 10 00:04:30.592460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.592435 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-dn6bq"] Sep 10 00:04:30.594403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.594386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.594786 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.594764 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g4nqk\"" Sep 10 00:04:30.594989 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.594972 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:04:30.595777 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.595759 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 00:04:30.599245 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.599224 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 00:04:30.599989 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.599950 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 00:04:30.600113 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.600075 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fzh22\"" Sep 10 00:04:30.600967 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.600949 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 00:04:30.602686 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.601173 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 00:04:30.605660 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.605643 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 00:04:30.609410 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.609387 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf"] Sep 10 00:04:30.612031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.612013 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-dn6bq"] Sep 10 00:04:30.686079 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.686045 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g"] Sep 10 00:04:30.688018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.687994 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.688948 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.688918 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736b1280-4c54-4d76-9f69-4dac33548977-tmp\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.689052 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.688949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b1280-4c54-4d76-9f69-4dac33548977-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.689052 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.688970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhcx\" (UniqueName: \"kubernetes.io/projected/b436bb12-1e3b-4d4a-9cb5-d43f167799e2-kube-api-access-dkhcx\") pod \"volume-data-source-validator-695c895bd6-dz4bf\" (UID: \"b436bb12-1e3b-4d4a-9cb5-d43f167799e2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" Sep 10 00:04:30.689052 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.688999 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-547v6\" (UniqueName: \"kubernetes.io/projected/736b1280-4c54-4d76-9f69-4dac33548977-kube-api-access-547v6\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.689052 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.689038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b1280-4c54-4d76-9f69-4dac33548977-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.689283 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.689062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736b1280-4c54-4d76-9f69-4dac33548977-serving-cert\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.689283 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.689201 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/736b1280-4c54-4d76-9f69-4dac33548977-snapshots\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.689383 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.689331 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp"] Sep 10 00:04:30.690598 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.690577 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 00:04:30.690711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.690608 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 00:04:30.690711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.690617 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 00:04:30.690711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.690648 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:04:30.690711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.690583 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nlqwz\"" Sep 10 00:04:30.691470 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.691456 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:30.693728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.693709 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 00:04:30.693821 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.693798 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 00:04:30.693943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.693805 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9fgm9\"" Sep 10 00:04:30.694480 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.694465 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:04:30.698602 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.698580 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g"] Sep 10 00:04:30.702185 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.702165 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp"] Sep 10 00:04:30.790030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.789990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736b1280-4c54-4d76-9f69-4dac33548977-tmp\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abd8a604-61bf-4da9-b478-468d75170467-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.790275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b1280-4c54-4d76-9f69-4dac33548977-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736b1280-4c54-4d76-9f69-4dac33548977-serving-cert\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9rnh\" (UniqueName: \"kubernetes.io/projected/abd8a604-61bf-4da9-b478-468d75170467-kube-api-access-k9rnh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.790275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/736b1280-4c54-4d76-9f69-4dac33548977-snapshots\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95ndm\" (UniqueName: \"kubernetes.io/projected/ade01131-b4c3-4e26-bfe9-efd0bb177d05-kube-api-access-95ndm\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:30.790450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b1280-4c54-4d76-9f69-4dac33548977-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhcx\" (UniqueName: \"kubernetes.io/projected/b436bb12-1e3b-4d4a-9cb5-d43f167799e2-kube-api-access-dkhcx\") pod \"volume-data-source-validator-695c895bd6-dz4bf\" (UID: \"b436bb12-1e3b-4d4a-9cb5-d43f167799e2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" Sep 10 00:04:30.790450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-547v6\" (UniqueName: \"kubernetes.io/projected/736b1280-4c54-4d76-9f69-4dac33548977-kube-api-access-547v6\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abd8a604-61bf-4da9-b478-468d75170467-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.790450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:30.790751 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790601 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736b1280-4c54-4d76-9f69-4dac33548977-tmp\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790855 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790835 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/736b1280-4c54-4d76-9f69-4dac33548977-snapshots\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.790914 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.790894 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b1280-4c54-4d76-9f69-4dac33548977-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.791170 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.791151 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b1280-4c54-4d76-9f69-4dac33548977-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.792626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.792608 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736b1280-4c54-4d76-9f69-4dac33548977-serving-cert\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.798440 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.798408 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-547v6\" (UniqueName: \"kubernetes.io/projected/736b1280-4c54-4d76-9f69-4dac33548977-kube-api-access-547v6\") pod \"insights-operator-76bcd6ccf5-dn6bq\" (UID: \"736b1280-4c54-4d76-9f69-4dac33548977\") " pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.798440 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.798417 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhcx\" (UniqueName: \"kubernetes.io/projected/b436bb12-1e3b-4d4a-9cb5-d43f167799e2-kube-api-access-dkhcx\") pod \"volume-data-source-validator-695c895bd6-dz4bf\" (UID: \"b436bb12-1e3b-4d4a-9cb5-d43f167799e2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" Sep 10 00:04:30.891667 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.891579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abd8a604-61bf-4da9-b478-468d75170467-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.891667 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.891633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9rnh\" (UniqueName: \"kubernetes.io/projected/abd8a604-61bf-4da9-b478-468d75170467-kube-api-access-k9rnh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.891876 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.891667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95ndm\" (UniqueName: \"kubernetes.io/projected/ade01131-b4c3-4e26-bfe9-efd0bb177d05-kube-api-access-95ndm\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:30.891876 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.891697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abd8a604-61bf-4da9-b478-468d75170467-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.891876 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.891721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:30.892025 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:30.891920 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:04:30.892025 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:30.892003 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls podName:ade01131-b4c3-4e26-bfe9-efd0bb177d05 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:31.39198069 +0000 UTC m=+256.045650782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-4x6zp" (UID: "ade01131-b4c3-4e26-bfe9-efd0bb177d05") : secret "samples-operator-tls" not found Sep 10 00:04:30.892291 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.892273 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abd8a604-61bf-4da9-b478-468d75170467-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.893870 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.893852 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abd8a604-61bf-4da9-b478-468d75170467-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.899896 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.899855 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9rnh\" (UniqueName: \"kubernetes.io/projected/abd8a604-61bf-4da9-b478-468d75170467-kube-api-access-k9rnh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4vp4g\" (UID: \"abd8a604-61bf-4da9-b478-468d75170467\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:30.900048 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.900029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95ndm\" (UniqueName: \"kubernetes.io/projected/ade01131-b4c3-4e26-bfe9-efd0bb177d05-kube-api-access-95ndm\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:30.903782 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.903761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" Sep 10 00:04:30.908470 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.908455 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" Sep 10 00:04:30.998832 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:30.998801 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" Sep 10 00:04:31.172038 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.171959 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf"] Sep 10 00:04:31.175068 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:31.175044 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb436bb12_1e3b_4d4a_9cb5_d43f167799e2.slice/crio-33765188b23bcaaba899d01f5ab6a272c87a4398958604b920ec335edb485f6b WatchSource:0}: Error finding container 33765188b23bcaaba899d01f5ab6a272c87a4398958604b920ec335edb485f6b: Status 404 returned error can't find the container with id 33765188b23bcaaba899d01f5ab6a272c87a4398958604b920ec335edb485f6b Sep 10 00:04:31.179127 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.179062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-dn6bq"] Sep 10 00:04:31.181898 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:31.181866 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736b1280_4c54_4d76_9f69_4dac33548977.slice/crio-920b7b5097c80d9508e3d08e0449e6c56deaddd84729ed45732ba97373e9529f WatchSource:0}: Error finding container 920b7b5097c80d9508e3d08e0449e6c56deaddd84729ed45732ba97373e9529f: Status 404 returned error can't find the container with id 920b7b5097c80d9508e3d08e0449e6c56deaddd84729ed45732ba97373e9529f Sep 10 00:04:31.263006 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.262970 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g"] Sep 10 00:04:31.265724 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:31.265697 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd8a604_61bf_4da9_b478_468d75170467.slice/crio-40afaaabe641feea668e7d785d7b897ad0128f9ba716274d93c68fa5a7abc19c WatchSource:0}: Error finding container 40afaaabe641feea668e7d785d7b897ad0128f9ba716274d93c68fa5a7abc19c: Status 404 returned error can't find the container with id 40afaaabe641feea668e7d785d7b897ad0128f9ba716274d93c68fa5a7abc19c Sep 10 00:04:31.395593 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.395553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:31.395772 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:31.395706 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:04:31.395813 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:31.395772 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls podName:ade01131-b4c3-4e26-bfe9-efd0bb177d05 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:32.39575585 +0000 UTC m=+257.049425927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-4x6zp" (UID: "ade01131-b4c3-4e26-bfe9-efd0bb177d05") : secret "samples-operator-tls" not found Sep 10 00:04:31.572467 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.572433 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" event={"ID":"b436bb12-1e3b-4d4a-9cb5-d43f167799e2","Type":"ContainerStarted","Data":"33765188b23bcaaba899d01f5ab6a272c87a4398958604b920ec335edb485f6b"} Sep 10 00:04:31.573491 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.573465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" event={"ID":"abd8a604-61bf-4da9-b478-468d75170467","Type":"ContainerStarted","Data":"40afaaabe641feea668e7d785d7b897ad0128f9ba716274d93c68fa5a7abc19c"} Sep 10 00:04:31.574466 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:31.574439 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" event={"ID":"736b1280-4c54-4d76-9f69-4dac33548977","Type":"ContainerStarted","Data":"920b7b5097c80d9508e3d08e0449e6c56deaddd84729ed45732ba97373e9529f"} Sep 10 00:04:32.403602 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:32.403512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:32.404166 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:32.403691 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:04:32.404166 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:32.403776 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls podName:ade01131-b4c3-4e26-bfe9-efd0bb177d05 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:34.403754572 +0000 UTC m=+259.057424651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-4x6zp" (UID: "ade01131-b4c3-4e26-bfe9-efd0bb177d05") : secret "samples-operator-tls" not found Sep 10 00:04:33.586588 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:33.586544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" event={"ID":"b436bb12-1e3b-4d4a-9cb5-d43f167799e2","Type":"ContainerStarted","Data":"2cd81e2ec2a27b3e12ea5872ba524204d6afaa293bcb45e5bd9b8872ed27298c"} Sep 10 00:04:33.603658 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:33.603608 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-dz4bf" podStartSLOduration=2.262722584 podStartE2EDuration="3.603593799s" totalImagesPullingTime="1.340871215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:33.600964923 +0000 UTC m=+258.254635026" watchObservedRunningTime="2026-09-10 00:04:33.603593799 +0000 UTC m=+258.257263899" Sep 10 00:04:34.421395 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.421353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:34.421572 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:34.421481 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:04:34.421572 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:34.421537 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls podName:ade01131-b4c3-4e26-bfe9-efd0bb177d05 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:38.421523138 +0000 UTC m=+263.075193215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-4x6zp" (UID: "ade01131-b4c3-4e26-bfe9-efd0bb177d05") : secret "samples-operator-tls" not found Sep 10 00:04:34.592192 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.592150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" event={"ID":"abd8a604-61bf-4da9-b478-468d75170467","Type":"ContainerStarted","Data":"fe7c15f89ff35fec9748d2e0660db1b88b70de8174ee5314be03acefb2787659"} Sep 10 00:04:34.593680 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.593650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" event={"ID":"736b1280-4c54-4d76-9f69-4dac33548977","Type":"ContainerStarted","Data":"5b763be6635973074264cd36c6fc442006591a3789eaf7e72ff49366875bb045"} Sep 10 00:04:34.609708 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.609651 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" podStartSLOduration=2.235851707 podStartE2EDuration="4.60963164s" totalImagesPullingTime="2.373779933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:34.609416218 +0000 UTC m=+259.263086323" watchObservedRunningTime="2026-09-10 00:04:34.60963164 +0000 UTC m=+259.263301736" Sep 10 00:04:34.626038 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.625978 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" podStartSLOduration=2.170313475 podStartE2EDuration="4.625958022s" totalImagesPullingTime="2.455644547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:34.624945283 +0000 UTC m=+259.278615386" watchObservedRunningTime="2026-09-10 00:04:34.625958022 +0000 UTC m=+259.279628123" Sep 10 00:04:34.975794 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.975760 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tvqq2"] Sep 10 00:04:34.978195 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.978165 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:34.981018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.980993 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 00:04:34.981473 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.981446 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 00:04:34.981590 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.981573 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7nf9b\"" Sep 10 00:04:34.990758 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:34.990724 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvqq2"] Sep 10 00:04:35.028218 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.028179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cljcn\" (UniqueName: \"kubernetes.io/projected/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-api-access-cljcn\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.028355 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.028256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/504dbf17-ea7f-4062-a443-dcfdcef8d252-data-volume\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.028355 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.028313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.028355 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.028339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.028498 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.028464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/504dbf17-ea7f-4062-a443-dcfdcef8d252-crio-socket\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.129742 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.129696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cljcn\" (UniqueName: \"kubernetes.io/projected/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-api-access-cljcn\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.129928 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.129799 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/504dbf17-ea7f-4062-a443-dcfdcef8d252-data-volume\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.130127 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.130086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.130266 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.130145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.130266 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.130162 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:04:35.130266 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.130205 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/504dbf17-ea7f-4062-a443-dcfdcef8d252-data-volume\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.130266 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.130229 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:35.630210509 +0000 UTC m=+260.283880594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : configmap "kube-rbac-proxy" not found Sep 10 00:04:35.130444 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.130293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/504dbf17-ea7f-4062-a443-dcfdcef8d252-crio-socket\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.130444 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.130307 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:04:35.130444 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.130357 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:35.630344361 +0000 UTC m=+260.284014439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : secret "insights-runtime-extractor-tls" not found Sep 10 00:04:35.130444 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.130373 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/504dbf17-ea7f-4062-a443-dcfdcef8d252-crio-socket\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.145716 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.145685 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cljcn\" (UniqueName: \"kubernetes.io/projected/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-api-access-cljcn\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.180757 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.180699 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4"] Sep 10 00:04:35.182812 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.182792 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" Sep 10 00:04:35.185142 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.185112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 00:04:35.185272 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.185159 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 00:04:35.185272 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.185158 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dmsq5\"" Sep 10 00:04:35.193051 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.193024 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4"] Sep 10 00:04:35.231569 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.231481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgb6p\" (UniqueName: \"kubernetes.io/projected/f42a84c2-2a2e-48c9-a03c-801906ff7548-kube-api-access-rgb6p\") pod \"migrator-fdbb8fdff-6gbv4\" (UID: \"f42a84c2-2a2e-48c9-a03c-801906ff7548\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" Sep 10 00:04:35.332751 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.332711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgb6p\" (UniqueName: \"kubernetes.io/projected/f42a84c2-2a2e-48c9-a03c-801906ff7548-kube-api-access-rgb6p\") pod \"migrator-fdbb8fdff-6gbv4\" (UID: \"f42a84c2-2a2e-48c9-a03c-801906ff7548\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" Sep 10 00:04:35.346886 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.346849 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgb6p\" (UniqueName: \"kubernetes.io/projected/f42a84c2-2a2e-48c9-a03c-801906ff7548-kube-api-access-rgb6p\") pod \"migrator-fdbb8fdff-6gbv4\" (UID: \"f42a84c2-2a2e-48c9-a03c-801906ff7548\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" Sep 10 00:04:35.492674 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.492580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" Sep 10 00:04:35.636184 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.636132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.636580 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.636197 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:04:35.636580 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.636248 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:04:35.636580 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.636263 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:36.636247003 +0000 UTC m=+261.289917081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : configmap "kube-rbac-proxy" not found Sep 10 00:04:35.636580 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:35.636302 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:36.636290371 +0000 UTC m=+261.289960449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : secret "insights-runtime-extractor-tls" not found Sep 10 00:04:35.636580 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.636196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:35.757819 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:35.757721 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4"] Sep 10 00:04:35.762017 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:35.761976 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42a84c2_2a2e_48c9_a03c_801906ff7548.slice/crio-9b7e4484e41c2fee43934ddf93ab0f87bd50417c79414a680ea837ec222445bb WatchSource:0}: Error finding container 9b7e4484e41c2fee43934ddf93ab0f87bd50417c79414a680ea837ec222445bb: Status 404 returned error can't find the container with id 9b7e4484e41c2fee43934ddf93ab0f87bd50417c79414a680ea837ec222445bb Sep 10 00:04:36.601538 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:36.601504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" event={"ID":"f42a84c2-2a2e-48c9-a03c-801906ff7548","Type":"ContainerStarted","Data":"9b7e4484e41c2fee43934ddf93ab0f87bd50417c79414a680ea837ec222445bb"} Sep 10 00:04:36.643674 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:36.643630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:36.643674 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:36.643684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:36.644191 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:36.643787 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:04:36.644191 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:36.643808 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:04:36.644191 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:36.643872 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:38.643842825 +0000 UTC m=+263.297512909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : configmap "kube-rbac-proxy" not found Sep 10 00:04:36.644191 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:36.643943 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:38.643924083 +0000 UTC m=+263.297594171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : secret "insights-runtime-extractor-tls" not found Sep 10 00:04:36.735871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:36.735832 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4klxw_4c51a859-b066-4e25-93f1-101b4ab1bae3/dns-node-resolver/0.log" Sep 10 00:04:37.607339 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:37.607301 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" event={"ID":"f42a84c2-2a2e-48c9-a03c-801906ff7548","Type":"ContainerStarted","Data":"4871d66fa1e05b9a15672e01c3b0b048ee6101b7f253c2d9c7b55b5358bc9ccf"} Sep 10 00:04:37.607509 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:37.607362 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" event={"ID":"f42a84c2-2a2e-48c9-a03c-801906ff7548","Type":"ContainerStarted","Data":"f1f903a89e327c10061be9ccf2623fd0af338b89a9c8846e6ee65b3da511bba2"} Sep 10 00:04:37.623177 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:37.623120 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6gbv4" podStartSLOduration=1.552555465 podStartE2EDuration="2.623083681s" totalImagesPullingTime="1.070528216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:37.6223646 +0000 UTC m=+262.276034700" watchObservedRunningTime="2026-09-10 00:04:37.623083681 +0000 UTC m=+262.276753829" Sep 10 00:04:38.336050 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:38.336018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qv2wk_711e44ff-c988-4cda-8ebe-a352a005b596/node-ca/0.log" Sep 10 00:04:38.459887 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:38.459837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:38.460063 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:38.459989 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:04:38.460152 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:38.460070 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls podName:ade01131-b4c3-4e26-bfe9-efd0bb177d05 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:46.460054343 +0000 UTC m=+271.113724420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-4x6zp" (UID: "ade01131-b4c3-4e26-bfe9-efd0bb177d05") : secret "samples-operator-tls" not found Sep 10 00:04:38.661582 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:38.661466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:38.661582 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:38.661530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:38.661833 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:38.661598 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:04:38.661833 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:38.661659 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:42.661642848 +0000 UTC m=+267.315312927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : configmap "kube-rbac-proxy" not found Sep 10 00:04:38.661833 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:38.661706 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:04:38.661833 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:38.661762 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:42.661747333 +0000 UTC m=+267.315417413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : secret "insights-runtime-extractor-tls" not found Sep 10 00:04:38.935921 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:38.935834 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qbc9z_ada8f14a-4200-4ffd-b094-943cd129508d/serve-healthcheck-canary/0.log" Sep 10 00:04:42.695190 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:42.695149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:42.695190 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:42.695193 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:42.695753 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:42.695274 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:04:42.695753 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:42.695299 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:04:42.695753 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:42.695342 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:50.695325771 +0000 UTC m=+275.348995849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : secret "insights-runtime-extractor-tls" not found Sep 10 00:04:42.695753 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:42.695360 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm podName:504dbf17-ea7f-4062-a443-dcfdcef8d252 nodeName:}" failed. No retries permitted until 2026-09-10 00:04:50.695350598 +0000 UTC m=+275.349020676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvqq2" (UID: "504dbf17-ea7f-4062-a443-dcfdcef8d252") : configmap "kube-rbac-proxy" not found Sep 10 00:04:46.524006 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:46.523959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:46.526326 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:46.526302 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ade01131-b4c3-4e26-bfe9-efd0bb177d05-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-4x6zp\" (UID: \"ade01131-b4c3-4e26-bfe9-efd0bb177d05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:46.604404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:46.604354 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" Sep 10 00:04:46.871713 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:46.871676 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp"] Sep 10 00:04:47.642531 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:47.642486 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" event={"ID":"ade01131-b4c3-4e26-bfe9-efd0bb177d05","Type":"ContainerStarted","Data":"2489d0b18a653a08b4c31fefa9e81365a5500a425f667e3d907533e6298d578b"} Sep 10 00:04:49.650388 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:49.650350 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" event={"ID":"ade01131-b4c3-4e26-bfe9-efd0bb177d05","Type":"ContainerStarted","Data":"d2f744ed55d62f1f151a3fec5908e3b658c2be22ae18f527845036d66558af75"} Sep 10 00:04:49.650873 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:49.650413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" event={"ID":"ade01131-b4c3-4e26-bfe9-efd0bb177d05","Type":"ContainerStarted","Data":"76886b1977310ef4d212e55c5d8fd4440ad44d78e7c3bfecf22d349204c19af9"} Sep 10 00:04:49.666752 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:49.666695 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-4x6zp" podStartSLOduration=17.916575467 podStartE2EDuration="19.666655553s" totalImagesPullingTime="1.750080086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:49.665727118 +0000 UTC m=+274.319397219" watchObservedRunningTime="2026-09-10 00:04:49.666655553 +0000 UTC m=+274.320325653" Sep 10 00:04:50.758300 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:50.758265 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:50.758790 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:50.758311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:50.758849 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:50.758817 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/504dbf17-ea7f-4062-a443-dcfdcef8d252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:50.760717 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:50.760692 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/504dbf17-ea7f-4062-a443-dcfdcef8d252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvqq2\" (UID: \"504dbf17-ea7f-4062-a443-dcfdcef8d252\") " pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:50.888661 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:50.888623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvqq2" Sep 10 00:04:51.157210 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:51.157172 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvqq2"] Sep 10 00:04:51.160300 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:51.160268 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504dbf17_ea7f_4062_a443_dcfdcef8d252.slice/crio-b98673522b964334166a90bda9d611b5ac727a98172455bc6d5e3551a33068e2 WatchSource:0}: Error finding container b98673522b964334166a90bda9d611b5ac727a98172455bc6d5e3551a33068e2: Status 404 returned error can't find the container with id b98673522b964334166a90bda9d611b5ac727a98172455bc6d5e3551a33068e2 Sep 10 00:04:51.658484 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:51.658445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvqq2" event={"ID":"504dbf17-ea7f-4062-a443-dcfdcef8d252","Type":"ContainerStarted","Data":"b1a544d0de7ba8c1afdd7d3ebbc64ee33fb293b333d0ae321e0e58f0e0ed9e63"} Sep 10 00:04:51.658657 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:51.658506 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvqq2" event={"ID":"504dbf17-ea7f-4062-a443-dcfdcef8d252","Type":"ContainerStarted","Data":"b98673522b964334166a90bda9d611b5ac727a98172455bc6d5e3551a33068e2"} Sep 10 00:04:52.662852 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:52.662814 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvqq2" event={"ID":"504dbf17-ea7f-4062-a443-dcfdcef8d252","Type":"ContainerStarted","Data":"8073e3820defab40e62b7b45f1e3e405dea441419abb2fb1884d29144f95a0d0"} Sep 10 00:04:54.673889 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:54.673853 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvqq2" event={"ID":"504dbf17-ea7f-4062-a443-dcfdcef8d252","Type":"ContainerStarted","Data":"87591d6ad324dd42f7723919409e3930fcb41bec1f3bbcc615dc370c3e2618b7"} Sep 10 00:04:54.691988 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:54.691943 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tvqq2" podStartSLOduration=18.372562021 podStartE2EDuration="20.691926716s" totalImagesPullingTime="2.319364695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:04:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:54.690759337 +0000 UTC m=+279.344429437" watchObservedRunningTime="2026-09-10 00:04:54.691926716 +0000 UTC m=+279.345596839" Sep 10 00:04:55.331022 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:55.330952 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" podUID="595a5151-f9b3-4edd-9fc8-70ae08410244" Sep 10 00:04:55.331022 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:55.330968 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xsn67" podUID="952debcd-1153-4dc7-92b5-bc974b35aeeb" Sep 10 00:04:55.405018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.404969 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfbf9d9-vqfws"] Sep 10 00:04:55.472982 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.472942 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-567876d654-d9mjz"] Sep 10 00:04:55.474942 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.474926 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.490407 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.490372 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567876d654-d9mjz"] Sep 10 00:04:55.595203 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595083 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-registry-certificates\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595203 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-bound-sa-token\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-registry-tls\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chv8b\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-kube-api-access-chv8b\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-trusted-ca\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-ca-trust-extracted\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595381 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-installation-pull-secrets\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.595580 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.595404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-image-registry-private-configuration\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.676986 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.676953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsn67" Sep 10 00:04:55.676986 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.676953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:04:55.677562 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:04:55.677544 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" podUID="595a5151-f9b3-4edd-9fc8-70ae08410244" Sep 10 00:04:55.696730 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.696693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-trusted-ca\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.696914 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.696735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-ca-trust-extracted\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.696914 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.696763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-installation-pull-secrets\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697034 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697013 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-image-registry-private-configuration\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697114 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697064 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-registry-certificates\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697170 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-bound-sa-token\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697170 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-registry-tls\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697267 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697188 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chv8b\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-kube-api-access-chv8b\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697328 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697296 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-ca-trust-extracted\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.697837 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697812 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-trusted-ca\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.698002 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.697915 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-registry-certificates\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.699481 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.699459 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-image-registry-private-configuration\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.699576 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.699521 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-installation-pull-secrets\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.699654 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.699636 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-registry-tls\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.706817 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.706784 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-bound-sa-token\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.706902 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.706891 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chv8b\" (UniqueName: \"kubernetes.io/projected/ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c-kube-api-access-chv8b\") pod \"image-registry-567876d654-d9mjz\" (UID: \"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c\") " pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:55.786425 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.786389 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5nl5z\"" Sep 10 00:04:55.794350 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:55.794327 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:56.065759 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.065732 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567876d654-d9mjz"] Sep 10 00:04:56.068265 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:56.068232 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae75a3ed_8aa6_4f9c_a42e_fd6d729f568c.slice/crio-8c5d83ba722095023f7a972b10f2701055568a746690d9917e8ecb399c16bb73 WatchSource:0}: Error finding container 8c5d83ba722095023f7a972b10f2701055568a746690d9917e8ecb399c16bb73: Status 404 returned error can't find the container with id 8c5d83ba722095023f7a972b10f2701055568a746690d9917e8ecb399c16bb73 Sep 10 00:04:56.681885 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.681843 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567876d654-d9mjz" event={"ID":"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c","Type":"ContainerStarted","Data":"dc3012e03a4cf6f3b56813b9b3772aef91f5def0f20fec420d1c20db59815b6a"} Sep 10 00:04:56.682304 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.681900 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567876d654-d9mjz" event={"ID":"ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c","Type":"ContainerStarted","Data":"8c5d83ba722095023f7a972b10f2701055568a746690d9917e8ecb399c16bb73"} Sep 10 00:04:56.682304 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.681859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:04:56.682304 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.682106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:04:56.688647 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.688624 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:04:56.703574 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.703518 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-567876d654-d9mjz" podStartSLOduration=1.70349415 podStartE2EDuration="1.70349415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:56.701691458 +0000 UTC m=+281.355361573" watchObservedRunningTime="2026-09-10 00:04:56.70349415 +0000 UTC m=+281.357164252" Sep 10 00:04:56.806070 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806033 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-installation-pull-secrets\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806274 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806086 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-trusted-ca\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806274 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806139 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-bound-sa-token\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806274 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806164 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-image-registry-private-configuration\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806274 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806196 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/595a5151-f9b3-4edd-9fc8-70ae08410244-ca-trust-extracted\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806274 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806229 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4kpt\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-kube-api-access-d4kpt\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806274 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806267 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-certificates\") pod \"595a5151-f9b3-4edd-9fc8-70ae08410244\" (UID: \"595a5151-f9b3-4edd-9fc8-70ae08410244\") " Sep 10 00:04:56.806551 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806503 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595a5151-f9b3-4edd-9fc8-70ae08410244-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:04:56.806614 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806597 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/595a5151-f9b3-4edd-9fc8-70ae08410244-ca-trust-extracted\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:56.807260 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806718 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:04:56.807260 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.806749 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:04:56.808615 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.808590 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:04:56.808826 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.808810 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:04:56.808908 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.808888 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-kube-api-access-d4kpt" (OuterVolumeSpecName: "kube-api-access-d4kpt") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "kube-api-access-d4kpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:04:56.808985 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.808965 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "595a5151-f9b3-4edd-9fc8-70ae08410244" (UID: "595a5151-f9b3-4edd-9fc8-70ae08410244"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:04:56.907477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.907431 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-certificates\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:56.907477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.907465 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-installation-pull-secrets\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:56.907477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.907475 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/595a5151-f9b3-4edd-9fc8-70ae08410244-trusted-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:56.907477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.907484 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-bound-sa-token\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:56.907477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.907492 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/595a5151-f9b3-4edd-9fc8-70ae08410244-image-registry-private-configuration\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:56.907833 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:56.907501 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4kpt\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-kube-api-access-d4kpt\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:57.685270 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:57.685237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfbf9d9-vqfws" Sep 10 00:04:57.717001 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:57.716969 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfbf9d9-vqfws"] Sep 10 00:04:57.720460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:57.720434 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dfbf9d9-vqfws"] Sep 10 00:04:57.816243 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:57.816005 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/595a5151-f9b3-4edd-9fc8-70ae08410244-registry-tls\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:04:57.844550 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:57.844507 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595a5151-f9b3-4edd-9fc8-70ae08410244" path="/var/lib/kubelet/pods/595a5151-f9b3-4edd-9fc8-70ae08410244/volumes" Sep 10 00:04:59.228227 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:59.228179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:04:59.230464 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:59.230428 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/952debcd-1153-4dc7-92b5-bc974b35aeeb-metrics-tls\") pod \"dns-default-xsn67\" (UID: \"952debcd-1153-4dc7-92b5-bc974b35aeeb\") " pod="openshift-dns/dns-default-xsn67" Sep 10 00:04:59.279919 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:59.279879 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f86ng\"" Sep 10 00:04:59.287936 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:59.287909 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsn67" Sep 10 00:04:59.554917 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:59.554886 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xsn67"] Sep 10 00:04:59.558050 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:04:59.558019 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952debcd_1153_4dc7_92b5_bc974b35aeeb.slice/crio-7b4c75987d568ffa15bf6ab8a899467039eee40ebd0131a3e1567567f9b21755 WatchSource:0}: Error finding container 7b4c75987d568ffa15bf6ab8a899467039eee40ebd0131a3e1567567f9b21755: Status 404 returned error can't find the container with id 7b4c75987d568ffa15bf6ab8a899467039eee40ebd0131a3e1567567f9b21755 Sep 10 00:04:59.696760 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:04:59.696719 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsn67" event={"ID":"952debcd-1153-4dc7-92b5-bc974b35aeeb","Type":"ContainerStarted","Data":"7b4c75987d568ffa15bf6ab8a899467039eee40ebd0131a3e1567567f9b21755"} Sep 10 00:05:01.705295 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:01.705198 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsn67" event={"ID":"952debcd-1153-4dc7-92b5-bc974b35aeeb","Type":"ContainerStarted","Data":"a23d574251272a51660ba7958ac8cc0272f152ea5e2e0ee20a533a92763df7e1"} Sep 10 00:05:01.705295 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:01.705257 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsn67" event={"ID":"952debcd-1153-4dc7-92b5-bc974b35aeeb","Type":"ContainerStarted","Data":"ff9b0f6d3ddefa79c19ac3a09411152bd2f9344d8ce0e49a90bc676dfed5eebd"} Sep 10 00:05:01.705796 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:01.705344 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xsn67" Sep 10 00:05:01.722510 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:01.722454 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xsn67" podStartSLOduration=250.948627662 podStartE2EDuration="4m12.722437839s" totalImagesPullingTime="1.773810177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:01.720696073 +0000 UTC m=+286.374366176" watchObservedRunningTime="2026-09-10 00:05:01.722437839 +0000 UTC m=+286.376107940" Sep 10 00:05:04.005913 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.005876 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fb8895bff-9m9dx"] Sep 10 00:05:04.008087 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.008069 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.010620 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.010592 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 00:05:04.010620 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.010605 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 00:05:04.010783 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.010714 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 00:05:04.010835 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.010808 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 00:05:04.011791 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.011767 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 00:05:04.011791 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.011779 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2tdg4\"" Sep 10 00:05:04.011791 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.011787 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 00:05:04.011996 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.011875 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 00:05:04.019658 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.019636 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb8895bff-9m9dx"] Sep 10 00:05:04.162625 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.162565 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-oauth-serving-cert\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.162625 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.162641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkc5z\" (UniqueName: \"kubernetes.io/projected/dd19a896-429e-4aba-b33f-36ece6d746ae-kube-api-access-qkc5z\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.162852 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.162665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-serving-cert\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.162852 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.162725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-oauth-config\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.162852 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.162762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-console-config\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.162852 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.162806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-service-ca\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.263248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.263144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-serving-cert\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.263248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.263191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-oauth-config\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.263248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.263238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-console-config\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.263528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.263291 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-service-ca\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.263528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.263323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-oauth-serving-cert\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.263528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.263357 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkc5z\" (UniqueName: \"kubernetes.io/projected/dd19a896-429e-4aba-b33f-36ece6d746ae-kube-api-access-qkc5z\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.264099 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.264072 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-oauth-serving-cert\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.264239 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.264132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-service-ca\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.264239 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.264132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-console-config\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.265666 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.265637 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-oauth-config\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.265805 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.265786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-serving-cert\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.270992 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.270967 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkc5z\" (UniqueName: \"kubernetes.io/projected/dd19a896-429e-4aba-b33f-36ece6d746ae-kube-api-access-qkc5z\") pod \"console-6fb8895bff-9m9dx\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.316946 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.316905 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:04.584594 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.584563 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb8895bff-9m9dx"] Sep 10 00:05:04.587732 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:04.587698 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd19a896_429e_4aba_b33f_36ece6d746ae.slice/crio-7c3fd14b3d45cba6421019e3d2bd1f34c35299094dd799ee4cf83211aa1dee03 WatchSource:0}: Error finding container 7c3fd14b3d45cba6421019e3d2bd1f34c35299094dd799ee4cf83211aa1dee03: Status 404 returned error can't find the container with id 7c3fd14b3d45cba6421019e3d2bd1f34c35299094dd799ee4cf83211aa1dee03 Sep 10 00:05:04.717127 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:04.717076 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb8895bff-9m9dx" event={"ID":"dd19a896-429e-4aba-b33f-36ece6d746ae","Type":"ContainerStarted","Data":"7c3fd14b3d45cba6421019e3d2bd1f34c35299094dd799ee4cf83211aa1dee03"} Sep 10 00:05:08.734144 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:08.734085 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb8895bff-9m9dx" event={"ID":"dd19a896-429e-4aba-b33f-36ece6d746ae","Type":"ContainerStarted","Data":"a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379"} Sep 10 00:05:08.750337 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:08.750287 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fb8895bff-9m9dx" podStartSLOduration=2.501200329 podStartE2EDuration="5.750271816s" totalImagesPullingTime="3.249071487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:08.749218627 +0000 UTC m=+293.402888728" watchObservedRunningTime="2026-09-10 00:05:08.750271816 +0000 UTC m=+293.403941939" Sep 10 00:05:09.842046 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:05:09.841992 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wm5p2" podUID="e95b0252-566a-4352-b9d1-afcabb4c5e56" Sep 10 00:05:11.711726 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:11.711690 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xsn67" Sep 10 00:05:14.317285 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:14.317239 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:14.317808 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:14.317306 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:14.322147 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:14.322124 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:14.760348 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:14.760264 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:15.750294 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:15.750265 2568 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 00:05:15.798773 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:15.798737 2568 patch_prober.go:28] interesting pod/image-registry-567876d654-d9mjz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 00:05:15.798933 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:15.798789 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567876d654-d9mjz" podUID="ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 00:05:17.690222 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:17.690193 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-567876d654-d9mjz" Sep 10 00:05:20.841203 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:20.841163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:05:23.019541 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.019507 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb8895bff-9m9dx"] Sep 10 00:05:23.305227 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.305192 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mf46l"] Sep 10 00:05:23.308445 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.308428 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.310986 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.310960 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 00:05:23.311875 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.311854 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 00:05:23.312879 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.312864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 00:05:23.313147 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.313126 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 00:05:23.313147 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.313143 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 00:05:23.314285 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.314260 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fpmfn\"" Sep 10 00:05:23.317976 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.317957 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 00:05:23.416968 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.416932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.416968 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.416965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-accelerators-collector-config\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.416987 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl2h8\" (UniqueName: \"kubernetes.io/projected/2dd0e1b4-82c5-421f-937b-109b1c576a21-kube-api-access-rl2h8\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.417069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd0e1b4-82c5-421f-937b-109b1c576a21-metrics-client-ca\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.417124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-root\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.417175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-tls\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417246 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.417212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-sys\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417427 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.417250 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-textfile\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.417427 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.417313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-wtmp\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.517958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.517920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd0e1b4-82c5-421f-937b-109b1c576a21-metrics-client-ca\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.517958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.517966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-root\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.517985 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-tls\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-sys\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-textfile\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-wtmp\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518055 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-root\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518118 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-sys\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-accelerators-collector-config\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl2h8\" (UniqueName: \"kubernetes.io/projected/2dd0e1b4-82c5-421f-937b-109b1c576a21-kube-api-access-rl2h8\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518248 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-wtmp\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518661 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-textfile\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518661 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518622 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd0e1b4-82c5-421f-937b-109b1c576a21-metrics-client-ca\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.518740 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.518715 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-accelerators-collector-config\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.520571 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.520542 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.520642 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.520615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dd0e1b4-82c5-421f-937b-109b1c576a21-node-exporter-tls\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.525478 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.525452 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl2h8\" (UniqueName: \"kubernetes.io/projected/2dd0e1b4-82c5-421f-937b-109b1c576a21-kube-api-access-rl2h8\") pod \"node-exporter-mf46l\" (UID: \"2dd0e1b4-82c5-421f-937b-109b1c576a21\") " pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.617866 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.617785 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mf46l" Sep 10 00:05:23.627030 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:23.627002 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd0e1b4_82c5_421f_937b_109b1c576a21.slice/crio-d0ec9b4746b676cd502037a6f6af655a8365316650c081e6819eb363d78ea038 WatchSource:0}: Error finding container d0ec9b4746b676cd502037a6f6af655a8365316650c081e6819eb363d78ea038: Status 404 returned error can't find the container with id d0ec9b4746b676cd502037a6f6af655a8365316650c081e6819eb363d78ea038 Sep 10 00:05:23.628940 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.628920 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:05:23.785304 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:23.785264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf46l" event={"ID":"2dd0e1b4-82c5-421f-937b-109b1c576a21","Type":"ContainerStarted","Data":"d0ec9b4746b676cd502037a6f6af655a8365316650c081e6819eb363d78ea038"} Sep 10 00:05:24.332998 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.332962 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:05:24.335998 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.335969 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.338334 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338299 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 00:05:24.338493 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338299 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 00:05:24.338493 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338346 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 00:05:24.338685 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338665 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 00:05:24.338758 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338696 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wwwmg\"" Sep 10 00:05:24.338758 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338705 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 00:05:24.338900 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338878 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 00:05:24.339035 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.338976 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 00:05:24.339456 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.339437 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 00:05:24.339456 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.339447 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 00:05:24.349784 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.349754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:05:24.526595 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24760597-7842-42fd-8de5-ae2df2197a21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.526741 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.526741 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24760597-7842-42fd-8de5-ae2df2197a21-config-out\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.526853 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526741 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-web-config\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.526853 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.526853 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526833 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8j7f\" (UniqueName: \"kubernetes.io/projected/24760597-7842-42fd-8de5-ae2df2197a21-kube-api-access-w8j7f\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24760597-7842-42fd-8de5-ae2df2197a21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526941 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24760597-7842-42fd-8de5-ae2df2197a21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24760597-7842-42fd-8de5-ae2df2197a21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.526982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-config-volume\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.527031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.527022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628397 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8j7f\" (UniqueName: \"kubernetes.io/projected/24760597-7842-42fd-8de5-ae2df2197a21-kube-api-access-w8j7f\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628397 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628593 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24760597-7842-42fd-8de5-ae2df2197a21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628593 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24760597-7842-42fd-8de5-ae2df2197a21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628593 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24760597-7842-42fd-8de5-ae2df2197a21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628745 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628646 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-config-volume\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628745 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628849 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24760597-7842-42fd-8de5-ae2df2197a21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628849 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628849 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24760597-7842-42fd-8de5-ae2df2197a21-config-out\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.628849 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-web-config\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.629051 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.628860 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24760597-7842-42fd-8de5-ae2df2197a21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.629611 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.629302 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24760597-7842-42fd-8de5-ae2df2197a21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.629611 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.629507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24760597-7842-42fd-8de5-ae2df2197a21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.629801 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.629662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.629801 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.629721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.631971 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.631922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-config-volume\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.632405 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.632346 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24760597-7842-42fd-8de5-ae2df2197a21-config-out\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.632926 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.632699 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.632926 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.632775 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.632926 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.632797 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.632926 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.632919 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-web-config\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.633523 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.633480 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24760597-7842-42fd-8de5-ae2df2197a21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.633640 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.633620 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.634828 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.634781 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24760597-7842-42fd-8de5-ae2df2197a21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.637076 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.637054 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8j7f\" (UniqueName: \"kubernetes.io/projected/24760597-7842-42fd-8de5-ae2df2197a21-kube-api-access-w8j7f\") pod \"alertmanager-main-0\" (UID: \"24760597-7842-42fd-8de5-ae2df2197a21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.647868 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.647838 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:05:24.986242 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:24.986202 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:05:24.992544 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:24.992519 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24760597_7842_42fd_8de5_ae2df2197a21.slice/crio-697a5bc81c6efe2a0a3f7430daf197a72b9a615ea93e3318ee00b80393f3f285 WatchSource:0}: Error finding container 697a5bc81c6efe2a0a3f7430daf197a72b9a615ea93e3318ee00b80393f3f285: Status 404 returned error can't find the container with id 697a5bc81c6efe2a0a3f7430daf197a72b9a615ea93e3318ee00b80393f3f285 Sep 10 00:05:25.794387 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:25.794352 2568 generic.go:356] "Generic (PLEG): container finished" podID="2dd0e1b4-82c5-421f-937b-109b1c576a21" containerID="cf3c633f9ff3ea0d69abd4be9371e972d5f13aafc0db71e9a76594e057dedb20" exitCode=0 Sep 10 00:05:25.794852 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:25.794453 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf46l" event={"ID":"2dd0e1b4-82c5-421f-937b-109b1c576a21","Type":"ContainerDied","Data":"cf3c633f9ff3ea0d69abd4be9371e972d5f13aafc0db71e9a76594e057dedb20"} Sep 10 00:05:25.796839 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:25.796798 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"697a5bc81c6efe2a0a3f7430daf197a72b9a615ea93e3318ee00b80393f3f285"} Sep 10 00:05:26.802173 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:26.802136 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf46l" event={"ID":"2dd0e1b4-82c5-421f-937b-109b1c576a21","Type":"ContainerStarted","Data":"aca6f1463645ad644d97972a46687531ae90e34addcf2a3ed10ac9db5dddb00d"} Sep 10 00:05:26.802650 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:26.802197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf46l" event={"ID":"2dd0e1b4-82c5-421f-937b-109b1c576a21","Type":"ContainerStarted","Data":"ae858b5f53c4cd6b3247df48acf89308cfa06db067ed12e122a19a9a125a7a92"} Sep 10 00:05:26.803855 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:26.803829 2568 generic.go:356] "Generic (PLEG): container finished" podID="24760597-7842-42fd-8de5-ae2df2197a21" containerID="41c82bf8bf9ea8a6ea69b863c8c5d1e88af072a9e9222d84cdb9d3c5839a2688" exitCode=0 Sep 10 00:05:26.803955 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:26.803885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerDied","Data":"41c82bf8bf9ea8a6ea69b863c8c5d1e88af072a9e9222d84cdb9d3c5839a2688"} Sep 10 00:05:26.819166 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:26.819035 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mf46l" podStartSLOduration=2.632535105 podStartE2EDuration="3.819013534s" totalImagesPullingTime="1.123899898s" totalInitContainerRuntime="62.578531ms" isStatefulPod=true podCreationTimestamp="2026-09-10 00:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:26.818800334 +0000 UTC m=+311.472470435" watchObservedRunningTime="2026-09-10 00:05:26.819013534 +0000 UTC m=+311.472683637" Sep 10 00:05:28.059998 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.059951 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp"] Sep 10 00:05:28.062309 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.062287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.064517 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.064488 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 00:05:28.064671 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.064648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qt5lb\"" Sep 10 00:05:28.072039 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.071978 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp"] Sep 10 00:05:28.156030 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.155990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0449672c-c5d1-4818-8aaf-b06ff18ab283-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6gkdp\" (UID: \"0449672c-c5d1-4818-8aaf-b06ff18ab283\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.156237 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.156104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs84s\" (UniqueName: \"kubernetes.io/projected/0449672c-c5d1-4818-8aaf-b06ff18ab283-kube-api-access-rs84s\") pod \"monitoring-plugin-85bbbbbf4-6gkdp\" (UID: \"0449672c-c5d1-4818-8aaf-b06ff18ab283\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.256818 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.256772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0449672c-c5d1-4818-8aaf-b06ff18ab283-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6gkdp\" (UID: \"0449672c-c5d1-4818-8aaf-b06ff18ab283\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.257007 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.256857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs84s\" (UniqueName: \"kubernetes.io/projected/0449672c-c5d1-4818-8aaf-b06ff18ab283-kube-api-access-rs84s\") pod \"monitoring-plugin-85bbbbbf4-6gkdp\" (UID: \"0449672c-c5d1-4818-8aaf-b06ff18ab283\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.259576 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.259547 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0449672c-c5d1-4818-8aaf-b06ff18ab283-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6gkdp\" (UID: \"0449672c-c5d1-4818-8aaf-b06ff18ab283\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.264572 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.264512 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs84s\" (UniqueName: \"kubernetes.io/projected/0449672c-c5d1-4818-8aaf-b06ff18ab283-kube-api-access-rs84s\") pod \"monitoring-plugin-85bbbbbf4-6gkdp\" (UID: \"0449672c-c5d1-4818-8aaf-b06ff18ab283\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.372675 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.372652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:28.482955 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.482929 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7649779665-llc5w"] Sep 10 00:05:28.485791 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.485771 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.488528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.488283 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-snk8f\"" Sep 10 00:05:28.488528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.488356 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 00:05:28.488528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.488406 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 00:05:28.488528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.488412 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 00:05:28.488528 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.488412 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 00:05:28.488821 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.488533 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 00:05:28.493071 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.493050 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 00:05:28.498489 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.498453 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7649779665-llc5w"] Sep 10 00:05:28.557981 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.557956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558107 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.557994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558107 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.558029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-metrics-client-ca\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558107 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.558062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-federate-client-tls\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558225 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.558127 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-serving-certs-ca-bundle\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558225 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.558157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-secret-telemeter-client\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558225 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.558173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-telemeter-client-tls\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.558325 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.558246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvxm\" (UniqueName: \"kubernetes.io/projected/76e21c65-e07a-42d9-9ad0-073e06afed7f-kube-api-access-4wvxm\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.642698 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.642625 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp"] Sep 10 00:05:28.645855 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:28.645822 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0449672c_c5d1_4818_8aaf_b06ff18ab283.slice/crio-fa2a8ac07a2e4e127f3c2f823bb2dc76d170a80496607dcf0967bde27c768e65 WatchSource:0}: Error finding container fa2a8ac07a2e4e127f3c2f823bb2dc76d170a80496607dcf0967bde27c768e65: Status 404 returned error can't find the container with id fa2a8ac07a2e4e127f3c2f823bb2dc76d170a80496607dcf0967bde27c768e65 Sep 10 00:05:28.659437 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659534 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659534 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-metrics-client-ca\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659612 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-federate-client-tls\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659612 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-serving-certs-ca-bundle\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659691 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659632 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-secret-telemeter-client\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659691 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-telemeter-client-tls\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.659786 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.659700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvxm\" (UniqueName: \"kubernetes.io/projected/76e21c65-e07a-42d9-9ad0-073e06afed7f-kube-api-access-4wvxm\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.660374 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.660320 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-metrics-client-ca\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.660480 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.660368 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-serving-certs-ca-bundle\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.660480 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.660416 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e21c65-e07a-42d9-9ad0-073e06afed7f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.662408 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.662380 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.662507 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.662496 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-telemeter-client-tls\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.662545 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.662525 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-federate-client-tls\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.663199 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.663165 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76e21c65-e07a-42d9-9ad0-073e06afed7f-secret-telemeter-client\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.666836 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.666816 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvxm\" (UniqueName: \"kubernetes.io/projected/76e21c65-e07a-42d9-9ad0-073e06afed7f-kube-api-access-4wvxm\") pod \"telemeter-client-7649779665-llc5w\" (UID: \"76e21c65-e07a-42d9-9ad0-073e06afed7f\") " pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.805351 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.805309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" Sep 10 00:05:28.814967 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.814938 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"c63ea1d8bfa009ef27b9cb715197f9997c5e160a0f3f57d99f43726259cf0d3b"} Sep 10 00:05:28.815072 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.815021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"f4b74e79c13e840032915a22971c4b926860849769134bc6ec1886c15beb2551"} Sep 10 00:05:28.815072 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.815067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"53ea2684a01dfd19871ea97adb5e73b5c34903207be7554d68e66736542a02a9"} Sep 10 00:05:28.815167 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.815128 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"616d7c6efe90b299dc4ba5da2f4825953b60bb93d0ee0efebde7d343699359cc"} Sep 10 00:05:28.815213 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.815168 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"e6c48c9110c85e89799644fcfadbdb1e91793469cd173708bcf1885975430aa8"} Sep 10 00:05:28.816147 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:28.816119 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" event={"ID":"0449672c-c5d1-4818-8aaf-b06ff18ab283","Type":"ContainerStarted","Data":"fa2a8ac07a2e4e127f3c2f823bb2dc76d170a80496607dcf0967bde27c768e65"} Sep 10 00:05:29.079956 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.079917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7649779665-llc5w"] Sep 10 00:05:29.083893 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:29.083867 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e21c65_e07a_42d9_9ad0_073e06afed7f.slice/crio-8ac78fa12dbbd87c1f4c6f6c01d130e2333a0cf8a750251385fc05a461e36902 WatchSource:0}: Error finding container 8ac78fa12dbbd87c1f4c6f6c01d130e2333a0cf8a750251385fc05a461e36902: Status 404 returned error can't find the container with id 8ac78fa12dbbd87c1f4c6f6c01d130e2333a0cf8a750251385fc05a461e36902 Sep 10 00:05:29.405943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.405855 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-777c58b4cd-7rhxh"] Sep 10 00:05:29.408906 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.408886 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.421295 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.419393 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 00:05:29.421295 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.419826 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777c58b4cd-7rhxh"] Sep 10 00:05:29.467475 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-trusted-ca-bundle\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.467475 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-oauth-serving-cert\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.467691 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9h5g\" (UniqueName: \"kubernetes.io/projected/00227f8b-d54a-4490-8166-e942ca412b65-kube-api-access-h9h5g\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.467691 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-service-ca\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.467691 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-console-config\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.467799 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-oauth-config\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.467799 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.467755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-serving-cert\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.568893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-serving-cert\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.568990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-trusted-ca-bundle\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.569019 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-oauth-serving-cert\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.569046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9h5g\" (UniqueName: \"kubernetes.io/projected/00227f8b-d54a-4490-8166-e942ca412b65-kube-api-access-h9h5g\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.569081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-service-ca\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.569163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-console-config\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.569317 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.569196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-oauth-config\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.570180 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.570114 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-service-ca\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.570180 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.570110 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-console-config\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.570378 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.570348 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-oauth-serving-cert\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.570451 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.570361 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-trusted-ca-bundle\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.572434 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.572399 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-oauth-config\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.572687 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.572656 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-serving-cert\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.580509 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.580454 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9h5g\" (UniqueName: \"kubernetes.io/projected/00227f8b-d54a-4490-8166-e942ca412b65-kube-api-access-h9h5g\") pod \"console-777c58b4cd-7rhxh\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.724743 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.724657 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:29.828157 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:29.828122 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" event={"ID":"76e21c65-e07a-42d9-9ad0-073e06afed7f","Type":"ContainerStarted","Data":"8ac78fa12dbbd87c1f4c6f6c01d130e2333a0cf8a750251385fc05a461e36902"} Sep 10 00:05:30.042665 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.042628 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777c58b4cd-7rhxh"] Sep 10 00:05:30.195167 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:30.195127 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00227f8b_d54a_4490_8166_e942ca412b65.slice/crio-93272cde83943180dfb4408455e91a89285b622bc5edfa2c23169cca52491031 WatchSource:0}: Error finding container 93272cde83943180dfb4408455e91a89285b622bc5edfa2c23169cca52491031: Status 404 returned error can't find the container with id 93272cde83943180dfb4408455e91a89285b622bc5edfa2c23169cca52491031 Sep 10 00:05:30.833084 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.833041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c58b4cd-7rhxh" event={"ID":"00227f8b-d54a-4490-8166-e942ca412b65","Type":"ContainerStarted","Data":"0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d"} Sep 10 00:05:30.833304 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.833124 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c58b4cd-7rhxh" event={"ID":"00227f8b-d54a-4490-8166-e942ca412b65","Type":"ContainerStarted","Data":"93272cde83943180dfb4408455e91a89285b622bc5edfa2c23169cca52491031"} Sep 10 00:05:30.834535 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.834504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" event={"ID":"0449672c-c5d1-4818-8aaf-b06ff18ab283","Type":"ContainerStarted","Data":"091dc7e507493ac7961e4fce0ab72e73e591132534c06e5194d0a8b512a93ef1"} Sep 10 00:05:30.834693 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.834627 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:30.838074 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.838042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24760597-7842-42fd-8de5-ae2df2197a21","Type":"ContainerStarted","Data":"7889264ab85460646198a7ca1922d99df1b3e204f5c9d27d488d3a257859c17b"} Sep 10 00:05:30.840727 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.840706 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" Sep 10 00:05:30.849455 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.849411 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-777c58b4cd-7rhxh" podStartSLOduration=1.849395848 podStartE2EDuration="1.849395848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:30.847975926 +0000 UTC m=+315.501646025" watchObservedRunningTime="2026-09-10 00:05:30.849395848 +0000 UTC m=+315.503065945" Sep 10 00:05:30.871365 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.871310 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.865522314 podStartE2EDuration="6.871295076s" totalImagesPullingTime="3.989671856s" totalInitContainerRuntime="16.100906ms" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:30.86937095 +0000 UTC m=+315.523041049" watchObservedRunningTime="2026-09-10 00:05:30.871295076 +0000 UTC m=+315.524965202" Sep 10 00:05:30.886328 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:30.886277 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6gkdp" podStartSLOduration=1.312709682 podStartE2EDuration="2.886261923s" totalImagesPullingTime="1.573552241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:30.885336513 +0000 UTC m=+315.539006616" watchObservedRunningTime="2026-09-10 00:05:30.886261923 +0000 UTC m=+315.539932024" Sep 10 00:05:32.848382 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.848345 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" event={"ID":"76e21c65-e07a-42d9-9ad0-073e06afed7f","Type":"ContainerStarted","Data":"ebd4aadf854ba3924a7ec39126ea1661775390d4b02c58d6cb5180f92eb5238e"} Sep 10 00:05:32.848766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.848433 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" event={"ID":"76e21c65-e07a-42d9-9ad0-073e06afed7f","Type":"ContainerStarted","Data":"c35dfcfb29af76b88c9e41c9d7d923d1c3a53ca28deefaa43741ae5ef0854537"} Sep 10 00:05:32.848766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.848459 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" event={"ID":"76e21c65-e07a-42d9-9ad0-073e06afed7f","Type":"ContainerStarted","Data":"6f285f8f4c35c4f6942936df8c77e6f7229cc85722d6f436cee4dbf4f154f462"} Sep 10 00:05:32.869431 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.869381 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7649779665-llc5w" podStartSLOduration=1.700562315 podStartE2EDuration="4.869364394s" totalImagesPullingTime="3.168802079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:32.868184826 +0000 UTC m=+317.521854926" watchObservedRunningTime="2026-09-10 00:05:32.869364394 +0000 UTC m=+317.523034494" Sep 10 00:05:32.950677 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.950641 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777c58b4cd-7rhxh"] Sep 10 00:05:32.971306 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.971272 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6cbb7fd8-2bz5v"] Sep 10 00:05:32.975083 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.975058 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.984281 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.984257 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6cbb7fd8-2bz5v"] Sep 10 00:05:32.999529 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph2zx\" (UniqueName: \"kubernetes.io/projected/37f702da-60a3-4f93-80a1-0db6d509bc9d-kube-api-access-ph2zx\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.999685 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-trusted-ca-bundle\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.999685 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-oauth-serving-cert\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.999791 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-service-ca\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.999791 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-oauth-config\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.999872 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-serving-cert\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:32.999872 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:32.999838 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-config\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.100947 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.100841 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-oauth-config\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.100947 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.100891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-serving-cert\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101179 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101008 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-config\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101179 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph2zx\" (UniqueName: \"kubernetes.io/projected/37f702da-60a3-4f93-80a1-0db6d509bc9d-kube-api-access-ph2zx\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101179 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-trusted-ca-bundle\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101345 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-oauth-serving-cert\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101345 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-service-ca\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101905 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101877 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-config\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.101905 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101902 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-service-ca\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.102034 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101884 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-oauth-serving-cert\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.102034 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.101947 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-trusted-ca-bundle\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.103922 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.103897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-serving-cert\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.103922 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.103917 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-oauth-config\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.108550 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.108533 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph2zx\" (UniqueName: \"kubernetes.io/projected/37f702da-60a3-4f93-80a1-0db6d509bc9d-kube-api-access-ph2zx\") pod \"console-7b6cbb7fd8-2bz5v\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.285324 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.285276 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:33.555468 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.555432 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6cbb7fd8-2bz5v"] Sep 10 00:05:33.558891 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:05:33.558861 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f702da_60a3_4f93_80a1_0db6d509bc9d.slice/crio-dbd957e45833eb49f3fbeca0c044586271adfbabbeb83a15ebcebeb66a390280 WatchSource:0}: Error finding container dbd957e45833eb49f3fbeca0c044586271adfbabbeb83a15ebcebeb66a390280: Status 404 returned error can't find the container with id dbd957e45833eb49f3fbeca0c044586271adfbabbeb83a15ebcebeb66a390280 Sep 10 00:05:33.853034 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.852948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6cbb7fd8-2bz5v" event={"ID":"37f702da-60a3-4f93-80a1-0db6d509bc9d","Type":"ContainerStarted","Data":"9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32"} Sep 10 00:05:33.853034 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.852996 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6cbb7fd8-2bz5v" event={"ID":"37f702da-60a3-4f93-80a1-0db6d509bc9d","Type":"ContainerStarted","Data":"dbd957e45833eb49f3fbeca0c044586271adfbabbeb83a15ebcebeb66a390280"} Sep 10 00:05:33.869429 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:33.869373 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6cbb7fd8-2bz5v" podStartSLOduration=1.869355997 podStartE2EDuration="1.869355997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:33.868449174 +0000 UTC m=+318.522119273" watchObservedRunningTime="2026-09-10 00:05:33.869355997 +0000 UTC m=+318.523026080" Sep 10 00:05:39.724835 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:39.724781 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:39.878843 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:39.878810 2568 generic.go:356] "Generic (PLEG): container finished" podID="736b1280-4c54-4d76-9f69-4dac33548977" containerID="5b763be6635973074264cd36c6fc442006591a3789eaf7e72ff49366875bb045" exitCode=0 Sep 10 00:05:39.878843 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:39.878850 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" event={"ID":"736b1280-4c54-4d76-9f69-4dac33548977","Type":"ContainerDied","Data":"5b763be6635973074264cd36c6fc442006591a3789eaf7e72ff49366875bb045"} Sep 10 00:05:39.879196 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:39.879182 2568 scope.go:117] "RemoveContainer" containerID="5b763be6635973074264cd36c6fc442006591a3789eaf7e72ff49366875bb045" Sep 10 00:05:40.533445 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:40.533413 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-4x6zp_ade01131-b4c3-4e26-bfe9-efd0bb177d05/cluster-samples-operator/0.log" Sep 10 00:05:40.542922 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:40.542896 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-4x6zp_ade01131-b4c3-4e26-bfe9-efd0bb177d05/cluster-samples-operator-watch/0.log" Sep 10 00:05:40.884080 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:40.884047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-dn6bq" event={"ID":"736b1280-4c54-4d76-9f69-4dac33548977","Type":"ContainerStarted","Data":"eba932dce90fd254921c0f1063d216a511cef0ee5378256cc9918d0f4dedf6cc"} Sep 10 00:05:43.285585 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:43.285543 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:43.286066 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:43.285611 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:43.290510 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:43.290485 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:43.899044 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:43.899012 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:05:48.038820 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.038781 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fb8895bff-9m9dx" podUID="dd19a896-429e-4aba-b33f-36ece6d746ae" containerName="console" containerID="cri-o://a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379" gracePeriod=15 Sep 10 00:05:48.269926 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.269900 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:48.346261 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346221 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-oauth-config\") pod \"dd19a896-429e-4aba-b33f-36ece6d746ae\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " Sep 10 00:05:48.346460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346300 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-service-ca\") pod \"dd19a896-429e-4aba-b33f-36ece6d746ae\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " Sep 10 00:05:48.346460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346326 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-console-config\") pod \"dd19a896-429e-4aba-b33f-36ece6d746ae\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " Sep 10 00:05:48.346460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346377 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkc5z\" (UniqueName: \"kubernetes.io/projected/dd19a896-429e-4aba-b33f-36ece6d746ae-kube-api-access-qkc5z\") pod \"dd19a896-429e-4aba-b33f-36ece6d746ae\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " Sep 10 00:05:48.346460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346411 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-serving-cert\") pod \"dd19a896-429e-4aba-b33f-36ece6d746ae\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " Sep 10 00:05:48.346460 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346447 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-oauth-serving-cert\") pod \"dd19a896-429e-4aba-b33f-36ece6d746ae\" (UID: \"dd19a896-429e-4aba-b33f-36ece6d746ae\") " Sep 10 00:05:48.346793 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346760 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "dd19a896-429e-4aba-b33f-36ece6d746ae" (UID: "dd19a896-429e-4aba-b33f-36ece6d746ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:48.346867 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346763 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-console-config" (OuterVolumeSpecName: "console-config") pod "dd19a896-429e-4aba-b33f-36ece6d746ae" (UID: "dd19a896-429e-4aba-b33f-36ece6d746ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:48.346924 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.346863 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dd19a896-429e-4aba-b33f-36ece6d746ae" (UID: "dd19a896-429e-4aba-b33f-36ece6d746ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:48.348600 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.348565 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dd19a896-429e-4aba-b33f-36ece6d746ae" (UID: "dd19a896-429e-4aba-b33f-36ece6d746ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:05:48.348600 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.348582 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dd19a896-429e-4aba-b33f-36ece6d746ae" (UID: "dd19a896-429e-4aba-b33f-36ece6d746ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:05:48.348728 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.348629 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd19a896-429e-4aba-b33f-36ece6d746ae-kube-api-access-qkc5z" (OuterVolumeSpecName: "kube-api-access-qkc5z") pod "dd19a896-429e-4aba-b33f-36ece6d746ae" (UID: "dd19a896-429e-4aba-b33f-36ece6d746ae"). InnerVolumeSpecName "kube-api-access-qkc5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:05:48.447386 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.447344 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:48.447386 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.447377 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:48.447386 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.447389 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkc5z\" (UniqueName: \"kubernetes.io/projected/dd19a896-429e-4aba-b33f-36ece6d746ae-kube-api-access-qkc5z\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:48.447626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.447400 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:48.447626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.447413 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd19a896-429e-4aba-b33f-36ece6d746ae-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:48.447626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.447425 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd19a896-429e-4aba-b33f-36ece6d746ae-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:48.917927 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.917887 2568 generic.go:356] "Generic (PLEG): container finished" podID="dd19a896-429e-4aba-b33f-36ece6d746ae" containerID="a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379" exitCode=0 Sep 10 00:05:48.918129 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.917959 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb8895bff-9m9dx" Sep 10 00:05:48.918129 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.917966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb8895bff-9m9dx" event={"ID":"dd19a896-429e-4aba-b33f-36ece6d746ae","Type":"ContainerDied","Data":"a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379"} Sep 10 00:05:48.918129 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.918040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb8895bff-9m9dx" event={"ID":"dd19a896-429e-4aba-b33f-36ece6d746ae","Type":"ContainerDied","Data":"7c3fd14b3d45cba6421019e3d2bd1f34c35299094dd799ee4cf83211aa1dee03"} Sep 10 00:05:48.918129 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.918061 2568 scope.go:117] "RemoveContainer" containerID="a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379" Sep 10 00:05:48.927489 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.927468 2568 scope.go:117] "RemoveContainer" containerID="a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379" Sep 10 00:05:48.927789 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:05:48.927769 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379\": container with ID starting with a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379 not found: ID does not exist" containerID="a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379" Sep 10 00:05:48.927863 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.927802 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379"} err="failed to get container status \"a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379\": rpc error: code = NotFound desc = could not find container \"a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379\": container with ID starting with a16699f753ad9bd1548c4c99ecc25d8d671fd84ccfff85aed04671ac2b0a6379 not found: ID does not exist" Sep 10 00:05:48.937541 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.937517 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb8895bff-9m9dx"] Sep 10 00:05:48.945203 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:48.945177 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fb8895bff-9m9dx"] Sep 10 00:05:49.845895 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:49.845854 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd19a896-429e-4aba-b33f-36ece6d746ae" path="/var/lib/kubelet/pods/dd19a896-429e-4aba-b33f-36ece6d746ae/volumes" Sep 10 00:05:49.923639 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:49.923603 2568 generic.go:356] "Generic (PLEG): container finished" podID="abd8a604-61bf-4da9-b478-468d75170467" containerID="fe7c15f89ff35fec9748d2e0660db1b88b70de8174ee5314be03acefb2787659" exitCode=0 Sep 10 00:05:49.923822 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:49.923668 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" event={"ID":"abd8a604-61bf-4da9-b478-468d75170467","Type":"ContainerDied","Data":"fe7c15f89ff35fec9748d2e0660db1b88b70de8174ee5314be03acefb2787659"} Sep 10 00:05:49.924107 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:49.924073 2568 scope.go:117] "RemoveContainer" containerID="fe7c15f89ff35fec9748d2e0660db1b88b70de8174ee5314be03acefb2787659" Sep 10 00:05:50.931242 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:50.931201 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4vp4g" event={"ID":"abd8a604-61bf-4da9-b478-468d75170467","Type":"ContainerStarted","Data":"c18409a10583233d2778cfa675d47f9e6bd48be26c96c605463c3d617d53d667"} Sep 10 00:05:57.969966 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:57.969923 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-777c58b4cd-7rhxh" podUID="00227f8b-d54a-4490-8166-e942ca412b65" containerName="console" containerID="cri-o://0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d" gracePeriod=15 Sep 10 00:05:58.217826 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.217800 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:58.341871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.341835 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-oauth-serving-cert\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.341871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.341877 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-serving-cert\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.342136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.341904 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-console-config\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.342136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.341964 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-service-ca\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.342136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342001 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-trusted-ca-bundle\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.342136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342034 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-oauth-config\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.342136 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342088 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9h5g\" (UniqueName: \"kubernetes.io/projected/00227f8b-d54a-4490-8166-e942ca412b65-kube-api-access-h9h5g\") pod \"00227f8b-d54a-4490-8166-e942ca412b65\" (UID: \"00227f8b-d54a-4490-8166-e942ca412b65\") " Sep 10 00:05:58.342401 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342372 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:58.342471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342445 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-console-config" (OuterVolumeSpecName: "console-config") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:58.342471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342460 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-service-ca" (OuterVolumeSpecName: "service-ca") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:58.342549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.342505 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:05:58.344312 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.344272 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:05:58.344431 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.344357 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00227f8b-d54a-4490-8166-e942ca412b65-kube-api-access-h9h5g" (OuterVolumeSpecName: "kube-api-access-h9h5g") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "kube-api-access-h9h5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:05:58.344431 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.344356 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00227f8b-d54a-4490-8166-e942ca412b65" (UID: "00227f8b-d54a-4490-8166-e942ca412b65"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:05:58.443672 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443636 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.443672 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443665 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.443672 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443674 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.443672 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443683 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.443930 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443692 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9h5g\" (UniqueName: \"kubernetes.io/projected/00227f8b-d54a-4490-8166-e942ca412b65-kube-api-access-h9h5g\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.443930 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443701 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00227f8b-d54a-4490-8166-e942ca412b65-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.443930 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.443710 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00227f8b-d54a-4490-8166-e942ca412b65-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:05:58.966225 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.966183 2568 generic.go:356] "Generic (PLEG): container finished" podID="00227f8b-d54a-4490-8166-e942ca412b65" containerID="0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d" exitCode=0 Sep 10 00:05:58.966225 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.966226 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c58b4cd-7rhxh" Sep 10 00:05:58.966499 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.966275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c58b4cd-7rhxh" event={"ID":"00227f8b-d54a-4490-8166-e942ca412b65","Type":"ContainerDied","Data":"0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d"} Sep 10 00:05:58.966499 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.966336 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c58b4cd-7rhxh" event={"ID":"00227f8b-d54a-4490-8166-e942ca412b65","Type":"ContainerDied","Data":"93272cde83943180dfb4408455e91a89285b622bc5edfa2c23169cca52491031"} Sep 10 00:05:58.966499 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.966363 2568 scope.go:117] "RemoveContainer" containerID="0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d" Sep 10 00:05:58.974991 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.974869 2568 scope.go:117] "RemoveContainer" containerID="0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d" Sep 10 00:05:58.975233 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:05:58.975164 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d\": container with ID starting with 0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d not found: ID does not exist" containerID="0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d" Sep 10 00:05:58.975233 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.975189 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d"} err="failed to get container status \"0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d\": rpc error: code = NotFound desc = could not find container \"0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d\": container with ID starting with 0378b52474ac6887ba1c72b3ad973f544dc2eff691c2e5edf83e9d1243708b9d not found: ID does not exist" Sep 10 00:05:58.985793 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.985765 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777c58b4cd-7rhxh"] Sep 10 00:05:58.989179 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:58.989158 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-777c58b4cd-7rhxh"] Sep 10 00:05:59.845962 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:05:59.845925 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00227f8b-d54a-4490-8166-e942ca412b65" path="/var/lib/kubelet/pods/00227f8b-d54a-4490-8166-e942ca412b65/volumes" Sep 10 00:06:29.798641 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:29.798592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:06:29.801116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:29.801075 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95b0252-566a-4352-b9d1-afcabb4c5e56-metrics-certs\") pod \"network-metrics-daemon-wm5p2\" (UID: \"e95b0252-566a-4352-b9d1-afcabb4c5e56\") " pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:06:29.844530 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:29.844495 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s66cg\"" Sep 10 00:06:29.852409 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:29.852383 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm5p2" Sep 10 00:06:30.150126 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:30.150031 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wm5p2"] Sep 10 00:06:30.153300 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:06:30.153271 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95b0252_566a_4352_b9d1_afcabb4c5e56.slice/crio-202538108a76b4301a9dce508337e45b71954ef8faf8df0b332ac6bae49b99f2 WatchSource:0}: Error finding container 202538108a76b4301a9dce508337e45b71954ef8faf8df0b332ac6bae49b99f2: Status 404 returned error can't find the container with id 202538108a76b4301a9dce508337e45b71954ef8faf8df0b332ac6bae49b99f2 Sep 10 00:06:31.083776 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:31.083737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wm5p2" event={"ID":"e95b0252-566a-4352-b9d1-afcabb4c5e56","Type":"ContainerStarted","Data":"202538108a76b4301a9dce508337e45b71954ef8faf8df0b332ac6bae49b99f2"} Sep 10 00:06:32.089426 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:32.089384 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wm5p2" event={"ID":"e95b0252-566a-4352-b9d1-afcabb4c5e56","Type":"ContainerStarted","Data":"73891a734122228b3de0e96c8ab89b7d20000725347cf224b8c67118bcce4526"} Sep 10 00:06:32.089829 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:32.089440 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wm5p2" event={"ID":"e95b0252-566a-4352-b9d1-afcabb4c5e56","Type":"ContainerStarted","Data":"3639f244568ba929ef45f8607ca6882eaf9429a41224888a38abc02bba0bf3fa"} Sep 10 00:06:32.105305 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:06:32.105250 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wm5p2" podStartSLOduration=375.062745742 podStartE2EDuration="6m16.105233041s" totalImagesPullingTime="1.042487299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:06:32.102984071 +0000 UTC m=+376.756654171" watchObservedRunningTime="2026-09-10 00:06:32.105233041 +0000 UTC m=+376.758903141" Sep 10 00:07:03.432227 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:03.432185 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6cbb7fd8-2bz5v"] Sep 10 00:07:28.452131 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.452061 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b6cbb7fd8-2bz5v" podUID="37f702da-60a3-4f93-80a1-0db6d509bc9d" containerName="console" containerID="cri-o://9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32" gracePeriod=15 Sep 10 00:07:28.704642 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.704580 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:07:28.800038 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.799998 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-oauth-serving-cert\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800070 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-oauth-config\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800127 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-config\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800170 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-trusted-ca-bundle\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800208 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph2zx\" (UniqueName: \"kubernetes.io/projected/37f702da-60a3-4f93-80a1-0db6d509bc9d-kube-api-access-ph2zx\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800251 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-service-ca\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800515 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800285 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-serving-cert\") pod \"37f702da-60a3-4f93-80a1-0db6d509bc9d\" (UID: \"37f702da-60a3-4f93-80a1-0db6d509bc9d\") " Sep 10 00:07:28.800515 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800475 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:07:28.800711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800686 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-config" (OuterVolumeSpecName: "console-config") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:07:28.800859 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800831 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:07:28.800950 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.800932 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:07:28.802503 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.802475 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f702da-60a3-4f93-80a1-0db6d509bc9d-kube-api-access-ph2zx" (OuterVolumeSpecName: "kube-api-access-ph2zx") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "kube-api-access-ph2zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:07:28.802597 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.802503 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:07:28.802597 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.802527 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37f702da-60a3-4f93-80a1-0db6d509bc9d" (UID: "37f702da-60a3-4f93-80a1-0db6d509bc9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:07:28.901488 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901443 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:28.901488 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901478 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:28.901488 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901489 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:28.901488 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901499 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph2zx\" (UniqueName: \"kubernetes.io/projected/37f702da-60a3-4f93-80a1-0db6d509bc9d-kube-api-access-ph2zx\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:28.901756 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901507 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:28.901756 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901516 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f702da-60a3-4f93-80a1-0db6d509bc9d-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:28.901756 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:28.901525 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f702da-60a3-4f93-80a1-0db6d509bc9d-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:29.302524 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.302480 2568 generic.go:356] "Generic (PLEG): container finished" podID="37f702da-60a3-4f93-80a1-0db6d509bc9d" containerID="9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32" exitCode=0 Sep 10 00:07:29.302730 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.302535 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6cbb7fd8-2bz5v" Sep 10 00:07:29.302730 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.302578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6cbb7fd8-2bz5v" event={"ID":"37f702da-60a3-4f93-80a1-0db6d509bc9d","Type":"ContainerDied","Data":"9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32"} Sep 10 00:07:29.302730 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.302630 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6cbb7fd8-2bz5v" event={"ID":"37f702da-60a3-4f93-80a1-0db6d509bc9d","Type":"ContainerDied","Data":"dbd957e45833eb49f3fbeca0c044586271adfbabbeb83a15ebcebeb66a390280"} Sep 10 00:07:29.302730 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.302652 2568 scope.go:117] "RemoveContainer" containerID="9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32" Sep 10 00:07:29.311857 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.311839 2568 scope.go:117] "RemoveContainer" containerID="9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32" Sep 10 00:07:29.312181 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:07:29.312159 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32\": container with ID starting with 9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32 not found: ID does not exist" containerID="9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32" Sep 10 00:07:29.312269 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.312187 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32"} err="failed to get container status \"9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32\": rpc error: code = NotFound desc = could not find container \"9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32\": container with ID starting with 9485b713581280789359276861e02a862658e1b6fa02add224053a376be90d32 not found: ID does not exist" Sep 10 00:07:29.322438 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.322410 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6cbb7fd8-2bz5v"] Sep 10 00:07:29.326130 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.326105 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6cbb7fd8-2bz5v"] Sep 10 00:07:29.845954 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:29.845916 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f702da-60a3-4f93-80a1-0db6d509bc9d" path="/var/lib/kubelet/pods/37f702da-60a3-4f93-80a1-0db6d509bc9d/volumes" Sep 10 00:07:40.485157 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485057 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j"] Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485372 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd19a896-429e-4aba-b33f-36ece6d746ae" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485383 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd19a896-429e-4aba-b33f-36ece6d746ae" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485392 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f702da-60a3-4f93-80a1-0db6d509bc9d" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485398 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f702da-60a3-4f93-80a1-0db6d509bc9d" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485416 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00227f8b-d54a-4490-8166-e942ca412b65" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485421 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00227f8b-d54a-4490-8166-e942ca412b65" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485463 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd19a896-429e-4aba-b33f-36ece6d746ae" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485471 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00227f8b-d54a-4490-8166-e942ca412b65" containerName="console" Sep 10 00:07:40.485636 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.485478 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f702da-60a3-4f93-80a1-0db6d509bc9d" containerName="console" Sep 10 00:07:40.487426 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.487409 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.489911 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.489885 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:07:40.490906 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.490889 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d4m7\"" Sep 10 00:07:40.490996 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.490939 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:07:40.496740 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.496718 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j"] Sep 10 00:07:40.598324 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.598289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzwh\" (UniqueName: \"kubernetes.io/projected/92613bb7-6fb3-4d3a-9730-a046ca5280ef-kube-api-access-kpzwh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.598491 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.598350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.598491 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.598457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.698871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.698833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.698999 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.698890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzwh\" (UniqueName: \"kubernetes.io/projected/92613bb7-6fb3-4d3a-9730-a046ca5280ef-kube-api-access-kpzwh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.698999 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.698924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.699332 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.699310 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.699368 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.699322 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.706787 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.706767 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzwh\" (UniqueName: \"kubernetes.io/projected/92613bb7-6fb3-4d3a-9730-a046ca5280ef-kube-api-access-kpzwh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:40.797613 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:40.797580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:41.066203 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:41.066124 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j"] Sep 10 00:07:41.069296 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:07:41.069270 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92613bb7_6fb3_4d3a_9730_a046ca5280ef.slice/crio-ffd1374a1c76655a4a94118328d17644ef5d07f165f4f4534762046ca29e0630 WatchSource:0}: Error finding container ffd1374a1c76655a4a94118328d17644ef5d07f165f4f4534762046ca29e0630: Status 404 returned error can't find the container with id ffd1374a1c76655a4a94118328d17644ef5d07f165f4f4534762046ca29e0630 Sep 10 00:07:41.355186 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:41.355084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerStarted","Data":"ffd1374a1c76655a4a94118328d17644ef5d07f165f4f4534762046ca29e0630"} Sep 10 00:07:47.382677 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:47.382640 2568 generic.go:356] "Generic (PLEG): container finished" podID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerID="e873b0ee31831fab7ea157e2b30f8341c82ee8eeb28e3db460d39baa1940cf94" exitCode=0 Sep 10 00:07:47.383047 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:47.382689 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerDied","Data":"e873b0ee31831fab7ea157e2b30f8341c82ee8eeb28e3db460d39baa1940cf94"} Sep 10 00:07:49.395546 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:49.395506 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerStarted","Data":"d9a18e417f29d4e7134403b63b56e74d711da9188b730be9d4d756b61251b14d"} Sep 10 00:07:50.401383 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:50.401337 2568 generic.go:356] "Generic (PLEG): container finished" podID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerID="d9a18e417f29d4e7134403b63b56e74d711da9188b730be9d4d756b61251b14d" exitCode=0 Sep 10 00:07:50.401755 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:50.401422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerDied","Data":"d9a18e417f29d4e7134403b63b56e74d711da9188b730be9d4d756b61251b14d"} Sep 10 00:07:57.433131 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:57.433070 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerStarted","Data":"ec63c64bbcba582894579c3ee19c0718e586f471f340481e07c99e66616be549"} Sep 10 00:07:57.449423 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:57.449379 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" podStartSLOduration=2.553186798 podStartE2EDuration="17.449365217s" totalImagesPullingTime="14.896178419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:07:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:07:57.44849455 +0000 UTC m=+462.102164650" watchObservedRunningTime="2026-09-10 00:07:57.449365217 +0000 UTC m=+462.103035318" Sep 10 00:07:58.439313 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:58.439274 2568 generic.go:356] "Generic (PLEG): container finished" podID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerID="ec63c64bbcba582894579c3ee19c0718e586f471f340481e07c99e66616be549" exitCode=0 Sep 10 00:07:58.439679 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:58.439344 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerDied","Data":"ec63c64bbcba582894579c3ee19c0718e586f471f340481e07c99e66616be549"} Sep 10 00:07:59.568633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.568603 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:07:59.662407 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.662372 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-util\") pod \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " Sep 10 00:07:59.662602 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.662416 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpzwh\" (UniqueName: \"kubernetes.io/projected/92613bb7-6fb3-4d3a-9730-a046ca5280ef-kube-api-access-kpzwh\") pod \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " Sep 10 00:07:59.662602 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.662435 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-bundle\") pod \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\" (UID: \"92613bb7-6fb3-4d3a-9730-a046ca5280ef\") " Sep 10 00:07:59.663082 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.663052 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-bundle" (OuterVolumeSpecName: "bundle") pod "92613bb7-6fb3-4d3a-9730-a046ca5280ef" (UID: "92613bb7-6fb3-4d3a-9730-a046ca5280ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:07:59.664726 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.664698 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92613bb7-6fb3-4d3a-9730-a046ca5280ef-kube-api-access-kpzwh" (OuterVolumeSpecName: "kube-api-access-kpzwh") pod "92613bb7-6fb3-4d3a-9730-a046ca5280ef" (UID: "92613bb7-6fb3-4d3a-9730-a046ca5280ef"). InnerVolumeSpecName "kube-api-access-kpzwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:07:59.666568 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.666543 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-util" (OuterVolumeSpecName: "util") pod "92613bb7-6fb3-4d3a-9730-a046ca5280ef" (UID: "92613bb7-6fb3-4d3a-9730-a046ca5280ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:07:59.762963 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.762874 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:59.762963 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.762905 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpzwh\" (UniqueName: \"kubernetes.io/projected/92613bb7-6fb3-4d3a-9730-a046ca5280ef-kube-api-access-kpzwh\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:07:59.762963 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:07:59.762916 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92613bb7-6fb3-4d3a-9730-a046ca5280ef-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:08:00.449367 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:00.449338 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" Sep 10 00:08:00.449553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:00.449338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ghn2j" event={"ID":"92613bb7-6fb3-4d3a-9730-a046ca5280ef","Type":"ContainerDied","Data":"ffd1374a1c76655a4a94118328d17644ef5d07f165f4f4534762046ca29e0630"} Sep 10 00:08:00.449553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:00.449466 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd1374a1c76655a4a94118328d17644ef5d07f165f4f4534762046ca29e0630" Sep 10 00:08:10.135869 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.135834 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj"] Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136165 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="util" Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136177 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="util" Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136189 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="extract" Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136198 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="extract" Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136209 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="pull" Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136219 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="pull" Sep 10 00:08:10.136525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.136285 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="92613bb7-6fb3-4d3a-9730-a046ca5280ef" containerName="extract" Sep 10 00:08:10.138294 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.138278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.140644 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.140604 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wfkm7\"" Sep 10 00:08:10.140787 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.140611 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:08:10.140787 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.140743 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 00:08:10.148927 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.148901 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj"] Sep 10 00:08:10.252178 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.252141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd97h\" (UniqueName: \"kubernetes.io/projected/9414286e-0c11-403e-a560-037c4c3f2111-kube-api-access-pd97h\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddqhj\" (UID: \"9414286e-0c11-403e-a560-037c4c3f2111\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.252357 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.252222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9414286e-0c11-403e-a560-037c4c3f2111-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddqhj\" (UID: \"9414286e-0c11-403e-a560-037c4c3f2111\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.353367 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.353329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9414286e-0c11-403e-a560-037c4c3f2111-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddqhj\" (UID: \"9414286e-0c11-403e-a560-037c4c3f2111\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.353541 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.353392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd97h\" (UniqueName: \"kubernetes.io/projected/9414286e-0c11-403e-a560-037c4c3f2111-kube-api-access-pd97h\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddqhj\" (UID: \"9414286e-0c11-403e-a560-037c4c3f2111\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.353770 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.353747 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9414286e-0c11-403e-a560-037c4c3f2111-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddqhj\" (UID: \"9414286e-0c11-403e-a560-037c4c3f2111\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.376457 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.376429 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd97h\" (UniqueName: \"kubernetes.io/projected/9414286e-0c11-403e-a560-037c4c3f2111-kube-api-access-pd97h\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddqhj\" (UID: \"9414286e-0c11-403e-a560-037c4c3f2111\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.447612 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.447519 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" Sep 10 00:08:10.729533 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:10.729507 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj"] Sep 10 00:08:10.732168 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:08:10.732139 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9414286e_0c11_403e_a560_037c4c3f2111.slice/crio-0da6d7166ecaf77d5d0c3a11b9a5d08a29b9bbe9de7b39e999a57c32245bd01e WatchSource:0}: Error finding container 0da6d7166ecaf77d5d0c3a11b9a5d08a29b9bbe9de7b39e999a57c32245bd01e: Status 404 returned error can't find the container with id 0da6d7166ecaf77d5d0c3a11b9a5d08a29b9bbe9de7b39e999a57c32245bd01e Sep 10 00:08:11.494235 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:11.494189 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" event={"ID":"9414286e-0c11-403e-a560-037c4c3f2111","Type":"ContainerStarted","Data":"0da6d7166ecaf77d5d0c3a11b9a5d08a29b9bbe9de7b39e999a57c32245bd01e"} Sep 10 00:08:12.501138 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:12.501080 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" event={"ID":"9414286e-0c11-403e-a560-037c4c3f2111","Type":"ContainerStarted","Data":"e823dbc45df9708592cdcc2a608bfb251ff8646ad17b220f10c52ef1d0416f7f"} Sep 10 00:08:12.523988 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:12.523937 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddqhj" podStartSLOduration=0.931617805 podStartE2EDuration="2.523920972s" totalImagesPullingTime="1.592303167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:12.522543681 +0000 UTC m=+477.176213783" watchObservedRunningTime="2026-09-10 00:08:12.523920972 +0000 UTC m=+477.177591072" Sep 10 00:08:14.146893 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.146856 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-658f8"] Sep 10 00:08:14.153268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.153242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.155801 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.155781 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 00:08:14.156868 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.156845 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-975gz\"" Sep 10 00:08:14.156868 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.156867 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 00:08:14.158875 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.158854 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-658f8"] Sep 10 00:08:14.287626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.287592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ftj\" (UniqueName: \"kubernetes.io/projected/72533122-53cc-4d92-a808-b664fc895d64-kube-api-access-x6ftj\") pod \"cert-manager-webhook-6486ffd997-658f8\" (UID: \"72533122-53cc-4d92-a808-b664fc895d64\") " pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.287803 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.287635 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72533122-53cc-4d92-a808-b664fc895d64-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-658f8\" (UID: \"72533122-53cc-4d92-a808-b664fc895d64\") " pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.388433 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.388388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ftj\" (UniqueName: \"kubernetes.io/projected/72533122-53cc-4d92-a808-b664fc895d64-kube-api-access-x6ftj\") pod \"cert-manager-webhook-6486ffd997-658f8\" (UID: \"72533122-53cc-4d92-a808-b664fc895d64\") " pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.388433 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.388435 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72533122-53cc-4d92-a808-b664fc895d64-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-658f8\" (UID: \"72533122-53cc-4d92-a808-b664fc895d64\") " pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.407356 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.407281 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72533122-53cc-4d92-a808-b664fc895d64-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-658f8\" (UID: \"72533122-53cc-4d92-a808-b664fc895d64\") " pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.407356 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.407342 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ftj\" (UniqueName: \"kubernetes.io/projected/72533122-53cc-4d92-a808-b664fc895d64-kube-api-access-x6ftj\") pod \"cert-manager-webhook-6486ffd997-658f8\" (UID: \"72533122-53cc-4d92-a808-b664fc895d64\") " pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.472994 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.472958 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:14.740214 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:14.740188 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-658f8"] Sep 10 00:08:14.742519 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:08:14.742495 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72533122_53cc_4d92_a808_b664fc895d64.slice/crio-9736a16ed39090634b89012f34b9e4bc3cd42b3a4cc15615eb9737b93516676f WatchSource:0}: Error finding container 9736a16ed39090634b89012f34b9e4bc3cd42b3a4cc15615eb9737b93516676f: Status 404 returned error can't find the container with id 9736a16ed39090634b89012f34b9e4bc3cd42b3a4cc15615eb9737b93516676f Sep 10 00:08:15.527586 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:15.527544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" event={"ID":"72533122-53cc-4d92-a808-b664fc895d64","Type":"ContainerStarted","Data":"9736a16ed39090634b89012f34b9e4bc3cd42b3a4cc15615eb9737b93516676f"} Sep 10 00:08:17.539348 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:17.539253 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" event={"ID":"72533122-53cc-4d92-a808-b664fc895d64","Type":"ContainerStarted","Data":"ebcaacd247a0c8d8fdf04d7f0e54c6e2f87d30550978400737496eee158b9aa1"} Sep 10 00:08:17.539348 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:17.539321 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:17.554896 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:17.554845 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" podStartSLOduration=1.050396986 podStartE2EDuration="3.554830026s" totalImagesPullingTime="2.50443304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:17.553745096 +0000 UTC m=+482.207415196" watchObservedRunningTime="2026-09-10 00:08:17.554830026 +0000 UTC m=+482.208500125" Sep 10 00:08:23.546508 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:23.546473 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-658f8" Sep 10 00:08:43.857262 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:43.857220 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc"] Sep 10 00:08:43.860200 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:43.860180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:43.862718 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:43.862688 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:08:43.863732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:43.863707 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 00:08:43.863732 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:43.863722 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xtl5k\"" Sep 10 00:08:43.869711 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:43.869684 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc"] Sep 10 00:08:44.036608 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.036563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7163626d-e8a4-415b-9e64-2ee370059f26-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dzwlc\" (UID: \"7163626d-e8a4-415b-9e64-2ee370059f26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.036800 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.036673 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4s6b\" (UniqueName: \"kubernetes.io/projected/7163626d-e8a4-415b-9e64-2ee370059f26-kube-api-access-h4s6b\") pod \"openshift-lws-operator-fd8ccff4c-dzwlc\" (UID: \"7163626d-e8a4-415b-9e64-2ee370059f26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.137216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.137125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7163626d-e8a4-415b-9e64-2ee370059f26-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dzwlc\" (UID: \"7163626d-e8a4-415b-9e64-2ee370059f26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.137216 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.137196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s6b\" (UniqueName: \"kubernetes.io/projected/7163626d-e8a4-415b-9e64-2ee370059f26-kube-api-access-h4s6b\") pod \"openshift-lws-operator-fd8ccff4c-dzwlc\" (UID: \"7163626d-e8a4-415b-9e64-2ee370059f26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.137615 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.137590 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7163626d-e8a4-415b-9e64-2ee370059f26-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dzwlc\" (UID: \"7163626d-e8a4-415b-9e64-2ee370059f26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.145279 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.145245 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4s6b\" (UniqueName: \"kubernetes.io/projected/7163626d-e8a4-415b-9e64-2ee370059f26-kube-api-access-h4s6b\") pod \"openshift-lws-operator-fd8ccff4c-dzwlc\" (UID: \"7163626d-e8a4-415b-9e64-2ee370059f26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.170311 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.170282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" Sep 10 00:08:44.436691 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.436571 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc"] Sep 10 00:08:44.439610 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:08:44.439580 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7163626d_e8a4_415b_9e64_2ee370059f26.slice/crio-d6118dd200ac78c8dfe93b43801f69c4b54a258df0534b302031e44dfe23f7d7 WatchSource:0}: Error finding container d6118dd200ac78c8dfe93b43801f69c4b54a258df0534b302031e44dfe23f7d7: Status 404 returned error can't find the container with id d6118dd200ac78c8dfe93b43801f69c4b54a258df0534b302031e44dfe23f7d7 Sep 10 00:08:44.656394 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:44.656358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" event={"ID":"7163626d-e8a4-415b-9e64-2ee370059f26","Type":"ContainerStarted","Data":"d6118dd200ac78c8dfe93b43801f69c4b54a258df0534b302031e44dfe23f7d7"} Sep 10 00:08:47.672626 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:47.672579 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" event={"ID":"7163626d-e8a4-415b-9e64-2ee370059f26","Type":"ContainerStarted","Data":"450a118cc43ae962b977815ccad931ae6384d49c31f05f724e3f224765f57d29"} Sep 10 00:08:47.689901 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:47.689846 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dzwlc" podStartSLOduration=2.270337481 podStartE2EDuration="4.689827262s" totalImagesPullingTime="2.419489781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:47.687316436 +0000 UTC m=+512.340986536" watchObservedRunningTime="2026-09-10 00:08:47.689827262 +0000 UTC m=+512.343497366" Sep 10 00:08:50.275472 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.275430 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2"] Sep 10 00:08:50.278031 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.278014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.280363 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.280339 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:08:50.280497 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.280391 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:08:50.281266 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.281247 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d4m7\"" Sep 10 00:08:50.284188 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.284156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.284301 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.284275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzgsg\" (UniqueName: \"kubernetes.io/projected/047af51f-c154-4858-9265-dc3c564842e1-kube-api-access-fzgsg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.284368 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.284318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.376404 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.376362 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2"] Sep 10 00:08:50.385355 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.385330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.385459 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.385394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzgsg\" (UniqueName: \"kubernetes.io/projected/047af51f-c154-4858-9265-dc3c564842e1-kube-api-access-fzgsg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.385459 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.385418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.385781 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.385767 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.385781 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.385774 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.393050 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.393017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzgsg\" (UniqueName: \"kubernetes.io/projected/047af51f-c154-4858-9265-dc3c564842e1-kube-api-access-fzgsg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.587806 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.587774 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:50.861119 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:50.861047 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2"] Sep 10 00:08:50.863844 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:08:50.863816 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047af51f_c154_4858_9265_dc3c564842e1.slice/crio-a7871fa3e0ed0b95dc19da44b646e21d9472e4da6b485a16a1929c116bad2b4b WatchSource:0}: Error finding container a7871fa3e0ed0b95dc19da44b646e21d9472e4da6b485a16a1929c116bad2b4b: Status 404 returned error can't find the container with id a7871fa3e0ed0b95dc19da44b646e21d9472e4da6b485a16a1929c116bad2b4b Sep 10 00:08:51.691542 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:51.691447 2568 generic.go:356] "Generic (PLEG): container finished" podID="047af51f-c154-4858-9265-dc3c564842e1" containerID="ebc26ce08b36b639dbaae9e81f1301896da594ce6ec334d3d1759b6546b971af" exitCode=0 Sep 10 00:08:51.691542 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:51.691492 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" event={"ID":"047af51f-c154-4858-9265-dc3c564842e1","Type":"ContainerDied","Data":"ebc26ce08b36b639dbaae9e81f1301896da594ce6ec334d3d1759b6546b971af"} Sep 10 00:08:51.691542 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:51.691528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" event={"ID":"047af51f-c154-4858-9265-dc3c564842e1","Type":"ContainerStarted","Data":"a7871fa3e0ed0b95dc19da44b646e21d9472e4da6b485a16a1929c116bad2b4b"} Sep 10 00:08:52.698000 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:52.697959 2568 generic.go:356] "Generic (PLEG): container finished" podID="047af51f-c154-4858-9265-dc3c564842e1" containerID="956b4fae2dd42188dfb195265c8b139b22ebb8af2dacdb88a863fe2615fd0ec3" exitCode=0 Sep 10 00:08:52.698430 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:52.698041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" event={"ID":"047af51f-c154-4858-9265-dc3c564842e1","Type":"ContainerDied","Data":"956b4fae2dd42188dfb195265c8b139b22ebb8af2dacdb88a863fe2615fd0ec3"} Sep 10 00:08:53.705464 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:53.705427 2568 generic.go:356] "Generic (PLEG): container finished" podID="047af51f-c154-4858-9265-dc3c564842e1" containerID="a639c724a753a8daa9deceafa442a327b9e3ad962541725eaa8dba1d84ef6ea0" exitCode=0 Sep 10 00:08:53.705842 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:53.705478 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" event={"ID":"047af51f-c154-4858-9265-dc3c564842e1","Type":"ContainerDied","Data":"a639c724a753a8daa9deceafa442a327b9e3ad962541725eaa8dba1d84ef6ea0"} Sep 10 00:08:54.835298 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.835269 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:54.887102 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887053 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx"] Sep 10 00:08:54.887370 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887358 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="extract" Sep 10 00:08:54.887420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887372 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="extract" Sep 10 00:08:54.887420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887391 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="util" Sep 10 00:08:54.887420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887396 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="util" Sep 10 00:08:54.887420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887412 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="pull" Sep 10 00:08:54.887420 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887417 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="pull" Sep 10 00:08:54.887613 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.887462 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="047af51f-c154-4858-9265-dc3c564842e1" containerName="extract" Sep 10 00:08:54.889467 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.889449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:54.891988 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.891957 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 00:08:54.892163 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.891964 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 00:08:54.892163 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.892050 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m7xbq\"" Sep 10 00:08:54.892163 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.892082 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 00:08:54.899138 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.899114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx"] Sep 10 00:08:54.916877 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.916842 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzgsg\" (UniqueName: \"kubernetes.io/projected/047af51f-c154-4858-9265-dc3c564842e1-kube-api-access-fzgsg\") pod \"047af51f-c154-4858-9265-dc3c564842e1\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " Sep 10 00:08:54.916877 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.916879 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-bundle\") pod \"047af51f-c154-4858-9265-dc3c564842e1\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " Sep 10 00:08:54.917116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.916904 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-util\") pod \"047af51f-c154-4858-9265-dc3c564842e1\" (UID: \"047af51f-c154-4858-9265-dc3c564842e1\") " Sep 10 00:08:54.917116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.917014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58f670e6-1aff-4d33-8139-fc6091b0d54a-cert\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:54.917116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.917040 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58f670e6-1aff-4d33-8139-fc6091b0d54a-metrics-cert\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:54.917116 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.917066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58f670e6-1aff-4d33-8139-fc6091b0d54a-manager-config\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:54.917306 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.917189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8dp\" (UniqueName: \"kubernetes.io/projected/58f670e6-1aff-4d33-8139-fc6091b0d54a-kube-api-access-js8dp\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:54.917775 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.917747 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-bundle" (OuterVolumeSpecName: "bundle") pod "047af51f-c154-4858-9265-dc3c564842e1" (UID: "047af51f-c154-4858-9265-dc3c564842e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:08:54.918947 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.918922 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047af51f-c154-4858-9265-dc3c564842e1-kube-api-access-fzgsg" (OuterVolumeSpecName: "kube-api-access-fzgsg") pod "047af51f-c154-4858-9265-dc3c564842e1" (UID: "047af51f-c154-4858-9265-dc3c564842e1"). InnerVolumeSpecName "kube-api-access-fzgsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:08:54.922912 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:54.922873 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-util" (OuterVolumeSpecName: "util") pod "047af51f-c154-4858-9265-dc3c564842e1" (UID: "047af51f-c154-4858-9265-dc3c564842e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:08:55.018523 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58f670e6-1aff-4d33-8139-fc6091b0d54a-cert\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.018523 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58f670e6-1aff-4d33-8139-fc6091b0d54a-metrics-cert\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.018764 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58f670e6-1aff-4d33-8139-fc6091b0d54a-manager-config\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.018764 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8dp\" (UniqueName: \"kubernetes.io/projected/58f670e6-1aff-4d33-8139-fc6091b0d54a-kube-api-access-js8dp\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.018871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018806 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzgsg\" (UniqueName: \"kubernetes.io/projected/047af51f-c154-4858-9265-dc3c564842e1-kube-api-access-fzgsg\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:08:55.018871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018823 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:08:55.018871 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.018837 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047af51f-c154-4858-9265-dc3c564842e1-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:08:55.019297 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.019280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58f670e6-1aff-4d33-8139-fc6091b0d54a-manager-config\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.020936 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.020914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58f670e6-1aff-4d33-8139-fc6091b0d54a-cert\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.021039 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.020974 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58f670e6-1aff-4d33-8139-fc6091b0d54a-metrics-cert\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.026805 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.026779 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8dp\" (UniqueName: \"kubernetes.io/projected/58f670e6-1aff-4d33-8139-fc6091b0d54a-kube-api-access-js8dp\") pod \"lws-controller-manager-d4c4f85fc-wv7gx\" (UID: \"58f670e6-1aff-4d33-8139-fc6091b0d54a\") " pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.199015 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.198972 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:55.468994 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.468962 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx"] Sep 10 00:08:55.471439 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:08:55.471408 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f670e6_1aff_4d33_8139_fc6091b0d54a.slice/crio-4f68cad91485100c21dc1e80204b2c07aade73879ad9366e5fb427c7acd5a524 WatchSource:0}: Error finding container 4f68cad91485100c21dc1e80204b2c07aade73879ad9366e5fb427c7acd5a524: Status 404 returned error can't find the container with id 4f68cad91485100c21dc1e80204b2c07aade73879ad9366e5fb427c7acd5a524 Sep 10 00:08:55.715865 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.715837 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" Sep 10 00:08:55.716064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.715838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afchlq2" event={"ID":"047af51f-c154-4858-9265-dc3c564842e1","Type":"ContainerDied","Data":"a7871fa3e0ed0b95dc19da44b646e21d9472e4da6b485a16a1929c116bad2b4b"} Sep 10 00:08:55.716064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.716031 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7871fa3e0ed0b95dc19da44b646e21d9472e4da6b485a16a1929c116bad2b4b" Sep 10 00:08:55.717161 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:55.717135 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" event={"ID":"58f670e6-1aff-4d33-8139-fc6091b0d54a","Type":"ContainerStarted","Data":"4f68cad91485100c21dc1e80204b2c07aade73879ad9366e5fb427c7acd5a524"} Sep 10 00:08:57.732425 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:57.732382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" event={"ID":"58f670e6-1aff-4d33-8139-fc6091b0d54a","Type":"ContainerStarted","Data":"c1b2bb78cc796a50996c93c7b7994e078fe8ee626943e8b0760061b52f1e5691"} Sep 10 00:08:57.732808 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:57.732485 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:08:57.747183 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:08:57.747135 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" podStartSLOduration=2.16281781 podStartE2EDuration="3.747117347s" totalImagesPullingTime="1.584299537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:57.74690555 +0000 UTC m=+522.400575650" watchObservedRunningTime="2026-09-10 00:08:57.747117347 +0000 UTC m=+522.400787446" Sep 10 00:09:02.854599 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.854553 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff"] Sep 10 00:09:02.857749 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.857724 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.861390 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.861364 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 00:09:02.861500 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.861374 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f56wf\"" Sep 10 00:09:02.861656 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.861639 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 00:09:02.862153 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.862136 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 00:09:02.862231 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.862216 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 00:09:02.872382 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.872358 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff"] Sep 10 00:09:02.888532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.888496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v57w\" (UniqueName: \"kubernetes.io/projected/50444932-1c67-4d93-b1fe-6dc910570489-kube-api-access-4v57w\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.888682 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.888541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50444932-1c67-4d93-b1fe-6dc910570489-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.888682 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.888574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50444932-1c67-4d93-b1fe-6dc910570489-manifests\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.888682 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.888605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50444932-1c67-4d93-b1fe-6dc910570489-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.888682 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.888632 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50444932-1c67-4d93-b1fe-6dc910570489-tmp\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.989338 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.989305 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v57w\" (UniqueName: \"kubernetes.io/projected/50444932-1c67-4d93-b1fe-6dc910570489-kube-api-access-4v57w\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.989474 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.989345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50444932-1c67-4d93-b1fe-6dc910570489-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.989474 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.989366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50444932-1c67-4d93-b1fe-6dc910570489-manifests\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.989474 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.989389 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50444932-1c67-4d93-b1fe-6dc910570489-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.989474 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.989408 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50444932-1c67-4d93-b1fe-6dc910570489-tmp\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.989832 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.989787 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50444932-1c67-4d93-b1fe-6dc910570489-manifests\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.991734 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.991707 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50444932-1c67-4d93-b1fe-6dc910570489-tmp\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.992044 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.992017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50444932-1c67-4d93-b1fe-6dc910570489-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:02.992288 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:02.992268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50444932-1c67-4d93-b1fe-6dc910570489-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:03.003968 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:03.003944 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v57w\" (UniqueName: \"kubernetes.io/projected/50444932-1c67-4d93-b1fe-6dc910570489-kube-api-access-4v57w\") pod \"opendatahub-operator-controller-manager-54f95565dd-54tff\" (UID: \"50444932-1c67-4d93-b1fe-6dc910570489\") " pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:03.168519 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:03.168440 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:03.445635 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:03.445580 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff"] Sep 10 00:09:03.447915 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:09:03.447890 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50444932_1c67_4d93_b1fe_6dc910570489.slice/crio-8472bcfaf5eb2a3c02462ed5616cbe9c4cb31fc3ec4bac2a53a374fe05d22d7e WatchSource:0}: Error finding container 8472bcfaf5eb2a3c02462ed5616cbe9c4cb31fc3ec4bac2a53a374fe05d22d7e: Status 404 returned error can't find the container with id 8472bcfaf5eb2a3c02462ed5616cbe9c4cb31fc3ec4bac2a53a374fe05d22d7e Sep 10 00:09:03.760314 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:03.760225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" event={"ID":"50444932-1c67-4d93-b1fe-6dc910570489","Type":"ContainerStarted","Data":"8472bcfaf5eb2a3c02462ed5616cbe9c4cb31fc3ec4bac2a53a374fe05d22d7e"} Sep 10 00:09:06.775891 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:06.775845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" event={"ID":"50444932-1c67-4d93-b1fe-6dc910570489","Type":"ContainerStarted","Data":"2deaae3b400baf54f0829aed3f6bd65c25fc411efa20fe00e3e51115611aabb2"} Sep 10 00:09:07.781830 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:07.781790 2568 generic.go:356] "Generic (PLEG): container finished" podID="50444932-1c67-4d93-b1fe-6dc910570489" containerID="2deaae3b400baf54f0829aed3f6bd65c25fc411efa20fe00e3e51115611aabb2" exitCode=0 Sep 10 00:09:07.782218 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:07.781857 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" event={"ID":"50444932-1c67-4d93-b1fe-6dc910570489","Type":"ContainerDied","Data":"2deaae3b400baf54f0829aed3f6bd65c25fc411efa20fe00e3e51115611aabb2"} Sep 10 00:09:08.738939 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:08.738906 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d4c4f85fc-wv7gx" Sep 10 00:09:08.790035 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:08.789997 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" event={"ID":"50444932-1c67-4d93-b1fe-6dc910570489","Type":"ContainerStarted","Data":"75deba4404bc2ddd3f0130a06a1f6612e99218f4ad0c07ad2631ec350b7a0457"} Sep 10 00:09:08.790527 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:08.790141 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:08.809300 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:08.809245 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" podStartSLOduration=2.228200309 podStartE2EDuration="6.809228052s" totalImagesPullingTime="3.546352512s" totalInitContainerRuntime="1.034675231s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:08.808243453 +0000 UTC m=+533.461913554" watchObservedRunningTime="2026-09-10 00:09:08.809228052 +0000 UTC m=+533.462898151" Sep 10 00:09:19.796725 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:19.796679 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54f95565dd-54tff" Sep 10 00:09:28.345105 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.345065 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj"] Sep 10 00:09:28.356938 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.356912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.361139 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.361060 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k4w8t\"" Sep 10 00:09:28.361784 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.361760 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 00:09:28.361913 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.361800 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 00:09:28.361913 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.361890 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 00:09:28.363918 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.363892 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj"] Sep 10 00:09:28.519186 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519151 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519343 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2rx\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-kube-api-access-rz2rx\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519343 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519343 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519343 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519477 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519420 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.519574 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.519477 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.587072 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.587034 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h"] Sep 10 00:09:28.589306 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.589284 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.601403 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.601377 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h"] Sep 10 00:09:28.620795 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.620766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.620943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.620800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.620943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.620837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.620943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.620874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.620943 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.620912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621183 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.620964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2rx\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-kube-api-access-rz2rx\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621183 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621009 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621183 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621346 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621346 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621224 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621504 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621365 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621504 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621451 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621668 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621651 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.621761 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.621743 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.623371 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.623350 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.623717 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.623690 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.629064 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.629037 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.629717 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.629695 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2rx\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-kube-api-access-rz2rx\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.669441 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.669410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:28.722710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ce9791-bc16-4387-9792-d26799730725-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.722710 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722702 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.722898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722761 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.722898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722792 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ce9791-bc16-4387-9792-d26799730725-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.722898 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.723061 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.723061 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.723061 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.722971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ce9791-bc16-4387-9792-d26799730725-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.723061 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.723019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpftj\" (UniqueName: \"kubernetes.io/projected/34ce9791-bc16-4387-9792-d26799730725-kube-api-access-tpftj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.823743 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpftj\" (UniqueName: \"kubernetes.io/projected/34ce9791-bc16-4387-9792-d26799730725-kube-api-access-tpftj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.823743 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ce9791-bc16-4387-9792-d26799730725-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ce9791-bc16-4387-9792-d26799730725-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.823937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ce9791-bc16-4387-9792-d26799730725-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824392 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.824274 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824392 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.824319 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824488 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.824436 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824629 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.824605 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.824785 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.824765 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ce9791-bc16-4387-9792-d26799730725-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.826366 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.826334 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ce9791-bc16-4387-9792-d26799730725-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.826518 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.826499 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ce9791-bc16-4387-9792-d26799730725-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.831352 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.831328 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ce9791-bc16-4387-9792-d26799730725-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.831352 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.831348 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpftj\" (UniqueName: \"kubernetes.io/projected/34ce9791-bc16-4387-9792-d26799730725-kube-api-access-tpftj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h\" (UID: \"34ce9791-bc16-4387-9792-d26799730725\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.900320 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.900239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:28.947055 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:28.946710 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj"] Sep 10 00:09:28.950452 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:09:28.949880 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ec2ad4_6e46_4712_bf68_0ada7bd7736c.slice/crio-724e828922be9e4e97ce84b0175b105e9c1eddeec74b7663007b80f2556420db WatchSource:0}: Error finding container 724e828922be9e4e97ce84b0175b105e9c1eddeec74b7663007b80f2556420db: Status 404 returned error can't find the container with id 724e828922be9e4e97ce84b0175b105e9c1eddeec74b7663007b80f2556420db Sep 10 00:09:29.172887 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:29.172859 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h"] Sep 10 00:09:29.174785 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:09:29.174745 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ce9791_bc16_4387_9792_d26799730725.slice/crio-bf86a8692f1c7d169e1b0465025195144a772ec331317426b42610e23e15510c WatchSource:0}: Error finding container bf86a8692f1c7d169e1b0465025195144a772ec331317426b42610e23e15510c: Status 404 returned error can't find the container with id bf86a8692f1c7d169e1b0465025195144a772ec331317426b42610e23e15510c Sep 10 00:09:29.897417 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:29.897335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" event={"ID":"18ec2ad4-6e46-4712-bf68-0ada7bd7736c","Type":"ContainerStarted","Data":"724e828922be9e4e97ce84b0175b105e9c1eddeec74b7663007b80f2556420db"} Sep 10 00:09:29.899640 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:29.899581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" event={"ID":"34ce9791-bc16-4387-9792-d26799730725","Type":"ContainerStarted","Data":"bf86a8692f1c7d169e1b0465025195144a772ec331317426b42610e23e15510c"} Sep 10 00:09:31.850367 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:31.850315 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:31.850717 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:31.850415 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:31.850717 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:31.850456 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:31.861395 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:31.861360 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:31.861490 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:31.861427 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:31.861490 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:31.861458 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:32.917809 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:32.917773 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" event={"ID":"18ec2ad4-6e46-4712-bf68-0ada7bd7736c","Type":"ContainerStarted","Data":"9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588"} Sep 10 00:09:32.919662 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:32.919635 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" event={"ID":"34ce9791-bc16-4387-9792-d26799730725","Type":"ContainerStarted","Data":"b8be3a3869e74d35f8baf6a0344dd0cfbb0525604cf9f8fe6fcfd4c6003749d2"} Sep 10 00:09:32.936332 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:32.936269 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" podStartSLOduration=2.02790898 podStartE2EDuration="4.936254016s" totalImagesPullingTime="2.908345036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:32.935360217 +0000 UTC m=+557.589030341" watchObservedRunningTime="2026-09-10 00:09:32.936254016 +0000 UTC m=+557.589924115" Sep 10 00:09:32.953882 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:32.953819 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" podStartSLOduration=2.280831016 podStartE2EDuration="4.953801498s" totalImagesPullingTime="2.672970482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:32.951487297 +0000 UTC m=+557.605157396" watchObservedRunningTime="2026-09-10 00:09:32.953801498 +0000 UTC m=+557.607471599" Sep 10 00:09:33.105473 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.105437 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p84w4"] Sep 10 00:09:33.108427 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.108406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.110931 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.110909 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 00:09:33.111026 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.110941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rdwfk\"" Sep 10 00:09:33.117080 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.117056 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p84w4"] Sep 10 00:09:33.268471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.268366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-cert\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.268471 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.268434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m868\" (UniqueName: \"kubernetes.io/projected/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-kube-api-access-2m868\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.369124 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.369074 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-cert\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.369301 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.369148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m868\" (UniqueName: \"kubernetes.io/projected/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-kube-api-access-2m868\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.369301 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:09:33.369255 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 00:09:33.369402 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:09:33.369327 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-cert podName:06aa36e5-3fc4-411b-bd14-5c01df8f2b8e nodeName:}" failed. No retries permitted until 2026-09-10 00:09:33.869306115 +0000 UTC m=+558.522976209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-cert") pod "odh-model-controller-7998c67dc4-p84w4" (UID: "06aa36e5-3fc4-411b-bd14-5c01df8f2b8e") : secret "odh-model-controller-webhook-cert" not found Sep 10 00:09:33.383680 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.383645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m868\" (UniqueName: \"kubernetes.io/projected/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-kube-api-access-2m868\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.670220 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.670178 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:33.672111 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.672070 2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 10 00:09:33.672250 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.672166 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 10 00:09:33.874009 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.873969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-cert\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.876435 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.876409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06aa36e5-3fc4-411b-bd14-5c01df8f2b8e-cert\") pod \"odh-model-controller-7998c67dc4-p84w4\" (UID: \"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e\") " pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:33.901498 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.901459 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:33.906304 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.906275 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:33.924804 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.924712 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:33.925929 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.925904 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h" Sep 10 00:09:33.971307 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:33.971269 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj"] Sep 10 00:09:34.019198 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:34.019150 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:34.294499 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:34.294464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p84w4"] Sep 10 00:09:34.300235 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:09:34.300189 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06aa36e5_3fc4_411b_bd14_5c01df8f2b8e.slice/crio-d6b6c45617d595f44a3b910375f1b9c9c523c79f9d0ddcf536c77dbe9edd900a WatchSource:0}: Error finding container d6b6c45617d595f44a3b910375f1b9c9c523c79f9d0ddcf536c77dbe9edd900a: Status 404 returned error can't find the container with id d6b6c45617d595f44a3b910375f1b9c9c523c79f9d0ddcf536c77dbe9edd900a Sep 10 00:09:34.670537 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:34.670445 2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 10 00:09:34.670692 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:34.670530 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 10 00:09:34.930382 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:34.930293 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" event={"ID":"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e","Type":"ContainerStarted","Data":"d6b6c45617d595f44a3b910375f1b9c9c523c79f9d0ddcf536c77dbe9edd900a"} Sep 10 00:09:35.670111 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:35.670060 2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 10 00:09:35.670286 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:35.670145 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 10 00:09:35.936111 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:35.935865 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" containerID="cri-o://9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588" gracePeriod=30 Sep 10 00:09:37.948915 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:37.948873 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" event={"ID":"06aa36e5-3fc4-411b-bd14-5c01df8f2b8e","Type":"ContainerStarted","Data":"3849b118026129c5435811509cf0cb35b6d48b1e9686b6a1d7849b26e7d89d45"} Sep 10 00:09:37.949373 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:37.948957 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:09:37.964389 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:37.964340 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" podStartSLOduration=1.9245194570000002 podStartE2EDuration="4.964323539s" totalImagesPullingTime="3.039804082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:37.963209309 +0000 UTC m=+562.616879410" watchObservedRunningTime="2026-09-10 00:09:37.964323539 +0000 UTC m=+562.617993639" Sep 10 00:09:40.238959 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.238921 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd"] Sep 10 00:09:40.241558 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.241534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.244204 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.244180 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 00:09:40.244340 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.244267 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sm9xw\"" Sep 10 00:09:40.244610 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.244585 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 00:09:40.244729 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.244647 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 00:09:40.253748 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.253715 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd"] Sep 10 00:09:40.329484 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.329484 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8972bdab-9496-407e-842e-66b326f19945-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.329699 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8972bdab-9496-407e-842e-66b326f19945-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.329699 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.329699 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w87k\" (UniqueName: \"kubernetes.io/projected/8972bdab-9496-407e-842e-66b326f19945-kube-api-access-8w87k\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.329824 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8972bdab-9496-407e-842e-66b326f19945-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.329824 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.329727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.430926 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.430892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w87k\" (UniqueName: \"kubernetes.io/projected/8972bdab-9496-407e-842e-66b326f19945-kube-api-access-8w87k\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431138 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.430936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8972bdab-9496-407e-842e-66b326f19945-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431138 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.430957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431279 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.431150 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431279 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.431216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8972bdab-9496-407e-842e-66b326f19945-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431387 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.431310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8972bdab-9496-407e-842e-66b326f19945-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431387 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.431347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.431740 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.431716 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8972bdab-9496-407e-842e-66b326f19945-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.433693 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.433667 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.433784 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.433747 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8972bdab-9496-407e-842e-66b326f19945-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.433828 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.433789 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.433866 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.433832 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8972bdab-9496-407e-842e-66b326f19945-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.444802 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.444780 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w87k\" (UniqueName: \"kubernetes.io/projected/8972bdab-9496-407e-842e-66b326f19945-kube-api-access-8w87k\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.444964 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.444943 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8972bdab-9496-407e-842e-66b326f19945-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zdqkd\" (UID: \"8972bdab-9496-407e-842e-66b326f19945\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.553062 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.553016 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:40.829177 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.829025 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd"] Sep 10 00:09:40.831385 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:09:40.831360 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8972bdab_9496_407e_842e_66b326f19945.slice/crio-1e95607715d7443f78340d549fe359f5f4f9831333c20d20ff1ae9832d3517a4 WatchSource:0}: Error finding container 1e95607715d7443f78340d549fe359f5f4f9831333c20d20ff1ae9832d3517a4: Status 404 returned error can't find the container with id 1e95607715d7443f78340d549fe359f5f4f9831333c20d20ff1ae9832d3517a4 Sep 10 00:09:40.964121 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:40.964077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" event={"ID":"8972bdab-9496-407e-842e-66b326f19945","Type":"ContainerStarted","Data":"1e95607715d7443f78340d549fe359f5f4f9831333c20d20ff1ae9832d3517a4"} Sep 10 00:09:41.169980 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.169952 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:41.236110 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236059 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-credential-socket\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236302 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236147 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-socket\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236302 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236181 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-token\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236302 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236202 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-data\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236302 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236231 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-envoy\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236302 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236270 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-certs\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236345 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-podinfo\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236379 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz2rx\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-kube-api-access-rz2rx\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236421 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istiod-ca-cert\") pod \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\" (UID: \"18ec2ad4-6e46-4712-bf68-0ada7bd7736c\") " Sep 10 00:09:41.236553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236419 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:09:41.236553 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236484 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-data" (OuterVolumeSpecName: "istio-data") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:09:41.236842 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236684 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:09:41.236842 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236746 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-data\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.236842 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236767 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-certs\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.236842 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236784 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-credential-socket\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.236842 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236803 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:09:41.237070 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.236847 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:09:41.238766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.238733 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-kube-api-access-rz2rx" (OuterVolumeSpecName: "kube-api-access-rz2rx") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "kube-api-access-rz2rx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:09:41.238766 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.238736 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 10 00:09:41.238944 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.238826 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:09:41.238944 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.238858 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-token" (OuterVolumeSpecName: "istio-token") pod "18ec2ad4-6e46-4712-bf68-0ada7bd7736c" (UID: "18ec2ad4-6e46-4712-bf68-0ada7bd7736c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:09:41.337456 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.337410 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-podinfo\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.337456 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.337447 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz2rx\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-kube-api-access-rz2rx\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.337456 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.337461 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istiod-ca-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.337918 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.337473 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-workload-socket\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.337918 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.337485 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-token\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.337918 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.337496 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ec2ad4-6e46-4712-bf68-0ada7bd7736c-istio-envoy\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Sep 10 00:09:41.971696 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.971652 2568 generic.go:356] "Generic (PLEG): container finished" podID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerID="9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588" exitCode=0 Sep 10 00:09:41.971892 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.971706 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" Sep 10 00:09:41.971892 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.971743 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" event={"ID":"18ec2ad4-6e46-4712-bf68-0ada7bd7736c","Type":"ContainerDied","Data":"9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588"} Sep 10 00:09:41.971892 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.971807 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj" event={"ID":"18ec2ad4-6e46-4712-bf68-0ada7bd7736c","Type":"ContainerDied","Data":"724e828922be9e4e97ce84b0175b105e9c1eddeec74b7663007b80f2556420db"} Sep 10 00:09:41.971892 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.971840 2568 scope.go:117] "RemoveContainer" containerID="9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588" Sep 10 00:09:41.982261 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.982235 2568 scope.go:117] "RemoveContainer" containerID="9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588" Sep 10 00:09:41.982598 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:09:41.982572 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588\": container with ID starting with 9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588 not found: ID does not exist" containerID="9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588" Sep 10 00:09:41.982707 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.982611 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588"} err="failed to get container status \"9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588\": rpc error: code = NotFound desc = could not find container \"9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588\": container with ID starting with 9ebcb951e0e395c66c653a717d2bad987445908c4674ba7ab6695e214b0c0588 not found: ID does not exist" Sep 10 00:09:41.993373 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:41.993344 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj"] Sep 10 00:09:42.000043 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:42.000013 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8w2sj"] Sep 10 00:09:43.409260 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:43.409226 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:43.409514 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:43.409295 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:09:43.850407 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:43.850022 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" path="/var/lib/kubelet/pods/18ec2ad4-6e46-4712-bf68-0ada7bd7736c/volumes" Sep 10 00:09:43.985702 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:43.985665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" event={"ID":"8972bdab-9496-407e-842e-66b326f19945","Type":"ContainerStarted","Data":"a8db900c04b4de50bda53e55e79f5081a406299ad9ba4f9c606dbabc9edf7d7c"} Sep 10 00:09:43.985846 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:43.985735 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:44.007145 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:44.007075 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" podStartSLOduration=1.4316758649999999 podStartE2EDuration="4.007056814s" totalImagesPullingTime="2.575380949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:44.005301117 +0000 UTC m=+568.658971218" watchObservedRunningTime="2026-09-10 00:09:44.007056814 +0000 UTC m=+568.660726913" Sep 10 00:09:44.991934 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:44.991900 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zdqkd" Sep 10 00:09:48.955907 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:09:48.955875 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-p84w4" Sep 10 00:12:11.976796 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.976716 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq"] Sep 10 00:12:11.977280 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.977049 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" Sep 10 00:12:11.977280 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.977061 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" Sep 10 00:12:11.977280 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.977157 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="18ec2ad4-6e46-4712-bf68-0ada7bd7736c" containerName="istio-proxy" Sep 10 00:12:11.979140 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.979122 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:11.981440 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.981404 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 00:12:11.981569 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.981449 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 00:12:11.982443 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.982420 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 00:12:11.982542 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.982426 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vqdnz\"" Sep 10 00:12:11.986024 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:11.985999 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq"] Sep 10 00:12:12.096268 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.096217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz5gw\" (UniqueName: \"kubernetes.io/projected/8c17b76e-3f91-4d8b-987b-9b1eca9c5e69-kube-api-access-sz5gw\") pod \"postgres-69fb4594cf-z6nlq\" (UID: \"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.096442 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.096357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8c17b76e-3f91-4d8b-987b-9b1eca9c5e69-data\") pod \"postgres-69fb4594cf-z6nlq\" (UID: \"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.197873 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.197828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8c17b76e-3f91-4d8b-987b-9b1eca9c5e69-data\") pod \"postgres-69fb4594cf-z6nlq\" (UID: \"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.198055 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.197984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz5gw\" (UniqueName: \"kubernetes.io/projected/8c17b76e-3f91-4d8b-987b-9b1eca9c5e69-kube-api-access-sz5gw\") pod \"postgres-69fb4594cf-z6nlq\" (UID: \"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.198243 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.198223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8c17b76e-3f91-4d8b-987b-9b1eca9c5e69-data\") pod \"postgres-69fb4594cf-z6nlq\" (UID: \"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.205637 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.205613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz5gw\" (UniqueName: \"kubernetes.io/projected/8c17b76e-3f91-4d8b-987b-9b1eca9c5e69-kube-api-access-sz5gw\") pod \"postgres-69fb4594cf-z6nlq\" (UID: \"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.291422 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.291388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:12.559171 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.559144 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq"] Sep 10 00:12:12.561942 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:12:12.561917 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c17b76e_3f91_4d8b_987b_9b1eca9c5e69.slice/crio-0c7f8809cf3453d6f77ab42ec278eff8afec412eeb4763b5ea276d1be75af9fd WatchSource:0}: Error finding container 0c7f8809cf3453d6f77ab42ec278eff8afec412eeb4763b5ea276d1be75af9fd: Status 404 returned error can't find the container with id 0c7f8809cf3453d6f77ab42ec278eff8afec412eeb4763b5ea276d1be75af9fd Sep 10 00:12:12.563344 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.563324 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:12:12.694196 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:12.694159 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" event={"ID":"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69","Type":"ContainerStarted","Data":"0c7f8809cf3453d6f77ab42ec278eff8afec412eeb4763b5ea276d1be75af9fd"} Sep 10 00:12:17.795935 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:17.795909 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 00:12:18.730702 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:18.730656 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" event={"ID":"8c17b76e-3f91-4d8b-987b-9b1eca9c5e69","Type":"ContainerStarted","Data":"26455307f7a3bead87378c94f96b546ca62b5e7a197f6ba240af8da18a31eb53"} Sep 10 00:12:18.730870 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:18.730778 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:12:18.747507 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:18.747440 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" podStartSLOduration=2.518030988 podStartE2EDuration="7.747419472s" totalImagesPullingTime="5.229388484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:12:18.745304324 +0000 UTC m=+723.398974424" watchObservedRunningTime="2026-09-10 00:12:18.747419472 +0000 UTC m=+723.401089572" Sep 10 00:12:24.764819 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:12:24.764789 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z6nlq" Sep 10 00:13:32.456436 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.456401 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn"] Sep 10 00:13:32.458858 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.458841 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.462368 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.462342 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 00:13:32.462368 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.462345 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6p9dv\"" Sep 10 00:13:32.462549 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.462489 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 00:13:32.462608 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.462576 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 00:13:32.468459 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.468435 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn"] Sep 10 00:13:32.603107 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.603063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.603275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.603160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.603275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.603208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d2b16e-b33b-48a3-af37-dc14cd525b4f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.603275 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.603256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.603381 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.603336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.603381 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.603366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftb5k\" (UniqueName: \"kubernetes.io/projected/70d2b16e-b33b-48a3-af37-dc14cd525b4f-kube-api-access-ftb5k\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704338 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d2b16e-b33b-48a3-af37-dc14cd525b4f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704443 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704532 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftb5k\" (UniqueName: \"kubernetes.io/projected/70d2b16e-b33b-48a3-af37-dc14cd525b4f-kube-api-access-ftb5k\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704798 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704773 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704859 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704808 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.704859 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.704838 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.706902 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.706848 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d2b16e-b33b-48a3-af37-dc14cd525b4f-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.707006 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.706990 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d2b16e-b33b-48a3-af37-dc14cd525b4f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.714602 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.714567 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftb5k\" (UniqueName: \"kubernetes.io/projected/70d2b16e-b33b-48a3-af37-dc14cd525b4f-kube-api-access-ftb5k\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7ktjn\" (UID: \"70d2b16e-b33b-48a3-af37-dc14cd525b4f\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:32.769583 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:32.769548 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:33.042665 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:33.042630 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn"] Sep 10 00:13:33.043309 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:13:33.043286 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d2b16e_b33b_48a3_af37_dc14cd525b4f.slice/crio-3e64c1d6533e7f6999361ae549527d5f6bfffef4cfff9d4968921c931528f2a1 WatchSource:0}: Error finding container 3e64c1d6533e7f6999361ae549527d5f6bfffef4cfff9d4968921c931528f2a1: Status 404 returned error can't find the container with id 3e64c1d6533e7f6999361ae549527d5f6bfffef4cfff9d4968921c931528f2a1 Sep 10 00:13:33.084807 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:33.084772 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerStarted","Data":"3e64c1d6533e7f6999361ae549527d5f6bfffef4cfff9d4968921c931528f2a1"} Sep 10 00:13:34.091755 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:34.091728 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerStarted","Data":"e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569"} Sep 10 00:13:34.092059 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:34.092040 2568 scope.go:117] "RemoveContainer" containerID="e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569" Sep 10 00:13:35.098079 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.098038 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569" exitCode=0 Sep 10 00:13:35.098079 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.098063 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046" exitCode=0 Sep 10 00:13:35.098584 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.098113 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569"} Sep 10 00:13:35.098584 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.098159 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046"} Sep 10 00:13:35.098584 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.098186 2568 scope.go:117] "RemoveContainer" containerID="e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569" Sep 10 00:13:35.098584 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.098392 2568 scope.go:117] "RemoveContainer" containerID="6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046" Sep 10 00:13:35.098723 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:13:35.098592 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:13:35.108013 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.107990 2568 scope.go:117] "RemoveContainer" containerID="e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569" Sep 10 00:13:35.108289 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:13:35.108272 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569\": container with ID starting with e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569 not found: ID does not exist" containerID="e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569" Sep 10 00:13:35.108344 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:35.108297 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569"} err="failed to get container status \"e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569\": rpc error: code = NotFound desc = could not find container \"e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569\": container with ID starting with e7a9f28a596f6c75d7a368b560a94ec005b2f0710c69ddf2db6b89d6bb528569 not found: ID does not exist" Sep 10 00:13:36.103890 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:36.103858 2568 scope.go:117] "RemoveContainer" containerID="6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046" Sep 10 00:13:36.104334 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:13:36.104033 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:13:42.770279 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:42.770238 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:42.770673 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:42.770300 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:42.770673 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:42.770316 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:42.770673 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:42.770329 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:13:42.770773 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:42.770704 2568 scope.go:117] "RemoveContainer" containerID="6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046" Sep 10 00:13:42.770884 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:13:42.770866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:13:52.355034 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.354996 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8"] Sep 10 00:13:52.357407 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.357379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.359786 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.359766 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 00:13:52.366387 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.366365 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8"] Sep 10 00:13:52.386355 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.386327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5b7h\" (UniqueName: \"kubernetes.io/projected/820eb472-9df7-4bae-b347-fc2d3d5a07dc-kube-api-access-g5b7h\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.386483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.386360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.386483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.386379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.386483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.386403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.386483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.386444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.386483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.386467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb472-9df7-4bae-b347-fc2d3d5a07dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487434 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb472-9df7-4bae-b347-fc2d3d5a07dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5b7h\" (UniqueName: \"kubernetes.io/projected/820eb472-9df7-4bae-b347-fc2d3d5a07dc-kube-api-access-g5b7h\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487633 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487887 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487839 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.487946 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.488004 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.487962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.489892 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.489868 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820eb472-9df7-4bae-b347-fc2d3d5a07dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.490023 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.490006 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb472-9df7-4bae-b347-fc2d3d5a07dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.495279 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.495256 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5b7h\" (UniqueName: \"kubernetes.io/projected/820eb472-9df7-4bae-b347-fc2d3d5a07dc-kube-api-access-g5b7h\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vtcj8\" (UID: \"820eb472-9df7-4bae-b347-fc2d3d5a07dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.668588 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.668494 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:13:52.935754 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:52.935729 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8"] Sep 10 00:13:52.937730 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:13:52.937697 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820eb472_9df7_4bae_b347_fc2d3d5a07dc.slice/crio-91329193bc690973af18fbcebe7c8e60ddaf178b3efafd1664dc97c11821edd9 WatchSource:0}: Error finding container 91329193bc690973af18fbcebe7c8e60ddaf178b3efafd1664dc97c11821edd9: Status 404 returned error can't find the container with id 91329193bc690973af18fbcebe7c8e60ddaf178b3efafd1664dc97c11821edd9 Sep 10 00:13:53.186242 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:53.186168 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" event={"ID":"820eb472-9df7-4bae-b347-fc2d3d5a07dc","Type":"ContainerStarted","Data":"249eba7c690b93d3303bca3290f1cc5abddf27f9bf392e2d64248539016f0190"} Sep 10 00:13:53.186242 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:53.186229 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" event={"ID":"820eb472-9df7-4bae-b347-fc2d3d5a07dc","Type":"ContainerStarted","Data":"91329193bc690973af18fbcebe7c8e60ddaf178b3efafd1664dc97c11821edd9"} Sep 10 00:13:53.201483 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:53.201431 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" podStartSLOduration=1.022261625 podStartE2EDuration="1.201414941s" totalImagesPullingTime="179.153316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:13:53.200682545 +0000 UTC m=+817.854352646" watchObservedRunningTime="2026-09-10 00:13:53.201414941 +0000 UTC m=+817.855085042" Sep 10 00:13:53.840945 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:53.840909 2568 scope.go:117] "RemoveContainer" containerID="6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046" Sep 10 00:13:54.192896 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:54.192864 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="edb1cb901392fdfbe6771e9814c84e8331c9f6996d7d4d5ee5844ef98e35c73f" exitCode=0 Sep 10 00:13:54.193050 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:54.192940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"edb1cb901392fdfbe6771e9814c84e8331c9f6996d7d4d5ee5844ef98e35c73f"} Sep 10 00:13:54.193050 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:54.193002 2568 scope.go:117] "RemoveContainer" containerID="6a609dc4dffda9f26941a366a2ff61dd965e4a666bff97910d400f8864c03046" Sep 10 00:13:54.193436 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:13:54.193411 2568 scope.go:117] "RemoveContainer" containerID="edb1cb901392fdfbe6771e9814c84e8331c9f6996d7d4d5ee5844ef98e35c73f" Sep 10 00:13:54.193627 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:13:54.193600 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:14:01.746754 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.746719 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w"] Sep 10 00:14:01.749948 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.749923 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.752552 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.752531 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 00:14:01.759484 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.759457 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w"] Sep 10 00:14:01.769812 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.769781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.769954 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.769835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.769954 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.769890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.769954 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.769942 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7b65\" (UniqueName: \"kubernetes.io/projected/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-kube-api-access-w7b65\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.770251 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.770028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.770251 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.770082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871368 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7b65\" (UniqueName: \"kubernetes.io/projected/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-kube-api-access-w7b65\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871559 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871630 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871552 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871680 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871680 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871778 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.871912 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871893 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.872012 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.871989 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.872236 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.872213 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.874235 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.874209 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.874758 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.874739 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:01.879312 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:01.879290 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7b65\" (UniqueName: \"kubernetes.io/projected/cb0b42f5-8f9a-49a6-a72b-a218ac2a546e-kube-api-access-w7b65\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w\" (UID: \"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:02.062731 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.062693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:02.333388 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.333361 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w"] Sep 10 00:14:02.335079 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:14:02.335050 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0b42f5_8f9a_49a6_a72b_a218ac2a546e.slice/crio-b2456aa6065966ec681c060a1531d300a1ab3580e0365a4b32136c43f132eb12 WatchSource:0}: Error finding container b2456aa6065966ec681c060a1531d300a1ab3580e0365a4b32136c43f132eb12: Status 404 returned error can't find the container with id b2456aa6065966ec681c060a1531d300a1ab3580e0365a4b32136c43f132eb12 Sep 10 00:14:02.668831 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.668749 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:14:02.668831 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.668811 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:14:02.680995 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.680964 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:14:02.770199 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.770162 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:02.770617 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.770223 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:02.770617 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.770240 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:02.770617 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.770255 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:02.770617 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:02.770616 2568 scope.go:117] "RemoveContainer" containerID="edb1cb901392fdfbe6771e9814c84e8331c9f6996d7d4d5ee5844ef98e35c73f" Sep 10 00:14:02.770804 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:14:02.770786 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:14:03.238899 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:03.238859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" event={"ID":"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e","Type":"ContainerStarted","Data":"6414b11a9e673cc53026813faef841b9376375c684c9d24b1bc321b647948b1c"} Sep 10 00:14:03.239234 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:03.238929 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" event={"ID":"cb0b42f5-8f9a-49a6-a72b-a218ac2a546e","Type":"ContainerStarted","Data":"b2456aa6065966ec681c060a1531d300a1ab3580e0365a4b32136c43f132eb12"} Sep 10 00:14:03.250060 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:03.250028 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vtcj8" Sep 10 00:14:03.257011 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:03.256957 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" podStartSLOduration=2.09018543 podStartE2EDuration="2.256943588s" totalImagesPullingTime="166.758158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:14:03.254677439 +0000 UTC m=+827.908347539" watchObservedRunningTime="2026-09-10 00:14:03.256943588 +0000 UTC m=+827.910613688" Sep 10 00:14:12.063655 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:12.063614 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:12.064057 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:12.063685 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:12.076139 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:12.076079 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:12.293213 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:12.293182 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w" Sep 10 00:14:14.841627 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:14.841591 2568 scope.go:117] "RemoveContainer" containerID="edb1cb901392fdfbe6771e9814c84e8331c9f6996d7d4d5ee5844ef98e35c73f" Sep 10 00:14:15.298380 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:15.298346 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" exitCode=0 Sep 10 00:14:15.298522 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:15.298388 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580"} Sep 10 00:14:15.298522 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:15.298457 2568 scope.go:117] "RemoveContainer" containerID="edb1cb901392fdfbe6771e9814c84e8331c9f6996d7d4d5ee5844ef98e35c73f" Sep 10 00:14:15.298876 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:15.298858 2568 scope.go:117] "RemoveContainer" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" Sep 10 00:14:15.299152 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:14:15.299124 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:14:22.770398 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:22.770360 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:22.770784 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:22.770425 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:22.770784 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:22.770442 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:22.770784 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:22.770455 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:14:22.770891 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:22.770810 2568 scope.go:117] "RemoveContainer" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" Sep 10 00:14:22.770993 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:14:22.770973 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:14:37.841653 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:37.841621 2568 scope.go:117] "RemoveContainer" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" Sep 10 00:14:37.842138 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:14:37.841771 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:14:48.841040 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:48.841004 2568 scope.go:117] "RemoveContainer" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" Sep 10 00:14:48.841418 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:14:48.841277 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:14:59.841701 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:14:59.841664 2568 scope.go:117] "RemoveContainer" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" Sep 10 00:15:00.133492 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.133458 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m"] Sep 10 00:15:00.136820 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.136802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" Sep 10 00:15:00.139167 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.139142 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g24qw\"" Sep 10 00:15:00.142667 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.142642 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m"] Sep 10 00:15:00.174956 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.174933 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" Sep 10 00:15:00.442776 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.442754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m"] Sep 10 00:15:00.444589 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:15:00.444561 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3102cadf_2d13_46f0_810f_283e09ef9e28.slice/crio-0824821dd142531002a5e38f8d05bba95556c394cc0cd0dfeb378f9883d72491 WatchSource:0}: Error finding container 0824821dd142531002a5e38f8d05bba95556c394cc0cd0dfeb378f9883d72491: Status 404 returned error can't find the container with id 0824821dd142531002a5e38f8d05bba95556c394cc0cd0dfeb378f9883d72491 Sep 10 00:15:00.523044 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.523008 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" event={"ID":"3102cadf-2d13-46f0-810f-283e09ef9e28","Type":"ContainerStarted","Data":"0824821dd142531002a5e38f8d05bba95556c394cc0cd0dfeb378f9883d72491"} Sep 10 00:15:00.524901 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.524875 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" exitCode=0 Sep 10 00:15:00.525018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.524950 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769"} Sep 10 00:15:00.525018 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.525007 2568 scope.go:117] "RemoveContainer" containerID="4d888cd07a3aa8feb0059de86e919c4e7fce8bd89ab158856cb89bd81fdac580" Sep 10 00:15:00.525399 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:00.525383 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:15:00.525591 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:15:00.525569 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:15:02.769714 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:02.769679 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:15:02.770210 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:02.769755 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:15:02.770210 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:02.769785 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:15:02.770210 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:02.769806 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:15:02.770383 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:02.770343 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:15:02.770584 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:15:02.770558 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:15:03.543351 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:03.543318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" event={"ID":"3102cadf-2d13-46f0-810f-283e09ef9e28","Type":"ContainerStarted","Data":"bce778d3cea4dfb16c0b5a436a635e6148b574da2da48b6710fd0e6c9311ed0c"} Sep 10 00:15:03.555763 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:03.555707 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" podStartSLOduration=1.057314983 podStartE2EDuration="3.555687946s" totalImagesPullingTime="2.498372963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:15:03.555208959 +0000 UTC m=+888.208879060" watchObservedRunningTime="2026-09-10 00:15:03.555687946 +0000 UTC m=+888.209358047" Sep 10 00:15:04.549726 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:04.549690 2568 generic.go:356] "Generic (PLEG): container finished" podID="3102cadf-2d13-46f0-810f-283e09ef9e28" containerID="bce778d3cea4dfb16c0b5a436a635e6148b574da2da48b6710fd0e6c9311ed0c" exitCode=0 Sep 10 00:15:04.550147 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:04.549778 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" event={"ID":"3102cadf-2d13-46f0-810f-283e09ef9e28","Type":"ContainerDied","Data":"bce778d3cea4dfb16c0b5a436a635e6148b574da2da48b6710fd0e6c9311ed0c"} Sep 10 00:15:05.687517 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:05.687488 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" Sep 10 00:15:06.561269 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:06.561237 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" Sep 10 00:15:06.561441 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:06.561242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-rdx5m" event={"ID":"3102cadf-2d13-46f0-810f-283e09ef9e28","Type":"ContainerDied","Data":"0824821dd142531002a5e38f8d05bba95556c394cc0cd0dfeb378f9883d72491"} Sep 10 00:15:06.561441 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:06.561360 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0824821dd142531002a5e38f8d05bba95556c394cc0cd0dfeb378f9883d72491" Sep 10 00:15:15.843598 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:15.843515 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:15:15.844223 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:15:15.843683 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:15:26.840955 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:26.840921 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:15:26.841423 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:15:26.841125 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:15:40.841374 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:40.841345 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:15:40.841826 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:15:40.841524 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:15:55.844652 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:15:55.844622 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:15:55.845173 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:15:55.844809 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:16:07.841724 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:07.841691 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:16:07.842207 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:16:07.841886 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:16:21.841111 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:21.841064 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:16:22.927473 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:22.927440 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" exitCode=0 Sep 10 00:16:22.927870 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:22.927486 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8"} Sep 10 00:16:22.927870 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:22.927533 2568 scope.go:117] "RemoveContainer" containerID="184e7d2be53c020bac37af5225b2b669af407eac2aa9edce5af25540d9734769" Sep 10 00:16:22.927977 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:22.927910 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:16:22.928155 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:16:22.928129 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:16:32.770564 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:32.770532 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:16:32.770971 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:32.770616 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:16:32.770971 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:32.770664 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:16:32.770971 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:32.770680 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" Sep 10 00:16:32.771073 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:32.771042 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:16:32.771264 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:16:32.771245 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:16:32.977385 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:32.977358 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:16:32.977557 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:16:32.977537 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:16:46.841240 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:46.841205 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:16:46.841672 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:16:46.841407 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:16:58.840661 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:16:58.840629 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:16:58.841122 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:16:58.840816 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:17:09.840966 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:17:09.840935 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:17:09.841455 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:17:09.841128 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:17:24.841117 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:17:24.841066 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:17:24.841576 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:17:24.841277 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:17:37.841450 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:17:37.841411 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:17:37.841837 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:17:37.841661 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:17:51.841243 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:17:51.841208 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:17:51.841662 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:17:51.841412 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:18:03.841539 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:03.841505 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:18:03.842109 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:18:03.841735 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:18:16.841313 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:16.841226 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:18:16.841933 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:18:16.841398 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:18:30.841346 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:30.841315 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:18:30.841829 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:18:30.841486 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:18:30.964570 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:30.964537 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p84w4_06aa36e5-3fc4-411b-bd14-5c01df8f2b8e/manager/0.log" Sep 10 00:18:31.076008 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:31.075978 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f95565dd-54tff_50444932-1c67-4d93-b1fe-6dc910570489/copy-manifests/0.log" Sep 10 00:18:31.095445 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:31.095364 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f95565dd-54tff_50444932-1c67-4d93-b1fe-6dc910570489/manager/0.log" Sep 10 00:18:31.814199 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:31.814167 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816655-rdx5m_3102cadf-2d13-46f0-810f-283e09ef9e28/cleanup/0.log" Sep 10 00:18:31.923556 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:31.923525 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-z6nlq_8c17b76e-3f91-4d8b-987b-9b1eca9c5e69/postgres/0.log" Sep 10 00:18:33.822227 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:33.822193 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h_34ce9791-bc16-4387-9792-d26799730725/istio-proxy/0.log" Sep 10 00:18:33.942241 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:33.942207 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zdqkd_8972bdab-9496-407e-842e-66b326f19945/discovery/0.log" Sep 10 00:18:35.005989 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:35.005945 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-7ktjn_70d2b16e-b33b-48a3-af37-dc14cd525b4f/main/5.log" Sep 10 00:18:35.363899 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:35.363855 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vtcj8_820eb472-9df7-4bae-b347-fc2d3d5a07dc/main/0.log" Sep 10 00:18:35.480297 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:35.480241 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpfj4w_cb0b42f5-8f9a-49a6-a72b-a218ac2a546e/main/0.log" Sep 10 00:18:43.847154 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:43.847126 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:18:43.847626 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:18:43.847308 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:18:44.734288 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:44.734254 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lgw5s_6189b315-17ce-45d6-9e93-6a7c3c0a2fdc/global-pull-secret-syncer/0.log" Sep 10 00:18:44.810938 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:44.810903 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r6z7n_eea4d69e-4262-4ada-883d-414366774ac0/konnectivity-agent/0.log" Sep 10 00:18:44.872167 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:44.872111 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-253.ec2.internal_e526b43fd5ad3b0e4f031d75eb1c3ee9/haproxy/0.log" Sep 10 00:18:50.845462 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.845426 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/alertmanager/0.log" Sep 10 00:18:50.865862 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.865821 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/config-reloader/0.log" Sep 10 00:18:50.888527 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.888493 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/kube-rbac-proxy-web/0.log" Sep 10 00:18:50.915785 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.915746 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/kube-rbac-proxy/0.log" Sep 10 00:18:50.949272 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.949235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/kube-rbac-proxy-metric/0.log" Sep 10 00:18:50.972193 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.972161 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/prom-label-proxy/0.log" Sep 10 00:18:50.997185 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:50.997157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24760597-7842-42fd-8de5-ae2df2197a21/init-config-reloader/0.log" Sep 10 00:18:51.150859 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.150772 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-6gkdp_0449672c-c5d1-4818-8aaf-b06ff18ab283/monitoring-plugin/0.log" Sep 10 00:18:51.178888 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.178860 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf46l_2dd0e1b4-82c5-421f-937b-109b1c576a21/node-exporter/0.log" Sep 10 00:18:51.197747 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.197715 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf46l_2dd0e1b4-82c5-421f-937b-109b1c576a21/kube-rbac-proxy/0.log" Sep 10 00:18:51.216603 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.216578 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf46l_2dd0e1b4-82c5-421f-937b-109b1c576a21/init-textfile/0.log" Sep 10 00:18:51.782725 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.782691 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7649779665-llc5w_76e21c65-e07a-42d9-9ad0-073e06afed7f/telemeter-client/0.log" Sep 10 00:18:51.805452 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.805422 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7649779665-llc5w_76e21c65-e07a-42d9-9ad0-073e06afed7f/reload/0.log" Sep 10 00:18:51.836195 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:51.836165 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7649779665-llc5w_76e21c65-e07a-42d9-9ad0-073e06afed7f/kube-rbac-proxy/0.log" Sep 10 00:18:54.841512 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:54.841479 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:18:54.841900 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:18:54.841667 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:18:55.142276 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.142190 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw"] Sep 10 00:18:55.142606 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.142593 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3102cadf-2d13-46f0-810f-283e09ef9e28" containerName="cleanup" Sep 10 00:18:55.142651 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.142608 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3102cadf-2d13-46f0-810f-283e09ef9e28" containerName="cleanup" Sep 10 00:18:55.142686 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.142679 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3102cadf-2d13-46f0-810f-283e09ef9e28" containerName="cleanup" Sep 10 00:18:55.145698 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.145681 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.148367 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.148338 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6tqvv\"/\"openshift-service-ca.crt\"" Sep 10 00:18:55.148515 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.148380 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6tqvv\"/\"kube-root-ca.crt\"" Sep 10 00:18:55.148565 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.148523 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6tqvv\"/\"default-dockercfg-wqq9k\"" Sep 10 00:18:55.153772 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.153744 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw"] Sep 10 00:18:55.264469 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.264423 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-sys\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.264469 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.264470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-lib-modules\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.264713 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.264523 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-proc\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.264713 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.264553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4hg\" (UniqueName: \"kubernetes.io/projected/a619b73b-03f8-4664-83dd-77d75855ff0c-kube-api-access-zg4hg\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.264713 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.264676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-podres\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.350802 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.350770 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-dz4bf_b436bb12-1e3b-4d4a-9cb5-d43f167799e2/volume-data-source-validator/0.log" Sep 10 00:18:55.365758 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-sys\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-lib-modules\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-proc\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4hg\" (UniqueName: \"kubernetes.io/projected/a619b73b-03f8-4664-83dd-77d75855ff0c-kube-api-access-zg4hg\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-sys\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365880 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-proc\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-podres\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.365958 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.365938 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-lib-modules\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.366243 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.366006 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a619b73b-03f8-4664-83dd-77d75855ff0c-podres\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.373325 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.373305 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4hg\" (UniqueName: \"kubernetes.io/projected/a619b73b-03f8-4664-83dd-77d75855ff0c-kube-api-access-zg4hg\") pod \"perf-node-gather-daemonset-nffsw\" (UID: \"a619b73b-03f8-4664-83dd-77d75855ff0c\") " pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.457494 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.457412 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:55.727835 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:55.727810 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw"] Sep 10 00:18:55.730218 ip-10-0-130-253 kubenswrapper[2568]: W0910 00:18:55.730191 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda619b73b_03f8_4664_83dd_77d75855ff0c.slice/crio-ab5c42544e0ee52ecbabd7b71c242048a2db4991e05bfa65ec7e80a398084b4e WatchSource:0}: Error finding container ab5c42544e0ee52ecbabd7b71c242048a2db4991e05bfa65ec7e80a398084b4e: Status 404 returned error can't find the container with id ab5c42544e0ee52ecbabd7b71c242048a2db4991e05bfa65ec7e80a398084b4e Sep 10 00:18:56.578992 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.578962 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xsn67_952debcd-1153-4dc7-92b5-bc974b35aeeb/dns/0.log" Sep 10 00:18:56.597735 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.597703 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xsn67_952debcd-1153-4dc7-92b5-bc974b35aeeb/kube-rbac-proxy/0.log" Sep 10 00:18:56.618411 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.618370 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4klxw_4c51a859-b066-4e25-93f1-101b4ab1bae3/dns-node-resolver/0.log" Sep 10 00:18:56.677694 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.677658 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" event={"ID":"a619b73b-03f8-4664-83dd-77d75855ff0c","Type":"ContainerStarted","Data":"595e10b7a4a86749cfcbca8b37069b301498332cf17fce55c0f2c95c93184964"} Sep 10 00:18:56.677883 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.677720 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" event={"ID":"a619b73b-03f8-4664-83dd-77d75855ff0c","Type":"ContainerStarted","Data":"ab5c42544e0ee52ecbabd7b71c242048a2db4991e05bfa65ec7e80a398084b4e"} Sep 10 00:18:56.677883 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.677748 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:18:56.694555 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:56.694478 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" podStartSLOduration=1.694461475 podStartE2EDuration="1.694461475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:18:56.693346975 +0000 UTC m=+1121.347017074" watchObservedRunningTime="2026-09-10 00:18:56.694461475 +0000 UTC m=+1121.348131574" Sep 10 00:18:57.177236 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:57.177203 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-567876d654-d9mjz_ae75a3ed-8aa6-4f9c-a42e-fd6d729f568c/registry/0.log" Sep 10 00:18:57.237470 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:57.237434 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qv2wk_711e44ff-c988-4cda-8ebe-a352a005b596/node-ca/0.log" Sep 10 00:18:58.123717 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:58.123681 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h_34ce9791-bc16-4387-9792-d26799730725/istio-proxy/0.log" Sep 10 00:18:58.184716 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:58.184678 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zdqkd_8972bdab-9496-407e-842e-66b326f19945/discovery/0.log" Sep 10 00:18:58.960025 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:58.959991 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qbc9z_ada8f14a-4200-4ffd-b094-943cd129508d/serve-healthcheck-canary/0.log" Sep 10 00:18:59.418056 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:59.418018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-dn6bq_736b1280-4c54-4d76-9f69-4dac33548977/insights-operator/0.log" Sep 10 00:18:59.418524 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:59.418209 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-dn6bq_736b1280-4c54-4d76-9f69-4dac33548977/insights-operator/1.log" Sep 10 00:18:59.505188 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:59.505152 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvqq2_504dbf17-ea7f-4062-a443-dcfdcef8d252/kube-rbac-proxy/0.log" Sep 10 00:18:59.524080 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:59.524049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvqq2_504dbf17-ea7f-4062-a443-dcfdcef8d252/exporter/0.log" Sep 10 00:18:59.545058 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:18:59.545028 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvqq2_504dbf17-ea7f-4062-a443-dcfdcef8d252/extractor/0.log" Sep 10 00:19:01.763834 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:01.763798 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p84w4_06aa36e5-3fc4-411b-bd14-5c01df8f2b8e/manager/0.log" Sep 10 00:19:01.825262 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:01.825226 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f95565dd-54tff_50444932-1c67-4d93-b1fe-6dc910570489/manager/0.log" Sep 10 00:19:01.840419 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:01.840388 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f95565dd-54tff_50444932-1c67-4d93-b1fe-6dc910570489/copy-manifests/0.log" Sep 10 00:19:02.692563 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:02.692533 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6tqvv/perf-node-gather-daemonset-nffsw" Sep 10 00:19:03.041412 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:03.041381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d4c4f85fc-wv7gx_58f670e6-1aff-4d33-8139-fc6091b0d54a/manager/0.log" Sep 10 00:19:03.065859 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:03.065821 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dzwlc_7163626d-e8a4-415b-9e64-2ee370059f26/openshift-lws-operator/0.log" Sep 10 00:19:04.958701 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:04.958670 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h_34ce9791-bc16-4387-9792-d26799730725/istio-proxy/0.log" Sep 10 00:19:05.038352 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:05.038314 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zdqkd_8972bdab-9496-407e-842e-66b326f19945/discovery/0.log" Sep 10 00:19:06.230767 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:06.230730 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wgp2h_34ce9791-bc16-4387-9792-d26799730725/istio-proxy/0.log" Sep 10 00:19:06.287110 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:06.287069 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zdqkd_8972bdab-9496-407e-842e-66b326f19945/discovery/0.log" Sep 10 00:19:08.293989 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:08.293951 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-6gbv4_f42a84c2-2a2e-48c9-a03c-801906ff7548/migrator/0.log" Sep 10 00:19:08.325552 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:08.325516 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-6gbv4_f42a84c2-2a2e-48c9-a03c-801906ff7548/graceful-termination/0.log" Sep 10 00:19:08.691869 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:08.691773 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4vp4g_abd8a604-61bf-4da9-b478-468d75170467/kube-storage-version-migrator-operator/1.log" Sep 10 00:19:08.693388 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:08.693357 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4vp4g_abd8a604-61bf-4da9-b478-468d75170467/kube-storage-version-migrator-operator/0.log" Sep 10 00:19:09.714201 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:09.714162 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6j8tv_497d9d9c-412d-4ca9-9fa5-6d2fe9963189/kube-multus/0.log" Sep 10 00:19:09.841547 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:09.841513 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:19:09.841813 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:09.841800 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:19:10.023400 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.023321 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/kube-multus-additional-cni-plugins/0.log" Sep 10 00:19:10.042781 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.042746 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/egress-router-binary-copy/0.log" Sep 10 00:19:10.062162 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.062123 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/cni-plugins/0.log" Sep 10 00:19:10.081196 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.081167 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/bond-cni-plugin/0.log" Sep 10 00:19:10.099653 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.099622 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/routeoverride-cni/0.log" Sep 10 00:19:10.120495 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.120465 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/whereabouts-cni-bincopy/0.log" Sep 10 00:19:10.143133 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.143107 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqj6h_6c48cabe-0dbf-44e8-9bf7-8121f2e586fa/whereabouts-cni/0.log" Sep 10 00:19:10.360371 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.360317 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wm5p2_e95b0252-566a-4352-b9d1-afcabb4c5e56/network-metrics-daemon/0.log" Sep 10 00:19:10.377580 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.377549 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wm5p2_e95b0252-566a-4352-b9d1-afcabb4c5e56/kube-rbac-proxy/0.log" Sep 10 00:19:10.753052 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.752967 2568 generic.go:356] "Generic (PLEG): container finished" podID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" containerID="ab2f1e8ee93e58b15e2a769537e6348aa3820aa76aa8c5e739d7d96bd3f5451b" exitCode=0 Sep 10 00:19:10.753508 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.753044 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" event={"ID":"70d2b16e-b33b-48a3-af37-dc14cd525b4f","Type":"ContainerDied","Data":"ab2f1e8ee93e58b15e2a769537e6348aa3820aa76aa8c5e739d7d96bd3f5451b"} Sep 10 00:19:10.753508 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.753137 2568 scope.go:117] "RemoveContainer" containerID="c5ffc59a0ee943d17d88cbcf3adfe9545728159d6ba51696cbfd46bc0c6e8ff8" Sep 10 00:19:10.753508 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:10.753503 2568 scope.go:117] "RemoveContainer" containerID="ab2f1e8ee93e58b15e2a769537e6348aa3820aa76aa8c5e739d7d96bd3f5451b" Sep 10 00:19:10.753723 ip-10-0-130-253 kubenswrapper[2568]: E0910 00:19:10.753700 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7ktjn_llm(70d2b16e-b33b-48a3-af37-dc14cd525b4f)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7ktjn" podUID="70d2b16e-b33b-48a3-af37-dc14cd525b4f" Sep 10 00:19:11.163681 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.163647 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/ovn-controller/0.log" Sep 10 00:19:11.179579 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.179547 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/ovn-acl-logging/0.log" Sep 10 00:19:11.210639 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.210604 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/kube-rbac-proxy-node/0.log" Sep 10 00:19:11.235525 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.235497 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 00:19:11.250962 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.250920 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/northd/0.log" Sep 10 00:19:11.269356 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.269327 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/nbdb/0.log" Sep 10 00:19:11.287803 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.287767 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/sbdb/0.log" Sep 10 00:19:11.342003 ip-10-0-130-253 kubenswrapper[2568]: I0910 00:19:11.341967 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k5x7_3c666a1b-ae08-4cfa-8356-6b7f175f4bbf/ovnkube-controller/0.log"