Sep 18 04:04:33.072881 ip-10-0-132-223 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 04:04:33.072892 ip-10-0-132-223 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 04:04:33.072899 ip-10-0-132-223 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 04:04:33.073044 ip-10-0-132-223 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 04:04:43.289721 ip-10-0-132-223 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 04:04:43.289735 ip-10-0-132-223 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aa456766390a40569dc46b528ade8470 -- Sep 18 04:06:49.703407 ip-10-0-132-223 systemd[1]: Starting Kubernetes Kubelet... Sep 18 04:06:53.109270 ip-10-0-132-223 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:06:53.109270 ip-10-0-132-223 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 04:06:53.109270 ip-10-0-132-223 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:06:53.109270 ip-10-0-132-223 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 04:06:53.109270 ip-10-0-132-223 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:06:53.110106 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.109361 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 04:06:53.113228 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113212 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:06:53.113228 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113227 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113231 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113235 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113238 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113241 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113245 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113248 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113251 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113254 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113261 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113264 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113267 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113269 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113272 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113275 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113278 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113280 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113283 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113285 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113288 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:06:53.113291 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113291 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113294 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113297 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113300 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113303 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113306 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113308 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113311 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113314 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113317 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113319 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113322 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113324 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113328 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113333 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113337 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113342 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113345 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113348 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:06:53.113766 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113351 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113353 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113356 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113359 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113361 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113364 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113366 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113369 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113371 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113374 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113376 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113379 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113381 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113384 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113386 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113390 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113393 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113396 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113400 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113402 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:06:53.114245 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113405 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113408 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113410 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113413 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113416 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113418 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113421 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113423 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113426 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113429 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113431 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113434 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113437 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113440 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113442 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113445 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113447 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113450 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113452 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113455 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:06:53.115236 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113457 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113461 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113464 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113466 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113469 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113471 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113474 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113478 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113482 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113485 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113488 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113491 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113493 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113496 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113499 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113502 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113504 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113507 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.113510 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:06:53.115732 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114295 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114303 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114306 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114309 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114312 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114319 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114322 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114325 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114328 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114331 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114333 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114337 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114339 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114342 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114345 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114348 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114351 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114354 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114356 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114359 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:06:53.116257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114362 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114365 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114368 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114371 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114374 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114376 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114379 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114381 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114384 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114387 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114390 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114393 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114396 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114398 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114401 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114404 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114407 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114409 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114417 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:06:53.116794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114420 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114423 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114426 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114428 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114431 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114433 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114436 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114439 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114442 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114444 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114447 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114450 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114452 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114455 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114458 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114460 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114463 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114465 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114468 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114470 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:06:53.117269 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114474 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114477 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114479 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114482 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114485 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114487 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114490 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114493 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114496 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114498 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114501 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114504 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114512 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114515 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114518 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114521 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114524 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114526 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114529 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114532 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:06:53.117754 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114534 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114540 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114544 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114549 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114553 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114556 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114558 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114561 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114564 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114566 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114570 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114574 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114577 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114580 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114583 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114586 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114589 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114592 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114595 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:06:53.118239 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.114598 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115028 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115036 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115040 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115043 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115052 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115055 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115057 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115060 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115063 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115066 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115068 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115071 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115074 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115077 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115080 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115082 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115085 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115087 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115090 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:06:53.118709 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115093 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115095 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115098 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115101 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115104 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115106 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115109 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115112 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115115 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115117 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115135 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115141 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115146 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115151 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115155 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115158 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115162 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115165 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115174 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:06:53.119208 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115177 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115180 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115183 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115186 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115188 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115191 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115194 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115196 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115199 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115202 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115204 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115207 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115211 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115215 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115218 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115221 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115223 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115226 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115228 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:06:53.119670 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115231 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115234 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115237 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115239 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115242 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115245 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115248 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115251 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115255 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115258 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115260 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115263 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115266 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115273 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115277 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115280 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115282 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115285 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115287 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115290 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:06:53.120162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115293 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115295 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115299 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115301 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115304 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115307 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115309 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115312 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115314 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115317 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115320 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115322 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115325 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115327 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115331 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115333 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115337 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115341 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115343 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115347 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:06:53.120653 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115353 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.115356 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115423 2560 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115457 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115463 2560 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115470 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115481 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115484 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115488 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115492 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115495 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115499 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115502 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115505 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115509 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115511 2560 flags.go:64] FLAG: --cgroup-root="" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115514 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115517 2560 flags.go:64] FLAG: --client-ca-file="" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115520 2560 flags.go:64] FLAG: --cloud-provider="external" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115523 2560 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115530 2560 flags.go:64] FLAG: --cluster-domain="" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115533 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115539 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115543 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 04:06:53.121162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115546 2560 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115550 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115555 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115558 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115561 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115564 2560 flags.go:64] FLAG: --contention-profiling="false" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115567 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115570 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115575 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115578 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115582 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115585 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115587 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115594 2560 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115597 2560 flags.go:64] FLAG: --enable-server="true" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115606 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115613 2560 flags.go:64] FLAG: --event-burst="100" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115616 2560 flags.go:64] FLAG: --event-qps="50" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115619 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115622 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115625 2560 flags.go:64] FLAG: --eviction-hard="" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115629 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115632 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115635 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115638 2560 flags.go:64] FLAG: --eviction-soft="" Sep 18 04:06:53.121761 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115641 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115644 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115647 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115650 2560 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115652 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115655 2560 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115658 2560 flags.go:64] FLAG: --feature-gates="" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115662 2560 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115665 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115669 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115673 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115676 2560 flags.go:64] FLAG: --healthz-port="10248" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115679 2560 flags.go:64] FLAG: --help="false" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115682 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115685 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115689 2560 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115692 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115695 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115699 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115702 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115704 2560 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115707 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115710 2560 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 04:06:53.122367 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115718 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115722 2560 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115725 2560 flags.go:64] FLAG: --kube-reserved="" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115728 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115730 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115734 2560 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115736 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115740 2560 flags.go:64] FLAG: --lock-file="" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115742 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115746 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115749 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115755 2560 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115758 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115760 2560 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115763 2560 flags.go:64] FLAG: --logging-format="text" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115766 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115769 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115772 2560 flags.go:64] FLAG: --manifest-url="" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115776 2560 flags.go:64] FLAG: --manifest-url-header="" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115780 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115783 2560 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115787 2560 flags.go:64] FLAG: --max-pods="110" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115790 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115793 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115797 2560 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 04:06:53.122982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115800 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115803 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115806 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115809 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115816 2560 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115819 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115823 2560 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115826 2560 flags.go:64] FLAG: --pod-cidr="" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115836 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115842 2560 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115845 2560 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115848 2560 flags.go:64] FLAG: --pods-per-core="0" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115852 2560 flags.go:64] FLAG: --port="10250" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115855 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115857 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e3b1e506a65927e3" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115861 2560 flags.go:64] FLAG: --qos-reserved="" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115863 2560 flags.go:64] FLAG: --read-only-port="10255" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115867 2560 flags.go:64] FLAG: --register-node="true" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115870 2560 flags.go:64] FLAG: --register-with-taints="" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115873 2560 flags.go:64] FLAG: --registry-burst="10" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115876 2560 flags.go:64] FLAG: --registry-qps="5" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115879 2560 flags.go:64] FLAG: --reserved-cpus="" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115882 2560 flags.go:64] FLAG: --reserved-memory="" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115885 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115889 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 04:06:53.123601 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115895 2560 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115898 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115901 2560 flags.go:64] FLAG: --runonce="false" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115904 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115907 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115910 2560 flags.go:64] FLAG: --seccomp-default="false" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115913 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115918 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115921 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115924 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115927 2560 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115930 2560 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115933 2560 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115936 2560 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115939 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115942 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115946 2560 flags.go:64] FLAG: --system-cgroups="" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115949 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115954 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115957 2560 flags.go:64] FLAG: --tls-cert-file="" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115960 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115965 2560 flags.go:64] FLAG: --tls-min-version="" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115967 2560 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115970 2560 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115973 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 04:06:53.124229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115976 2560 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115979 2560 flags.go:64] FLAG: --v="2" Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115983 2560 flags.go:64] FLAG: --version="false" Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115987 2560 flags.go:64] FLAG: --vmodule="" Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115991 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.115994 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116111 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116116 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116120 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116138 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116141 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116144 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116147 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116150 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116154 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116164 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116167 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116169 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116172 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116175 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116178 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:06:53.124843 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116181 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116183 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116186 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116189 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116192 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116195 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116197 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116200 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116203 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116205 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116208 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116211 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116213 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116217 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116221 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116224 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116227 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116230 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116234 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:06:53.125424 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116236 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116239 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116242 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116244 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116247 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116250 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116254 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116257 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116260 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116263 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116266 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116269 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116272 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116274 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116277 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116280 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116282 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116288 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116291 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116294 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:06:53.125886 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116297 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116300 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116305 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116308 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116310 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116313 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116316 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116318 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116321 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116324 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116326 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116330 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116333 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116336 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116339 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116341 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116344 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116347 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116350 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:06:53.126390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116353 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116355 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116358 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116361 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116364 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116367 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116369 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116372 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116375 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116377 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116380 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116383 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116386 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116389 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116391 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116394 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116398 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116401 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116404 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:06:53.126875 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116406 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116409 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116412 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116414 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116417 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116421 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.116423 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.116958 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.123923 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.123938 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.123962 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.123967 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124021 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124026 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124030 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:06:53.127390 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124033 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124036 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124038 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124041 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124044 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124047 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124050 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124052 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124055 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124058 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124060 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124063 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124066 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124068 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124071 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124074 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124076 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124079 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124082 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124085 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:06:53.127794 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124088 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124091 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124093 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124096 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124099 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124101 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124105 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124108 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124111 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124114 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124117 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124120 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124139 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124143 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124146 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124149 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124152 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124155 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124157 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124160 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:06:53.128343 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124163 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124166 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124169 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124172 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124175 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124178 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124181 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124183 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124186 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124189 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124192 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124194 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124197 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124200 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124203 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124205 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124208 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124211 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124214 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124217 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:06:53.129150 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124220 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124223 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124225 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124228 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124231 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124234 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124238 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124242 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124245 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124248 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124251 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124254 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124257 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124261 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124264 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124269 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124272 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124275 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:06:53.129820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124278 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124281 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124284 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124287 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124290 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124293 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124295 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124298 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124301 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124304 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124306 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124309 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124312 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124314 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124317 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124320 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124323 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:06:53.130345 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124326 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.124331 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124439 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124443 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124446 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124449 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124453 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124458 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124460 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124463 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124466 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124469 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124472 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124475 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:06:53.130774 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124478 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124480 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124483 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124485 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124488 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124491 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124493 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124496 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124499 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124502 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124505 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124507 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124510 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124513 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124515 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124518 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124521 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124524 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124527 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124530 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:06:53.131207 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124532 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124535 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124539 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124543 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124545 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124548 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124551 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124554 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124557 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124560 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124563 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124566 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124569 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124572 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124575 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124577 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124580 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124583 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124585 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124588 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:06:53.131689 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124591 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124594 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124596 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124599 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124601 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124604 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124607 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124609 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124612 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124617 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124620 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124623 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124626 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124629 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124632 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124635 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124638 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124641 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124644 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:06:53.132188 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124646 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124649 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124652 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124655 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124658 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124660 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124663 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124666 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124669 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124671 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124674 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124676 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124679 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124682 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124684 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124687 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124689 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124692 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124694 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124697 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:06:53.132658 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124702 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124705 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124708 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124712 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124715 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124717 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124720 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:53.124722 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.124727 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.124829 2560 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.126831 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.127611 2560 server.go:1019] "Starting client certificate rotation" Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.127706 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 04:06:53.133154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.127754 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 04:06:53.133468 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.132410 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 04:06:53.133531 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.133513 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 04:06:53.139856 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.139829 2560 log.go:25] "Validated CRI v1 runtime API" Sep 18 04:06:53.141403 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.141387 2560 log.go:25] "Validated CRI v1 image API" Sep 18 04:06:53.142242 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.142228 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 04:06:53.144480 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.144463 2560 fs.go:135] Filesystem UUIDs: map[255e8591-5476-4553-a162-e70b59e9fc1d:/dev/nvme0n1p3 3f76d318-8a1f-41d6-8128-bf771c2655fd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 18 04:06:53.144549 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.144481 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 04:06:53.149246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.149115 2560 manager.go:216] Machine: {Timestamp:2026-09-18 04:06:53.147863064 +0000 UTC m=+1.913675084 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099642 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20e309a4bb891ab996894124d77a60 SystemUUID:ec20e309-a4bb-891a-b996-894124d77a60 BootID:aa456766-390a-4056-9dc4-6b528ade8470 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fd:41:83:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fd:41:83:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:05:5d:68:ec:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 04:06:53.149246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.149240 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 04:06:53.149363 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.149315 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 04:06:53.150973 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.150947 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 04:06:53.151102 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.150976 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 04:06:53.152182 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.152173 2560 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 04:06:53.152215 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.152185 2560 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 04:06:53.152215 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.152193 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 04:06:53.152215 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.152203 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 04:06:53.152296 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.152273 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 04:06:53.156085 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156073 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 18 04:06:53.156206 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156197 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 04:06:53.156252 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156244 2560 kubelet.go:486] "Attempting to sync node with API server" Sep 18 04:06:53.156294 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156255 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 04:06:53.156294 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156268 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 04:06:53.156294 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156281 2560 kubelet.go:398] "Adding apiserver pod source" Sep 18 04:06:53.156294 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156291 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 04:06:53.156775 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156749 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 04:06:53.156775 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.156781 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 04:06:53.163092 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.163061 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 04:06:53.167332 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.167310 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 04:06:53.169857 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.169843 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 04:06:53.169935 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.169881 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 04:06:53.171301 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171281 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 04:06:53.171301 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171308 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171317 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171326 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171338 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171346 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171366 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171375 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171386 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171392 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171403 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171412 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171439 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 04:06:53.171440 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.171444 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 04:06:53.179082 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.179048 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 04:06:53.179193 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.179096 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 04:06:53.179193 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.179096 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 04:06:53.179556 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.179544 2560 server.go:1268] "Started kubelet" Sep 18 04:06:53.179630 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.179606 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 04:06:53.179686 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.179637 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 04:06:53.179725 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.179703 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 04:06:53.180405 ip-10-0-132-223 systemd[1]: Started Kubernetes Kubelet. Sep 18 04:06:53.180947 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.180858 2560 server.go:310] "Adding debug handlers to kubelet server" Sep 18 04:06:53.181204 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.181020 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dckvk" Sep 18 04:06:53.181564 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.181513 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 04:06:53.185267 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.185251 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 04:06:53.186827 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.186806 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 04:06:53.186926 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.186896 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.186982 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.186809 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 04:06:53.187249 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187227 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dckvk" Sep 18 04:06:53.187424 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187406 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 04:06:53.187507 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187470 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 04:06:53.187573 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187510 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 04:06:53.187690 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187664 2560 reconstruct.go:97] "Volume reconstruction finished" Sep 18 04:06:53.187690 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187679 2560 reconciler.go:29] "Reconciler: start to sync state" Sep 18 04:06:53.187825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187758 2560 factory.go:55] Registering systemd factory Sep 18 04:06:53.187825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.187773 2560 factory.go:223] Registration of the systemd container factory successfully Sep 18 04:06:53.188067 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.188052 2560 factory.go:153] Registering CRI-O factory Sep 18 04:06:53.188067 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.188069 2560 factory.go:223] Registration of the crio container factory successfully Sep 18 04:06:53.188206 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.188137 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 04:06:53.188206 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.188154 2560 factory.go:103] Registering Raw factory Sep 18 04:06:53.188206 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.188165 2560 manager.go:1196] Started watching for new ooms in manager Sep 18 04:06:53.188494 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.188484 2560 manager.go:349] Starting recovery of all containers Sep 18 04:06:53.194153 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.194096 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 04:06:53.217394 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.183583 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-223.ec2.internal.18d64eae78839998 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-223.ec2.internal,UID:ip-10-0-132-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-223.ec2.internal,},FirstTimestamp:2026-09-18 04:06:53.179517336 +0000 UTC m=+1.945329356,LastTimestamp:2026-09-18 04:06:53.179517336 +0000 UTC m=+1.945329356,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-223.ec2.internal,}" Sep 18 04:06:53.220557 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.220533 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:06:53.220557 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.220552 2560 manager.go:354] Recovery completed Sep 18 04:06:53.221115 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.221081 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-223.ec2.internal\" not found" node="ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.225483 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.225468 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.227251 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227231 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.227316 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227269 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.227316 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227281 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.227801 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227789 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 04:06:53.227801 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227795 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.227801 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227799 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 04:06:53.227914 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.227815 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 18 04:06:53.228494 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.228481 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.228552 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.228504 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.228552 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.228521 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.229822 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.229810 2560 policy_none.go:49] "None policy: Start" Sep 18 04:06:53.229864 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.229826 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 04:06:53.229864 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.229836 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 04:06:53.231806 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.231793 2560 policy_none.go:47] "Start" Sep 18 04:06:53.270679 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.270665 2560 manager.go:337] "Starting Device Plugin manager" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.270708 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.270720 2560 server.go:87] "Starting device plugin registration server" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.270972 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.270990 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.271066 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.271309 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.271318 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.271639 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 04:06:53.283853 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.271689 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.340013 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.339990 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 04:06:53.340151 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.340046 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 04:06:53.340151 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.340069 2560 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 04:06:53.340151 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.340111 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 04:06:53.342670 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.342650 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:06:53.371701 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.371646 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.372564 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.372549 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.372646 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.372579 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.372646 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.372596 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.372646 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.372623 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.380732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.380719 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.380782 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.380740 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-223.ec2.internal\": node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.394016 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.393999 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.440991 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.440969 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal"] Sep 18 04:06:53.441054 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.441038 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.443602 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.443588 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.443672 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.443614 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.443672 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.443623 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.445946 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.445934 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.446070 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446056 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.446109 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446087 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.446806 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446790 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.446881 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446819 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.446881 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446830 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.446881 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446790 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.446972 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446895 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.446972 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.446910 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.449157 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.449138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.449239 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.449163 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:06:53.449870 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.449855 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:06:53.449939 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.449887 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:06:53.449939 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.449903 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:06:53.472767 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.472749 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-223.ec2.internal\" not found" node="ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.477221 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.477205 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-223.ec2.internal\" not found" node="ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.489651 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.489634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1678dec89514a13b66f496e43d62684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"e1678dec89514a13b66f496e43d62684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.489732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.489656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1678dec89514a13b66f496e43d62684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"e1678dec89514a13b66f496e43d62684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.489732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.489679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b6211f16feaea8a35000a897638fac3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-223.ec2.internal\" (UID: \"1b6211f16feaea8a35000a897638fac3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.494748 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.494731 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.590783 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.590754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1678dec89514a13b66f496e43d62684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"e1678dec89514a13b66f496e43d62684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.590783 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.590783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1678dec89514a13b66f496e43d62684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"e1678dec89514a13b66f496e43d62684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.590932 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.590798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b6211f16feaea8a35000a897638fac3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-223.ec2.internal\" (UID: \"1b6211f16feaea8a35000a897638fac3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.590932 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.590831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b6211f16feaea8a35000a897638fac3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-223.ec2.internal\" (UID: \"1b6211f16feaea8a35000a897638fac3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.590932 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.590846 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1678dec89514a13b66f496e43d62684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"e1678dec89514a13b66f496e43d62684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.590932 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.590848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1678dec89514a13b66f496e43d62684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"e1678dec89514a13b66f496e43d62684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.594812 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.594794 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.695596 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.695531 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.776758 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.776728 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.780651 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:53.780634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Sep 18 04:06:53.796083 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.796060 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.896665 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.896619 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:53.997187 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:53.997104 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:54.097706 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:54.097663 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:54.127867 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.127835 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 04:06:54.128312 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.127993 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 04:06:54.128312 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.128008 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 04:06:54.192680 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.192640 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 04:01:53 +0000 UTC" deadline="2028-02-19 19:26:46.508322251 +0000 UTC" Sep 18 04:06:54.192680 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.192672 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12471h19m52.315652644s" Sep 18 04:06:54.198482 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:54.198463 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Sep 18 04:06:54.291319 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.291299 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:06:54.387933 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.387905 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Sep 18 04:06:54.397991 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.397972 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 04:06:54.399666 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.399635 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Sep 18 04:06:54.409285 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.409265 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 04:06:54.447953 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:54.447923 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1678dec89514a13b66f496e43d62684.slice/crio-7ddc8cebf27380ffa445e05087116a056a188d4ae2a957b624ac04ab1a46cc63 WatchSource:0}: Error finding container 7ddc8cebf27380ffa445e05087116a056a188d4ae2a957b624ac04ab1a46cc63: Status 404 returned error can't find the container with id 7ddc8cebf27380ffa445e05087116a056a188d4ae2a957b624ac04ab1a46cc63 Sep 18 04:06:54.448328 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:54.448309 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6211f16feaea8a35000a897638fac3.slice/crio-a7a72328bcbcdc8f62b9b9c3b6605ff3850249d9fac08c9a4083f756a0253467 WatchSource:0}: Error finding container a7a72328bcbcdc8f62b9b9c3b6605ff3850249d9fac08c9a4083f756a0253467: Status 404 returned error can't find the container with id a7a72328bcbcdc8f62b9b9c3b6605ff3850249d9fac08c9a4083f756a0253467 Sep 18 04:06:54.453434 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.453417 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:06:54.459228 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:54.459210 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:06:55.157353 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.157310 2560 apiserver.go:52] "Watching apiserver" Sep 18 04:06:55.166910 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.166830 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 04:06:55.167848 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.167821 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-t2r79","kube-system/konnectivity-agent-xpqlg","kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal","openshift-multus/network-metrics-daemon-k8j66","openshift-network-diagnostics/network-check-target-nwjpx","openshift-network-operator/iptables-alerter-x8fgt","openshift-ovn-kubernetes/ovnkube-node-r6hbz","kube-system/global-pull-secret-syncer-6lctk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2","openshift-cluster-node-tuning-operator/tuned-b5d2w","openshift-dns/node-resolver-nwtr5","openshift-image-registry/node-ca-nkhgd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-7vc4c"] Sep 18 04:06:55.171636 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.171612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.173895 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.173874 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.174103 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.174083 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 04:06:55.174443 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.174422 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.174790 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.174771 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smw2s\"" Sep 18 04:06:55.174924 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.174909 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 04:06:55.175064 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.175041 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.175297 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.175279 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 04:06:55.175422 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.175407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 04:06:55.176119 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.176078 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.176391 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.176374 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gwklr\"" Sep 18 04:06:55.176470 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.176398 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.178062 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.177989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.180707 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180051 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 04:06:55.180707 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180462 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.180707 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180477 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 04:06:55.180969 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180717 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.180969 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180758 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qwkgc\"" Sep 18 04:06:55.180969 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180905 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 04:06:55.180969 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.180962 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.181171 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.181031 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:06:55.183364 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.182998 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:55.183364 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.183062 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:06:55.186511 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.186495 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.188593 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.188174 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 04:06:55.188749 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.188734 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.189312 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.189282 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.189407 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.189341 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 04:06:55.189508 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.189494 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cccqv\"" Sep 18 04:06:55.189582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.189551 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.190388 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.190368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.190476 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.190430 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:06:55.191078 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.191058 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 04:06:55.191309 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.191292 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.194017 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.193009 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kvqbv\"" Sep 18 04:06:55.194017 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.193114 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.194017 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.193267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.195855 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.195483 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 04:06:55.195855 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.195677 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 04:06:55.195855 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.195795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.195855 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.195816 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kgvcx\"" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.197742 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198037 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wgv9j\"" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198317 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f47ad4-073b-4dcb-89a8-5055a26988ff-tmp-dir\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198579 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-env-overrides\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44efb45a-2187-4ca1-a329-bd53381e2d07-ovn-node-metrics-cert\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-registration-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-dbus\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqdh\" (UniqueName: \"kubernetes.io/projected/8be3598a-5f7e-489f-8fb7-491347d2cacd-kube-api-access-5hqdh\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-systemd\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-ovnkube-config\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.200255 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-ovnkube-script-lib\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqnzx\" (UniqueName: \"kubernetes.io/projected/03f47ad4-073b-4dcb-89a8-5055a26988ff-kube-api-access-bqnzx\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198951 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-device-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.198988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h87sv\" (UniqueName: \"kubernetes.io/projected/d620b21a-d1cc-4952-a1c0-23086877f2fe-kube-api-access-h87sv\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-node-log\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-socket-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97gzp\" (UniqueName: \"kubernetes.io/projected/4a210a07-93a7-416b-9264-e30a934bfc86-kube-api-access-97gzp\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-ovn\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-etc-selinux\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-sys-fs\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-system-cni-dir\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrbs\" (UniqueName: \"kubernetes.io/projected/5cbd097f-667b-4edf-a3fd-f8db1971b314-kube-api-access-lzrbs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8be3598a-5f7e-489f-8fb7-491347d2cacd-iptables-alerter-script\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199334 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8be3598a-5f7e-489f-8fb7-491347d2cacd-host-slash\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.201219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-slash\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-var-lib-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-log-socket\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkfn\" (UniqueName: \"kubernetes.io/projected/44efb45a-2187-4ca1-a329-bd53381e2d07-kube-api-access-zgkfn\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-cnibin\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-kubelet\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-systemd-units\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-run-netns\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-etc-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-cni-bin\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03f47ad4-073b-4dcb-89a8-5055a26988ff-hosts-file\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-kubelet-config\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.199737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-cni-netd\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.201309 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.201943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.201608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.206582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.204645 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 04:06:55.206582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.204730 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z6k7z\"" Sep 18 04:06:55.206582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.204889 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 04:06:55.206582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.205001 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 04:06:55.206582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.205560 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 04:06:55.206582 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.205942 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6ghh\"" Sep 18 04:06:55.206915 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.205743 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 04:06:55.225900 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.225880 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vnnrr" Sep 18 04:06:55.234927 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.234905 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vnnrr" Sep 18 04:06:55.289186 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.289163 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 04:06:55.300531 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.300652 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-cni-binary-copy\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.300652 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14fc9f49-e30e-4799-b4d6-766dff65f85d-konnectivity-ca\") pod \"konnectivity-agent-xpqlg\" (UID: \"14fc9f49-e30e-4799-b4d6-766dff65f85d\") " pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.300652 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-systemd-units\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.300652 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-run-netns\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.300652 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-etc-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-cni-bin\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-kubelet-config\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-tuned\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-hostroot\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0b951b1-163f-4376-8992-875ad0219de6-serviceca\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f47ad4-073b-4dcb-89a8-5055a26988ff-tmp-dir\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysctl-conf\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300849 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvp9\" (UniqueName: \"kubernetes.io/projected/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-kube-api-access-pzvp9\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-cni-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.300898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-etc-kubernetes\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br5x9\" (UniqueName: \"kubernetes.io/projected/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-kube-api-access-br5x9\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djwtq\" (UniqueName: \"kubernetes.io/projected/d0b951b1-163f-4376-8992-875ad0219de6-kube-api-access-djwtq\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44efb45a-2187-4ca1-a329-bd53381e2d07-ovn-node-metrics-cert\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.300998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-daemon-config\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301032 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-var-lib-kubelet\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-systemd\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-ovnkube-config\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h87sv\" (UniqueName: \"kubernetes.io/projected/d620b21a-d1cc-4952-a1c0-23086877f2fe-kube-api-access-h87sv\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301159 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-lib-modules\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-host\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.301246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301234 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-k8s-cni-cncf-io\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301296 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-systemd-units\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301400 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-systemd\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301429 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-run-netns\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301467 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-kubelet-config\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-cni-bin\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301513 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-etc-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301655 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f47ad4-073b-4dcb-89a8-5055a26988ff-tmp-dir\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-socket-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-modprobe-d\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-cnibin\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14fc9f49-e30e-4799-b4d6-766dff65f85d-agent-certs\") pod \"konnectivity-agent-xpqlg\" (UID: \"14fc9f49-e30e-4799-b4d6-766dff65f85d\") " pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8be3598a-5f7e-489f-8fb7-491347d2cacd-iptables-alerter-script\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-socket-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-socket-dir-parent\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301831 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301843 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-ovnkube-config\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301837 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-run\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.301919 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301908 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-log-socket\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkfn\" (UniqueName: \"kubernetes.io/projected/44efb45a-2187-4ca1-a329-bd53381e2d07-kube-api-access-zgkfn\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.301983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-cnibin\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302025 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-log-socket\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302025 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-kubelet\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302063 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-cnibin\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302077 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03f47ad4-073b-4dcb-89a8-5055a26988ff-hosts-file\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-systemd\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302180 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03f47ad4-073b-4dcb-89a8-5055a26988ff-hosts-file\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-system-cni-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302104 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-kubelet\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-cni-bin\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-cni-multus\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-cni-netd\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.302787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302320 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302344 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8be3598a-5f7e-489f-8fb7-491347d2cacd-iptables-alerter-script\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302344 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-cni-netd\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-env-overrides\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-registration-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302463 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302572 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-registration-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-dbus\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqdh\" (UniqueName: \"kubernetes.io/projected/8be3598a-5f7e-489f-8fb7-491347d2cacd-kube-api-access-5hqdh\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-kubernetes\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.302678 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:55.303616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0b951b1-163f-4376-8992-875ad0219de6-host\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-ovnkube-script-lib\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqnzx\" (UniqueName: \"kubernetes.io/projected/03f47ad4-073b-4dcb-89a8-5055a26988ff-kube-api-access-bqnzx\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.302816 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:55.80276921 +0000 UTC m=+4.568581238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302824 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d620b21a-d1cc-4952-a1c0-23086877f2fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-device-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-tmp\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-netns\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302891 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-env-overrides\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-conf-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-node-log\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97gzp\" (UniqueName: \"kubernetes.io/projected/4a210a07-93a7-416b-9264-e30a934bfc86-kube-api-access-97gzp\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysconfig\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.302963 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.303153 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.303202 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:55.803185552 +0000 UTC m=+4.568997580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:55.304478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303253 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-device-dir\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303291 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-node-log\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysctl-d\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303335 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-dbus\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-sys\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-kubelet\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-ovn\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-etc-selinux\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303467 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-run-ovn\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303475 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44efb45a-2187-4ca1-a329-bd53381e2d07-ovnkube-script-lib\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-sys-fs\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-system-cni-dir\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303554 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-sys-fs\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrbs\" (UniqueName: \"kubernetes.io/projected/5cbd097f-667b-4edf-a3fd-f8db1971b314-kube-api-access-lzrbs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303574 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a210a07-93a7-416b-9264-e30a934bfc86-etc-selinux\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303601 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d620b21a-d1cc-4952-a1c0-23086877f2fe-system-cni-dir\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.305270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8be3598a-5f7e-489f-8fb7-491347d2cacd-host-slash\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-multus-certs\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-slash\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-var-lib-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303713 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8be3598a-5f7e-489f-8fb7-491347d2cacd-host-slash\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303756 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-slash\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303792 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-var-lib-openvswitch\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.306040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.303826 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44efb45a-2187-4ca1-a329-bd53381e2d07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.307819 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.307785 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44efb45a-2187-4ca1-a329-bd53381e2d07-ovn-node-metrics-cert\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.311714 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.311694 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:06:55.311811 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.311725 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:06:55.311811 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.311740 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:55.311915 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.311886 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:55.811869194 +0000 UTC m=+4.577681218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:55.314486 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.314459 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h87sv\" (UniqueName: \"kubernetes.io/projected/d620b21a-d1cc-4952-a1c0-23086877f2fe-kube-api-access-h87sv\") pod \"multus-additional-cni-plugins-7vc4c\" (UID: \"d620b21a-d1cc-4952-a1c0-23086877f2fe\") " pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.315169 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.315145 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqdh\" (UniqueName: \"kubernetes.io/projected/8be3598a-5f7e-489f-8fb7-491347d2cacd-kube-api-access-5hqdh\") pod \"iptables-alerter-x8fgt\" (UID: \"8be3598a-5f7e-489f-8fb7-491347d2cacd\") " pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.315700 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.315656 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqnzx\" (UniqueName: \"kubernetes.io/projected/03f47ad4-073b-4dcb-89a8-5055a26988ff-kube-api-access-bqnzx\") pod \"node-resolver-nwtr5\" (UID: \"03f47ad4-073b-4dcb-89a8-5055a26988ff\") " pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.316878 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.316240 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrbs\" (UniqueName: \"kubernetes.io/projected/5cbd097f-667b-4edf-a3fd-f8db1971b314-kube-api-access-lzrbs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.316878 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.316841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97gzp\" (UniqueName: \"kubernetes.io/projected/4a210a07-93a7-416b-9264-e30a934bfc86-kube-api-access-97gzp\") pod \"aws-ebs-csi-driver-node-6gsv2\" (UID: \"4a210a07-93a7-416b-9264-e30a934bfc86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.317672 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.317632 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkfn\" (UniqueName: \"kubernetes.io/projected/44efb45a-2187-4ca1-a329-bd53381e2d07-kube-api-access-zgkfn\") pod \"ovnkube-node-r6hbz\" (UID: \"44efb45a-2187-4ca1-a329-bd53381e2d07\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.349115 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.349051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" event={"ID":"1b6211f16feaea8a35000a897638fac3","Type":"ContainerStarted","Data":"a7a72328bcbcdc8f62b9b9c3b6605ff3850249d9fac08c9a4083f756a0253467"} Sep 18 04:06:55.351897 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.351849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" event={"ID":"e1678dec89514a13b66f496e43d62684","Type":"ContainerStarted","Data":"7ddc8cebf27380ffa445e05087116a056a188d4ae2a957b624ac04ab1a46cc63"} Sep 18 04:06:55.404637 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-cni-multus\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.404774 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-kubernetes\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.404774 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0b951b1-163f-4376-8992-875ad0219de6-host\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.404774 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-tmp\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.404774 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404727 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-cni-multus\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.404774 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-netns\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404799 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-netns\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404805 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0b951b1-163f-4376-8992-875ad0219de6-host\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-conf-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysconfig\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404860 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-conf-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404799 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-kubernetes\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysctl-d\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-sys\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-kubelet\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404919 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysconfig\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404984 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-sys\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.404993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-multus-certs\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405008 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-kubelet\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-cni-binary-copy\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405032 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysctl-d\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14fc9f49-e30e-4799-b4d6-766dff65f85d-konnectivity-ca\") pod \"konnectivity-agent-xpqlg\" (UID: \"14fc9f49-e30e-4799-b4d6-766dff65f85d\") " pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405067 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-multus-certs\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-tuned\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405114 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-hostroot\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0b951b1-163f-4376-8992-875ad0219de6-serviceca\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysctl-conf\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvp9\" (UniqueName: \"kubernetes.io/projected/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-kube-api-access-pzvp9\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405225 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-cni-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-etc-kubernetes\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br5x9\" (UniqueName: \"kubernetes.io/projected/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-kube-api-access-br5x9\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djwtq\" (UniqueName: \"kubernetes.io/projected/d0b951b1-163f-4376-8992-875ad0219de6-kube-api-access-djwtq\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-daemon-config\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-var-lib-kubelet\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-lib-modules\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-host\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-k8s-cni-cncf-io\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-modprobe-d\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.405732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-cnibin\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14fc9f49-e30e-4799-b4d6-766dff65f85d-agent-certs\") pod \"konnectivity-agent-xpqlg\" (UID: \"14fc9f49-e30e-4799-b4d6-766dff65f85d\") " pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-socket-dir-parent\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-run\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-systemd\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405574 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-hostroot\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-cni-binary-copy\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405625 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-system-cni-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405620 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14fc9f49-e30e-4799-b4d6-766dff65f85d-konnectivity-ca\") pod \"konnectivity-agent-xpqlg\" (UID: \"14fc9f49-e30e-4799-b4d6-766dff65f85d\") " pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405645 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-cni-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405693 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-etc-kubernetes\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405683 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-socket-dir-parent\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405582 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-system-cni-dir\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-cni-bin\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405753 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-host\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405802 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-lib-modules\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405806 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-var-lib-cni-bin\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405575 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-var-lib-kubelet\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.406585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405864 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-host-run-k8s-cni-cncf-io\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405885 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-sysctl-conf\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-run\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405934 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-systemd\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405959 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-cnibin\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.405997 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-modprobe-d\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.406257 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0b951b1-163f-4376-8992-875ad0219de6-serviceca\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.407466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.406301 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-multus-daemon-config\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.407768 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.407752 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-etc-tuned\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.407805 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.407786 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-tmp\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.408520 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.408491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14fc9f49-e30e-4799-b4d6-766dff65f85d-agent-certs\") pod \"konnectivity-agent-xpqlg\" (UID: \"14fc9f49-e30e-4799-b4d6-766dff65f85d\") " pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.413548 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.413525 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvp9\" (UniqueName: \"kubernetes.io/projected/bb50419e-9d34-4f25-8b61-4d9e323ffdc9-kube-api-access-pzvp9\") pod \"tuned-b5d2w\" (UID: \"bb50419e-9d34-4f25-8b61-4d9e323ffdc9\") " pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.413650 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.413606 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djwtq\" (UniqueName: \"kubernetes.io/projected/d0b951b1-163f-4376-8992-875ad0219de6-kube-api-access-djwtq\") pod \"node-ca-nkhgd\" (UID: \"d0b951b1-163f-4376-8992-875ad0219de6\") " pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.417612 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.417562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br5x9\" (UniqueName: \"kubernetes.io/projected/6b3566b3-59fa-47b3-a9ba-b626c8625ed5-kube-api-access-br5x9\") pod \"multus-t2r79\" (UID: \"6b3566b3-59fa-47b3-a9ba-b626c8625ed5\") " pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.487807 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.487769 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:06:55.497801 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.497778 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nwtr5" Sep 18 04:06:55.517674 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.517649 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" Sep 18 04:06:55.526013 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.525992 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x8fgt" Sep 18 04:06:55.534858 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.534833 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" Sep 18 04:06:55.541571 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.541550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:06:55.550154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.550119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" Sep 18 04:06:55.566794 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.566768 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nkhgd" Sep 18 04:06:55.572654 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.572636 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2r79" Sep 18 04:06:55.598987 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.598960 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:06:55.631573 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.631544 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:06:55.808371 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.808295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:55.808371 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.808336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:55.808575 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.808444 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:55.808575 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.808478 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:55.808575 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.808507 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:56.808492088 +0000 UTC m=+5.574304094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:55.808575 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.808529 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:56.808514162 +0000 UTC m=+5.574326189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:55.909751 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:55.909713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:55.909918 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.909871 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:06:55.909918 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.909889 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:06:55.909918 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.909898 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:55.910052 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:55.909960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:56.909946532 +0000 UTC m=+5.675758559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:56.238408 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:56.238320 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:01:55 +0000 UTC" deadline="2028-06-22 09:37:33.965260774 +0000 UTC" Sep 18 04:06:56.238408 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:56.238361 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15437h30m37.726904756s" Sep 18 04:06:56.341173 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:56.341146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:56.341346 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.341261 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:06:56.539781 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.539753 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a210a07_93a7_416b_9264_e30a934bfc86.slice/crio-42f92120f675cab20db21dda57bb50bc48a0163a4d88d3dec33350371d537d04 WatchSource:0}: Error finding container 42f92120f675cab20db21dda57bb50bc48a0163a4d88d3dec33350371d537d04: Status 404 returned error can't find the container with id 42f92120f675cab20db21dda57bb50bc48a0163a4d88d3dec33350371d537d04 Sep 18 04:06:56.540769 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.540743 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b951b1_163f_4376_8992_875ad0219de6.slice/crio-1e7debb49ed52cd9f3f29e00f0d2980ab3de19786a81fc221a00d4736b589920 WatchSource:0}: Error finding container 1e7debb49ed52cd9f3f29e00f0d2980ab3de19786a81fc221a00d4736b589920: Status 404 returned error can't find the container with id 1e7debb49ed52cd9f3f29e00f0d2980ab3de19786a81fc221a00d4736b589920 Sep 18 04:06:56.542055 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.542017 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3566b3_59fa_47b3_a9ba_b626c8625ed5.slice/crio-7c5475b27c6044764b919b440ee8c1b5afb4e425024980b36b0565411e7f0803 WatchSource:0}: Error finding container 7c5475b27c6044764b919b440ee8c1b5afb4e425024980b36b0565411e7f0803: Status 404 returned error can't find the container with id 7c5475b27c6044764b919b440ee8c1b5afb4e425024980b36b0565411e7f0803 Sep 18 04:06:56.546866 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.546818 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44efb45a_2187_4ca1_a329_bd53381e2d07.slice/crio-768819d87ba37d8eabd71f5ac2262c787b4c07bc82fa924295ebb1954bf36640 WatchSource:0}: Error finding container 768819d87ba37d8eabd71f5ac2262c787b4c07bc82fa924295ebb1954bf36640: Status 404 returned error can't find the container with id 768819d87ba37d8eabd71f5ac2262c787b4c07bc82fa924295ebb1954bf36640 Sep 18 04:06:56.568423 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.568400 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd620b21a_d1cc_4952_a1c0_23086877f2fe.slice/crio-9fbb7261d70ab05c320244e421986ea15357673aaca71488581688bf250e65d5 WatchSource:0}: Error finding container 9fbb7261d70ab05c320244e421986ea15357673aaca71488581688bf250e65d5: Status 404 returned error can't find the container with id 9fbb7261d70ab05c320244e421986ea15357673aaca71488581688bf250e65d5 Sep 18 04:06:56.568891 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.568872 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb50419e_9d34_4f25_8b61_4d9e323ffdc9.slice/crio-f15c05e7f90f7f7d32336cb9b2021f8665ea86f5a457b43cb0b6acf83b295d62 WatchSource:0}: Error finding container f15c05e7f90f7f7d32336cb9b2021f8665ea86f5a457b43cb0b6acf83b295d62: Status 404 returned error can't find the container with id f15c05e7f90f7f7d32336cb9b2021f8665ea86f5a457b43cb0b6acf83b295d62 Sep 18 04:06:56.569828 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.569804 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fc9f49_e30e_4799_b4d6_766dff65f85d.slice/crio-cf3b1b859a9309dfafd2d1c5a55bb445c712dfb04fd560cc56e15b4ee865a449 WatchSource:0}: Error finding container cf3b1b859a9309dfafd2d1c5a55bb445c712dfb04fd560cc56e15b4ee865a449: Status 404 returned error can't find the container with id cf3b1b859a9309dfafd2d1c5a55bb445c712dfb04fd560cc56e15b4ee865a449 Sep 18 04:06:56.571004 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:06:56.570977 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f47ad4_073b_4dcb_89a8_5055a26988ff.slice/crio-135329969d8ed19c43422da46cd78e87d6d180e6479855a76bb413898a1b6aa3 WatchSource:0}: Error finding container 135329969d8ed19c43422da46cd78e87d6d180e6479855a76bb413898a1b6aa3: Status 404 returned error can't find the container with id 135329969d8ed19c43422da46cd78e87d6d180e6479855a76bb413898a1b6aa3 Sep 18 04:06:56.815954 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:56.815770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:56.816059 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:56.815980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:56.816059 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.815901 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:56.816199 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.816119 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:56.816199 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.816120 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:58.816090454 +0000 UTC m=+7.581902480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:56.816199 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.816191 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:58.81617464 +0000 UTC m=+7.581986654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:56.916595 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:56.916563 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:56.916716 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.916691 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:06:56.916716 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.916707 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:06:56.916716 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.916717 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:56.916827 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:56.916768 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:06:58.916752544 +0000 UTC m=+7.682564570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:57.239235 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.239101 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:01:55 +0000 UTC" deadline="2028-03-06 21:09:19.217496184 +0000 UTC" Sep 18 04:06:57.239235 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.239175 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12857h2m21.978325038s" Sep 18 04:06:57.341314 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.341283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:57.341542 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:57.341420 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:06:57.341836 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.341814 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:57.341960 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:57.341929 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:06:57.358102 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.358022 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerStarted","Data":"9fbb7261d70ab05c320244e421986ea15357673aaca71488581688bf250e65d5"} Sep 18 04:06:57.368915 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.368879 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x8fgt" event={"ID":"8be3598a-5f7e-489f-8fb7-491347d2cacd","Type":"ContainerStarted","Data":"505cd840b49f2dedab850824eb2aa5963cdfe0202a89630c62c9a479917eb1df"} Sep 18 04:06:57.382912 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.382882 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" event={"ID":"4a210a07-93a7-416b-9264-e30a934bfc86","Type":"ContainerStarted","Data":"42f92120f675cab20db21dda57bb50bc48a0163a4d88d3dec33350371d537d04"} Sep 18 04:06:57.393268 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.393236 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" event={"ID":"1b6211f16feaea8a35000a897638fac3","Type":"ContainerStarted","Data":"b32d846587ba94bd881f39a15a44fb65cdbde31b427afc525f4067b63844a629"} Sep 18 04:06:57.401826 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.401797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"768819d87ba37d8eabd71f5ac2262c787b4c07bc82fa924295ebb1954bf36640"} Sep 18 04:06:57.408386 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.408336 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" podStartSLOduration=3.408318232 podStartE2EDuration="3.408318232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:57.407393081 +0000 UTC m=+6.173205110" watchObservedRunningTime="2026-09-18 04:06:57.408318232 +0000 UTC m=+6.174130262" Sep 18 04:06:57.409663 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.409636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2r79" event={"ID":"6b3566b3-59fa-47b3-a9ba-b626c8625ed5","Type":"ContainerStarted","Data":"7c5475b27c6044764b919b440ee8c1b5afb4e425024980b36b0565411e7f0803"} Sep 18 04:06:57.415215 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.415187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nkhgd" event={"ID":"d0b951b1-163f-4376-8992-875ad0219de6","Type":"ContainerStarted","Data":"1e7debb49ed52cd9f3f29e00f0d2980ab3de19786a81fc221a00d4736b589920"} Sep 18 04:06:57.425749 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.425700 2560 generic.go:356] "Generic (PLEG): container finished" podID="e1678dec89514a13b66f496e43d62684" containerID="c2c659013a6f9c23fb22ce4477e085660252fd0e34cddd4e7afb0458a22da8b9" exitCode=0 Sep 18 04:06:57.425857 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.425772 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" event={"ID":"e1678dec89514a13b66f496e43d62684","Type":"ContainerDied","Data":"c2c659013a6f9c23fb22ce4477e085660252fd0e34cddd4e7afb0458a22da8b9"} Sep 18 04:06:57.436459 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.436433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nwtr5" event={"ID":"03f47ad4-073b-4dcb-89a8-5055a26988ff","Type":"ContainerStarted","Data":"135329969d8ed19c43422da46cd78e87d6d180e6479855a76bb413898a1b6aa3"} Sep 18 04:06:57.450691 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.450529 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xpqlg" event={"ID":"14fc9f49-e30e-4799-b4d6-766dff65f85d","Type":"ContainerStarted","Data":"cf3b1b859a9309dfafd2d1c5a55bb445c712dfb04fd560cc56e15b4ee865a449"} Sep 18 04:06:57.460474 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:57.460446 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" event={"ID":"bb50419e-9d34-4f25-8b61-4d9e323ffdc9","Type":"ContainerStarted","Data":"f15c05e7f90f7f7d32336cb9b2021f8665ea86f5a457b43cb0b6acf83b295d62"} Sep 18 04:06:58.341211 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:58.341177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:58.341672 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.341313 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:06:58.486079 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:58.486000 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" event={"ID":"e1678dec89514a13b66f496e43d62684","Type":"ContainerStarted","Data":"18216c6e339e98b87283197d18c28697e5cb47a23f48776d2ef4245321220b6f"} Sep 18 04:06:58.831928 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:58.831188 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:58.831928 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:58.831237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:58.831928 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.831404 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:58.831928 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.831467 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:02.83144979 +0000 UTC m=+11.597261803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:06:58.831928 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.831531 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:58.831928 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.831563 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:02.831552271 +0000 UTC m=+11.597364292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:06:58.932051 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:58.932014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:58.932248 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.932196 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:06:58.932248 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.932215 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:06:58.932248 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.932227 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:58.932405 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:58.932282 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:02.93226485 +0000 UTC m=+11.698076876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:06:59.354953 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:59.353068 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:06:59.356216 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:59.355690 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:06:59.356216 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:59.355792 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:06:59.356216 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:59.355933 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:06:59.356216 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:06:59.356004 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:06:59.356216 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:06:59.356153 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:01.344596 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:01.344570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:01.344997 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:01.344694 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:01.345058 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:01.345050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:01.345188 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:01.345166 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:01.345263 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:01.345214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:01.345315 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:01.345280 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:02.864700 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:02.864662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:02.865160 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:02.864713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:02.865160 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.864844 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:07:02.865160 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.864927 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:10.864906658 +0000 UTC m=+19.630718678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:07:02.865352 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.864847 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:07:02.865352 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.865301 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:10.865285942 +0000 UTC m=+19.631097981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:07:02.965875 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:02.965679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:02.965875 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.965862 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:07:02.965875 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.965884 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:07:02.966260 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.965898 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:07:02.966260 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:02.965962 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:10.965945146 +0000 UTC m=+19.731757174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:07:03.341819 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:03.341112 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:03.341819 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:03.341254 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:03.341819 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:03.341627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:03.341819 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:03.341719 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:03.342379 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:03.342247 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:03.342379 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:03.342342 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:05.340723 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:05.340691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:05.341158 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:05.340830 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:05.341268 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:05.341249 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:05.341368 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:05.341347 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:05.341514 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:05.341492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:05.341629 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:05.341580 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:07.340420 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:07.340384 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:07.340420 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:07.340405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:07.340934 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:07.340384 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:07.340934 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:07.340531 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:07.340934 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:07.340597 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:07.340934 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:07.340664 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:09.340700 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:09.340658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:09.341175 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:09.340674 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:09.341175 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:09.340793 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:09.341175 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:09.340813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:09.341175 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:09.340934 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:09.341175 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:09.341021 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:10.927359 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:10.927324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:10.927792 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:10.927366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:10.927792 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:10.927462 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:07:10.927792 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:10.927522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:26.927506918 +0000 UTC m=+35.693318924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:07:10.927792 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:10.927461 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:07:10.927792 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:10.927615 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:26.927595214 +0000 UTC m=+35.693407233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:07:11.027930 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:11.027893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:11.028096 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.028021 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:07:11.028096 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.028045 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:07:11.028096 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.028057 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:07:11.028249 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.028111 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:27.028096724 +0000 UTC m=+35.793908747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:07:11.341228 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:11.341159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:11.341377 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:11.341159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:11.341377 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.341270 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:11.341377 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:11.341159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:11.341377 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.341361 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:11.341549 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:11.341437 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:13.341258 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:13.341220 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:13.341657 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:13.341327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:13.341657 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:13.341338 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:13.341657 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:13.341468 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:13.341657 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:13.341504 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:13.341657 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:13.341571 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:14.520099 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.520053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nwtr5" event={"ID":"03f47ad4-073b-4dcb-89a8-5055a26988ff","Type":"ContainerStarted","Data":"d3f9cca4856819695de47136fa876e52a6ecd02b702602869ce6189c44abfb1e"} Sep 18 04:07:14.521786 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.521756 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xpqlg" event={"ID":"14fc9f49-e30e-4799-b4d6-766dff65f85d","Type":"ContainerStarted","Data":"021710d7674587bba7bc3ee58879dcab062b08264b0e9981cab2b32696ab1bb3"} Sep 18 04:07:14.523580 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.523463 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" event={"ID":"bb50419e-9d34-4f25-8b61-4d9e323ffdc9","Type":"ContainerStarted","Data":"5080e0923ac920ed776189ab7fb1becda02ffca4b45569e2443a72a01ade2b3c"} Sep 18 04:07:14.525281 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.525252 2560 generic.go:356] "Generic (PLEG): container finished" podID="d620b21a-d1cc-4952-a1c0-23086877f2fe" containerID="866f38e66818be904b9758dea24a9ecde9e37a2fbd67b4b7469b970ffdaf89ed" exitCode=0 Sep 18 04:07:14.525374 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.525292 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerDied","Data":"866f38e66818be904b9758dea24a9ecde9e37a2fbd67b4b7469b970ffdaf89ed"} Sep 18 04:07:14.528941 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.528916 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" event={"ID":"4a210a07-93a7-416b-9264-e30a934bfc86","Type":"ContainerStarted","Data":"6a5259630740dc7745348d1245f0d7001c2dc06e9a956845a24638071aaf47d3"} Sep 18 04:07:14.532984 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.532959 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"e91b4dda241623a37850ebe55b054951b728c88df907b437c3a8b7d2237a8108"} Sep 18 04:07:14.533093 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.533035 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"eacc6bb0b3137484da6d2a3c6c4e635181a7b8de1b6e9de053e1da8920506a65"} Sep 18 04:07:14.533093 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.533085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"e96be10f6b16c5ca4bdb254d561cc1ff237c50bbb3d5e07643930cee6f210d2a"} Sep 18 04:07:14.533220 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.533148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"70395908cdf6756f9710f20dd6636773c3d2e750efebf0079675e2dcb8083513"} Sep 18 04:07:14.533220 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.533194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"07cef2d95317c213791bf3943597f85de2e9e80e37109a8479a3bd8a9bb1fb6f"} Sep 18 04:07:14.533328 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.533244 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"25845afb100cca6c31085965ac3ac2615b9ac39a55b61c189c8f5305edbc61a4"} Sep 18 04:07:14.534803 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.534780 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2r79" event={"ID":"6b3566b3-59fa-47b3-a9ba-b626c8625ed5","Type":"ContainerStarted","Data":"2af56fc74e961bd46d19b972e453249c2aeb29cd7a72f5e3a95c84d7ab150d24"} Sep 18 04:07:14.536371 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.536328 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nwtr5" podStartSLOduration=4.31316314 podStartE2EDuration="21.536315637s" totalImagesPullingTime="17.223152497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:14.535830522 +0000 UTC m=+23.301642561" watchObservedRunningTime="2026-09-18 04:07:14.536315637 +0000 UTC m=+23.302127665" Sep 18 04:07:14.536496 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.536467 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" podStartSLOduration=20.53645833 podStartE2EDuration="20.53645833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:06:58.50173413 +0000 UTC m=+7.267546159" watchObservedRunningTime="2026-09-18 04:07:14.53645833 +0000 UTC m=+23.302270360" Sep 18 04:07:14.536576 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.536483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nkhgd" event={"ID":"d0b951b1-163f-4376-8992-875ad0219de6","Type":"ContainerStarted","Data":"027c9a0da3e9b5476fe3d9b0502bb1029f63101670cf69e65634b538eeae3fe7"} Sep 18 04:07:14.549979 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.549944 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xpqlg" podStartSLOduration=8.370737843 podStartE2EDuration="21.549932676s" totalImagesPullingTime="13.179194833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:14.549806681 +0000 UTC m=+23.315618711" watchObservedRunningTime="2026-09-18 04:07:14.549932676 +0000 UTC m=+23.315744703" Sep 18 04:07:14.566402 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.566364 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b5d2w" podStartSLOduration=4.341507833 podStartE2EDuration="21.566353046s" totalImagesPullingTime="17.224845213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:14.566158467 +0000 UTC m=+23.331970519" watchObservedRunningTime="2026-09-18 04:07:14.566353046 +0000 UTC m=+23.332165074" Sep 18 04:07:14.581752 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.581718 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t2r79" podStartSLOduration=4.282471724 podStartE2EDuration="21.581706216s" totalImagesPullingTime="17.299234492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:14.581529487 +0000 UTC m=+23.347341516" watchObservedRunningTime="2026-09-18 04:07:14.581706216 +0000 UTC m=+23.347518246" Sep 18 04:07:14.614039 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.613990 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nkhgd" podStartSLOduration=4.359948894 podStartE2EDuration="21.613973872s" totalImagesPullingTime="17.254024978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:14.613466881 +0000 UTC m=+23.379278922" watchObservedRunningTime="2026-09-18 04:07:14.613973872 +0000 UTC m=+23.379785900" Sep 18 04:07:14.990920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:14.990727 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 04:07:15.284876 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.284736 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T04:07:14.990908091Z","UUID":"a8089cb7-5178-4921-88ab-aa76bd14a62d","Handler":null,"Name":"","Endpoint":""} Sep 18 04:07:15.286443 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.286416 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 04:07:15.286566 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.286450 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 04:07:15.340498 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.340465 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:15.340708 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.340466 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:15.340708 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:15.340584 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:15.340708 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.340595 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:15.340708 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:15.340666 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:15.340875 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:15.340744 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:15.477944 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.477853 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:07:15.478632 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.478609 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:07:15.541896 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.541860 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x8fgt" event={"ID":"8be3598a-5f7e-489f-8fb7-491347d2cacd","Type":"ContainerStarted","Data":"0551ceb3547b613625d9302bd4b03a22751963a6b75cb8e2d2197669cd006662"} Sep 18 04:07:15.546147 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.544503 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" event={"ID":"4a210a07-93a7-416b-9264-e30a934bfc86","Type":"ContainerStarted","Data":"199b6a6dbb76d9c8fa04d1396f0c64e49e1ae68166d65baa766868e53f3b296e"} Sep 18 04:07:15.546147 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.546093 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:07:15.546645 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.546627 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xpqlg" Sep 18 04:07:15.557000 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:15.556939 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x8fgt" podStartSLOduration=5.305380729 podStartE2EDuration="22.556923094s" totalImagesPullingTime="17.251542365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:15.556823259 +0000 UTC m=+24.322635288" watchObservedRunningTime="2026-09-18 04:07:15.556923094 +0000 UTC m=+24.322735124" Sep 18 04:07:16.549790 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:16.549749 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" event={"ID":"4a210a07-93a7-416b-9264-e30a934bfc86","Type":"ContainerStarted","Data":"405f83ee0dac2effcbf30cd41baaa14c47de15abad87a679713470b671eb4152"} Sep 18 04:07:16.553946 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:16.553912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"07f773392bbb453292ebaed4bf61a4efd8e2dbb41320e2745b00508d15f8176f"} Sep 18 04:07:16.566803 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:16.566753 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gsv2" podStartSLOduration=4.435666646 podStartE2EDuration="23.56673416s" totalImagesPullingTime="19.131067514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:16.56638844 +0000 UTC m=+25.332200470" watchObservedRunningTime="2026-09-18 04:07:16.56673416 +0000 UTC m=+25.332546189" Sep 18 04:07:17.340570 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:17.340540 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:17.340787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:17.340573 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:17.340787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:17.340540 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:17.340787 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:17.340701 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:17.340914 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:17.340839 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:17.340950 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:17.340928 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:19.340782 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.340609 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:19.341394 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.340609 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:19.341394 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:19.340853 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:19.341394 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.340664 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:19.341394 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:19.340921 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:19.341394 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:19.341053 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:19.564029 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.563952 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" event={"ID":"44efb45a-2187-4ca1-a329-bd53381e2d07","Type":"ContainerStarted","Data":"e1f2aa8804142a7563a5e8a09c726e8afb1414b51ee9de99a14368dc707c7601"} Sep 18 04:07:19.564216 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.564189 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:07:19.564329 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.564273 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:07:19.564329 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.564327 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:07:19.566284 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.566257 2560 generic.go:356] "Generic (PLEG): container finished" podID="d620b21a-d1cc-4952-a1c0-23086877f2fe" containerID="867dbe280d366af0cb07a19bc2f02bd215333ee49b6b1a7f02375e26c8711716" exitCode=0 Sep 18 04:07:19.566370 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.566295 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerDied","Data":"867dbe280d366af0cb07a19bc2f02bd215333ee49b6b1a7f02375e26c8711716"} Sep 18 04:07:19.579427 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.579407 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:07:19.579667 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.579650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:07:19.590616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:19.590574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" podStartSLOduration=9.330323867 podStartE2EDuration="26.590563145s" totalImagesPullingTime="17.260239278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:19.590440646 +0000 UTC m=+28.356252674" watchObservedRunningTime="2026-09-18 04:07:19.590563145 +0000 UTC m=+28.356375173" Sep 18 04:07:20.928675 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:20.928483 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k8j66"] Sep 18 04:07:20.929259 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:20.928809 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:20.929259 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:20.928903 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:20.931918 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:20.931831 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lctk"] Sep 18 04:07:20.932038 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:20.931943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:20.932091 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:20.932045 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:20.932689 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:20.932663 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nwjpx"] Sep 18 04:07:20.932779 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:20.932768 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:20.932900 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:20.932858 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:21.572886 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:21.572851 2560 generic.go:356] "Generic (PLEG): container finished" podID="d620b21a-d1cc-4952-a1c0-23086877f2fe" containerID="0d9821d7c5d3ed38ed98288d929b24351d1ca0621124c5f25d301a2f7930c74d" exitCode=0 Sep 18 04:07:21.573037 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:21.572925 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerDied","Data":"0d9821d7c5d3ed38ed98288d929b24351d1ca0621124c5f25d301a2f7930c74d"} Sep 18 04:07:22.341066 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:22.341036 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:22.341501 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:22.341036 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:22.341501 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:22.341161 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:22.341501 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:22.341203 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:22.341501 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:22.341036 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:22.341501 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:22.341351 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:23.579535 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:23.579442 2560 generic.go:356] "Generic (PLEG): container finished" podID="d620b21a-d1cc-4952-a1c0-23086877f2fe" containerID="4f8321d82c7012128c89e1653a3fe830a8a56a6fbef597d06875b94dcd39f7df" exitCode=0 Sep 18 04:07:23.579535 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:23.579490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerDied","Data":"4f8321d82c7012128c89e1653a3fe830a8a56a6fbef597d06875b94dcd39f7df"} Sep 18 04:07:24.340972 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:24.340943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:24.341118 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:24.340950 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:24.341118 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:24.340950 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:24.341220 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:24.341145 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:24.341220 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:24.341200 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:24.341220 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:24.341035 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:26.341222 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.341194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:26.341662 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.341194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:26.341662 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.341198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:26.341662 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.341359 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k8j66" podUID="5cbd097f-667b-4edf-a3fd-f8db1971b314" Sep 18 04:07:26.341662 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.341442 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwjpx" podUID="aee70705-d493-48e8-8702-dbd968534c55" Sep 18 04:07:26.341662 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.341506 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lctk" podUID="a823d1f9-c5bd-4ac9-924b-de7cf049c1e5" Sep 18 04:07:26.568501 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.568477 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeReady" Sep 18 04:07:26.568666 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.568607 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 04:07:26.649313 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.649238 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lv9jw"] Sep 18 04:07:26.666355 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.666321 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pgx4l"] Sep 18 04:07:26.666541 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.666439 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.670356 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.670324 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 04:07:26.670510 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.670470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pwqr\"" Sep 18 04:07:26.670684 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.670659 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 04:07:26.691218 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.691194 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgx4l"] Sep 18 04:07:26.691345 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.691232 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lv9jw"] Sep 18 04:07:26.691345 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.691326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:26.695352 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.695319 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 04:07:26.695613 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.695574 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 04:07:26.696536 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.696515 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 04:07:26.696624 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.696548 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rfxrq\"" Sep 18 04:07:26.749735 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.749701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-config-volume\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.749735 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.749739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-tmp-dir\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.749934 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.749762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.749934 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.749855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tgqq\" (UniqueName: \"kubernetes.io/projected/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-kube-api-access-2tgqq\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.851099 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-tmp-dir\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.851282 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.851282 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl7d\" (UniqueName: \"kubernetes.io/projected/9edb819a-eb6f-4820-aec2-af752857ab8a-kube-api-access-jnl7d\") pod \"ingress-canary-pgx4l\" (UID: \"9edb819a-eb6f-4820-aec2-af752857ab8a\") " pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:26.851282 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tgqq\" (UniqueName: \"kubernetes.io/projected/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-kube-api-access-2tgqq\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.851282 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9edb819a-eb6f-4820-aec2-af752857ab8a-cert\") pod \"ingress-canary-pgx4l\" (UID: \"9edb819a-eb6f-4820-aec2-af752857ab8a\") " pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:26.851282 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-config-volume\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.851518 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.851281 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:07:26.851518 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.851404 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls podName:0e8bf73c-719d-4d6a-90ab-1738f48d77f0 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:27.351387386 +0000 UTC m=+36.117199407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls") pod "dns-default-lv9jw" (UID: "0e8bf73c-719d-4d6a-90ab-1738f48d77f0") : secret "dns-default-metrics-tls" not found Sep 18 04:07:26.851518 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851445 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-tmp-dir\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.851747 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.851723 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-config-volume\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.865157 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.864967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tgqq\" (UniqueName: \"kubernetes.io/projected/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-kube-api-access-2tgqq\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:26.952243 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.952161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:26.952243 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.952198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:26.952243 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.952216 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl7d\" (UniqueName: \"kubernetes.io/projected/9edb819a-eb6f-4820-aec2-af752857ab8a-kube-api-access-jnl7d\") pod \"ingress-canary-pgx4l\" (UID: \"9edb819a-eb6f-4820-aec2-af752857ab8a\") " pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:26.952243 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.952243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9edb819a-eb6f-4820-aec2-af752857ab8a-cert\") pod \"ingress-canary-pgx4l\" (UID: \"9edb819a-eb6f-4820-aec2-af752857ab8a\") " pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:26.952463 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.952328 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:07:26.952463 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.952333 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:07:26.952463 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.952412 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret podName:a823d1f9-c5bd-4ac9-924b-de7cf049c1e5 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:58.95239182 +0000 UTC m=+67.718203843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret") pod "global-pull-secret-syncer-6lctk" (UID: "a823d1f9-c5bd-4ac9-924b-de7cf049c1e5") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:07:26.952463 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:26.952449 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs podName:5cbd097f-667b-4edf-a3fd-f8db1971b314 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:58.952435973 +0000 UTC m=+67.718248009 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs") pod "network-metrics-daemon-k8j66" (UID: "5cbd097f-667b-4edf-a3fd-f8db1971b314") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:07:26.954716 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.954698 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9edb819a-eb6f-4820-aec2-af752857ab8a-cert\") pod \"ingress-canary-pgx4l\" (UID: \"9edb819a-eb6f-4820-aec2-af752857ab8a\") " pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:26.960204 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:26.960185 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl7d\" (UniqueName: \"kubernetes.io/projected/9edb819a-eb6f-4820-aec2-af752857ab8a-kube-api-access-jnl7d\") pod \"ingress-canary-pgx4l\" (UID: \"9edb819a-eb6f-4820-aec2-af752857ab8a\") " pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:27.001678 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:27.001656 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgx4l" Sep 18 04:07:27.053230 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:27.053194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:27.053421 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:27.053402 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:07:27.053474 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:27.053425 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:07:27.053474 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:27.053434 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bb5jz for pod openshift-network-diagnostics/network-check-target-nwjpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:07:27.053557 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:27.053499 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz podName:aee70705-d493-48e8-8702-dbd968534c55 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:59.053482402 +0000 UTC m=+67.819294409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5jz" (UniqueName: "kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz") pod "network-check-target-nwjpx" (UID: "aee70705-d493-48e8-8702-dbd968534c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:07:27.355996 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:27.355966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:27.356429 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:27.356119 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:07:27.356429 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:27.356206 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls podName:0e8bf73c-719d-4d6a-90ab-1738f48d77f0 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:28.356184148 +0000 UTC m=+37.121996160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls") pod "dns-default-lv9jw" (UID: "0e8bf73c-719d-4d6a-90ab-1738f48d77f0") : secret "dns-default-metrics-tls" not found Sep 18 04:07:28.341175 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.341139 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:28.341349 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.341143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:28.341349 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.341145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:28.344844 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.344822 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 04:07:28.344844 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.344830 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mt76n\"" Sep 18 04:07:28.345040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.344851 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cw2bm\"" Sep 18 04:07:28.345040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.344873 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 04:07:28.345040 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.344823 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 04:07:28.345257 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.345244 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 04:07:28.362607 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.362585 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:28.362912 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:28.362696 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:07:28.362912 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:28.362777 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls podName:0e8bf73c-719d-4d6a-90ab-1738f48d77f0 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:30.36275403 +0000 UTC m=+39.128566050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls") pod "dns-default-lv9jw" (UID: "0e8bf73c-719d-4d6a-90ab-1738f48d77f0") : secret "dns-default-metrics-tls" not found Sep 18 04:07:28.851790 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:28.851758 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgx4l"] Sep 18 04:07:28.855058 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:28.855031 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9edb819a_eb6f_4820_aec2_af752857ab8a.slice/crio-174764f8f334a6a7852f19be4a23f2bca76e2a4290facdab24d56011991978a7 WatchSource:0}: Error finding container 174764f8f334a6a7852f19be4a23f2bca76e2a4290facdab24d56011991978a7: Status 404 returned error can't find the container with id 174764f8f334a6a7852f19be4a23f2bca76e2a4290facdab24d56011991978a7 Sep 18 04:07:29.599224 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:29.599190 2560 generic.go:356] "Generic (PLEG): container finished" podID="d620b21a-d1cc-4952-a1c0-23086877f2fe" containerID="c044c13c55fa86e998feea4a5be0182a3bfccc5174b5f2920393b3b3d8eb5b1c" exitCode=0 Sep 18 04:07:29.600225 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:29.599282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerDied","Data":"c044c13c55fa86e998feea4a5be0182a3bfccc5174b5f2920393b3b3d8eb5b1c"} Sep 18 04:07:29.600713 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:29.600688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgx4l" event={"ID":"9edb819a-eb6f-4820-aec2-af752857ab8a","Type":"ContainerStarted","Data":"174764f8f334a6a7852f19be4a23f2bca76e2a4290facdab24d56011991978a7"} Sep 18 04:07:30.175354 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.175322 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zd9lc"] Sep 18 04:07:30.191147 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.191108 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.194061 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.194001 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 04:07:30.194061 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.194057 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s75gn\"" Sep 18 04:07:30.195113 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.194946 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 04:07:30.195113 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.194984 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 04:07:30.195113 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.194946 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 04:07:30.195310 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.195248 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zd9lc"] Sep 18 04:07:30.275854 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.275821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be87ffa2-f151-462c-a8e0-82642ff66781-data-volume\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.276007 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.275867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be87ffa2-f151-462c-a8e0-82642ff66781-crio-socket\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.276007 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.275915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.276007 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.275935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxwsz\" (UniqueName: \"kubernetes.io/projected/be87ffa2-f151-462c-a8e0-82642ff66781-kube-api-access-vxwsz\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.276007 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.275965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376355 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be87ffa2-f151-462c-a8e0-82642ff66781-crio-socket\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376517 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376362 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376517 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxwsz\" (UniqueName: \"kubernetes.io/projected/be87ffa2-f151-462c-a8e0-82642ff66781-kube-api-access-vxwsz\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376517 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376517 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376475 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be87ffa2-f151-462c-a8e0-82642ff66781-data-volume\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376568 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be87ffa2-f151-462c-a8e0-82642ff66781-crio-socket\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.376487 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.376570 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.376626 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.376680 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:30.876661012 +0000 UTC m=+39.642473025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : configmap "kube-rbac-proxy" not found Sep 18 04:07:30.376733 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.376700 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:30.876690621 +0000 UTC m=+39.642502626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : secret "insights-runtime-extractor-tls" not found Sep 18 04:07:30.377039 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.376740 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls podName:0e8bf73c-719d-4d6a-90ab-1738f48d77f0 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:34.376722853 +0000 UTC m=+43.142534864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls") pod "dns-default-lv9jw" (UID: "0e8bf73c-719d-4d6a-90ab-1738f48d77f0") : secret "dns-default-metrics-tls" not found Sep 18 04:07:30.377039 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.376850 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be87ffa2-f151-462c-a8e0-82642ff66781-data-volume\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.394228 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.394199 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxwsz\" (UniqueName: \"kubernetes.io/projected/be87ffa2-f151-462c-a8e0-82642ff66781-kube-api-access-vxwsz\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.404106 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.404074 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx"] Sep 18 04:07:30.410116 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.410096 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" Sep 18 04:07:30.414355 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.414332 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 04:07:30.414490 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.414405 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 04:07:30.414490 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.414431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4c294\"" Sep 18 04:07:30.418747 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.418721 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx"] Sep 18 04:07:30.577692 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.577654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rc2l\" (UniqueName: \"kubernetes.io/projected/4a257edd-e624-4e75-a373-c3412bcc205c-kube-api-access-5rc2l\") pod \"migrator-76794cbd6c-tnbbx\" (UID: \"4a257edd-e624-4e75-a373-c3412bcc205c\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" Sep 18 04:07:30.605593 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.605564 2560 generic.go:356] "Generic (PLEG): container finished" podID="d620b21a-d1cc-4952-a1c0-23086877f2fe" containerID="4d893910325bdfc1add018bd37a02b667b3078ba814202bfa1acdc23c5d1edcf" exitCode=0 Sep 18 04:07:30.605934 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.605623 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerDied","Data":"4d893910325bdfc1add018bd37a02b667b3078ba814202bfa1acdc23c5d1edcf"} Sep 18 04:07:30.678356 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.678327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rc2l\" (UniqueName: \"kubernetes.io/projected/4a257edd-e624-4e75-a373-c3412bcc205c-kube-api-access-5rc2l\") pod \"migrator-76794cbd6c-tnbbx\" (UID: \"4a257edd-e624-4e75-a373-c3412bcc205c\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" Sep 18 04:07:30.687111 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.686935 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rc2l\" (UniqueName: \"kubernetes.io/projected/4a257edd-e624-4e75-a373-c3412bcc205c-kube-api-access-5rc2l\") pod \"migrator-76794cbd6c-tnbbx\" (UID: \"4a257edd-e624-4e75-a373-c3412bcc205c\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" Sep 18 04:07:30.720165 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.720116 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" Sep 18 04:07:30.879591 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.879558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.879748 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:30.879612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:30.879748 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.879688 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:07:30.879830 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.879765 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:31.879744918 +0000 UTC m=+40.645556942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : configmap "kube-rbac-proxy" not found Sep 18 04:07:30.879830 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.879767 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:07:30.879830 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:30.879819 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:31.87980278 +0000 UTC m=+40.645614799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : secret "insights-runtime-extractor-tls" not found Sep 18 04:07:31.613762 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:31.613732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" event={"ID":"d620b21a-d1cc-4952-a1c0-23086877f2fe","Type":"ContainerStarted","Data":"36e8e8f88090474f4b731ab7ce00bdecfa2775bb3ef56ff450aa9cfcc2919bed"} Sep 18 04:07:31.635277 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:31.635231 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7vc4c" podStartSLOduration=9.214812302 podStartE2EDuration="38.635218236s" totalImagesPullingTime="29.420405934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:31.63408515 +0000 UTC m=+40.399897179" watchObservedRunningTime="2026-09-18 04:07:31.635218236 +0000 UTC m=+40.401030255" Sep 18 04:07:31.696503 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:31.696444 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx"] Sep 18 04:07:31.745168 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:31.745142 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a257edd_e624_4e75_a373_c3412bcc205c.slice/crio-f33c008474d7b7183a3120e3644b790e5e0e03cfa9e556fc89c8b9b02d4c1eac WatchSource:0}: Error finding container f33c008474d7b7183a3120e3644b790e5e0e03cfa9e556fc89c8b9b02d4c1eac: Status 404 returned error can't find the container with id f33c008474d7b7183a3120e3644b790e5e0e03cfa9e556fc89c8b9b02d4c1eac Sep 18 04:07:31.887659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:31.887634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:31.887807 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:31.887787 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:07:31.887858 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:31.887820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:31.887858 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:31.887849 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:33.88783415 +0000 UTC m=+42.653646174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : secret "insights-runtime-extractor-tls" not found Sep 18 04:07:31.887934 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:31.887876 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:07:31.887971 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:31.887936 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:33.887923995 +0000 UTC m=+42.653736002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : configmap "kube-rbac-proxy" not found Sep 18 04:07:31.923648 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:31.923621 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nwtr5_03f47ad4-073b-4dcb-89a8-5055a26988ff/dns-node-resolver/0.log" Sep 18 04:07:32.617922 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.617885 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" event={"ID":"4a257edd-e624-4e75-a373-c3412bcc205c","Type":"ContainerStarted","Data":"f33c008474d7b7183a3120e3644b790e5e0e03cfa9e556fc89c8b9b02d4c1eac"} Sep 18 04:07:32.619767 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.619736 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgx4l" event={"ID":"9edb819a-eb6f-4820-aec2-af752857ab8a","Type":"ContainerStarted","Data":"d4a44262cfa6c41bb1297f6ec9ec069684652c44da26a4682ae9a617484ba147"} Sep 18 04:07:32.640706 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.640657 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pgx4l" podStartSLOduration=3.723591755 podStartE2EDuration="6.64064124s" totalImagesPullingTime="2.917049485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:32.639952836 +0000 UTC m=+41.405764865" watchObservedRunningTime="2026-09-18 04:07:32.64064124 +0000 UTC m=+41.406453267" Sep 18 04:07:32.805706 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.805673 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-krnws"] Sep 18 04:07:32.829652 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.829614 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-krnws"] Sep 18 04:07:32.829810 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.829713 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:32.832245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.832216 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 04:07:32.832245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.832234 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 04:07:32.832245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.832248 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 04:07:32.832464 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.832278 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-75zfv\"" Sep 18 04:07:32.832464 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.832225 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 04:07:32.997183 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.997145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97cp\" (UniqueName: \"kubernetes.io/projected/83ce9a45-e87c-4c3b-ab37-1fe146212a66-kube-api-access-j97cp\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:32.997360 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.997248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/83ce9a45-e87c-4c3b-ab37-1fe146212a66-signing-key\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:32.997360 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:32.997345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/83ce9a45-e87c-4c3b-ab37-1fe146212a66-signing-cabundle\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.098091 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.098055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97cp\" (UniqueName: \"kubernetes.io/projected/83ce9a45-e87c-4c3b-ab37-1fe146212a66-kube-api-access-j97cp\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.098307 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.098117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/83ce9a45-e87c-4c3b-ab37-1fe146212a66-signing-key\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.098366 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.098336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/83ce9a45-e87c-4c3b-ab37-1fe146212a66-signing-cabundle\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.099116 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.099087 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/83ce9a45-e87c-4c3b-ab37-1fe146212a66-signing-cabundle\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.102668 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.102645 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/83ce9a45-e87c-4c3b-ab37-1fe146212a66-signing-key\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.106474 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.106451 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97cp\" (UniqueName: \"kubernetes.io/projected/83ce9a45-e87c-4c3b-ab37-1fe146212a66-kube-api-access-j97cp\") pod \"service-ca-55f6fc7b86-krnws\" (UID: \"83ce9a45-e87c-4c3b-ab37-1fe146212a66\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.123704 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.123679 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nkhgd_d0b951b1-163f-4376-8992-875ad0219de6/node-ca/0.log" Sep 18 04:07:33.139201 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.139179 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" Sep 18 04:07:33.453021 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.452999 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-krnws"] Sep 18 04:07:33.456094 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:33.456072 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ce9a45_e87c_4c3b_ab37_1fe146212a66.slice/crio-5385d75f3c0957de931f56adf7bf9f69011930f62052a5e63742752580044711 WatchSource:0}: Error finding container 5385d75f3c0957de931f56adf7bf9f69011930f62052a5e63742752580044711: Status 404 returned error can't find the container with id 5385d75f3c0957de931f56adf7bf9f69011930f62052a5e63742752580044711 Sep 18 04:07:33.623594 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.623557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" event={"ID":"4a257edd-e624-4e75-a373-c3412bcc205c","Type":"ContainerStarted","Data":"e14794acf95ba735a1de3c95d30e8fa9bbfe3971ce5fd143d2abca300508c48e"} Sep 18 04:07:33.623974 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.623655 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" event={"ID":"4a257edd-e624-4e75-a373-c3412bcc205c","Type":"ContainerStarted","Data":"8819889cc605ebb93f548de9c9314feca2f5ae83a584d0e4e231b883a7a56910"} Sep 18 04:07:33.624918 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.624885 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" event={"ID":"83ce9a45-e87c-4c3b-ab37-1fe146212a66","Type":"ContainerStarted","Data":"5385d75f3c0957de931f56adf7bf9f69011930f62052a5e63742752580044711"} Sep 18 04:07:33.639490 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.639447 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tnbbx" podStartSLOduration=2.000612919 podStartE2EDuration="3.639432623s" totalImagesPullingTime="1.638819704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:33.639016578 +0000 UTC m=+42.404828607" watchObservedRunningTime="2026-09-18 04:07:33.639432623 +0000 UTC m=+42.405244645" Sep 18 04:07:33.723502 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.723470 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgx4l_9edb819a-eb6f-4820-aec2-af752857ab8a/serve-healthcheck-canary/0.log" Sep 18 04:07:33.903696 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.903652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:33.903696 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:33.903699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:33.903924 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:33.903766 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:07:33.903924 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:33.903793 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:07:33.903924 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:33.903835 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:37.903818132 +0000 UTC m=+46.669630137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : configmap "kube-rbac-proxy" not found Sep 18 04:07:33.903924 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:33.903849 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:37.903843488 +0000 UTC m=+46.669655493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : secret "insights-runtime-extractor-tls" not found Sep 18 04:07:34.408062 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:34.408026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:34.408248 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:34.408208 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:07:34.408382 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:34.408281 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls podName:0e8bf73c-719d-4d6a-90ab-1738f48d77f0 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:42.408261786 +0000 UTC m=+51.174073812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls") pod "dns-default-lv9jw" (UID: "0e8bf73c-719d-4d6a-90ab-1738f48d77f0") : secret "dns-default-metrics-tls" not found Sep 18 04:07:35.631939 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:35.631911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" event={"ID":"83ce9a45-e87c-4c3b-ab37-1fe146212a66","Type":"ContainerStarted","Data":"a9353d124d64fc5eafd3601b9d270b17cdb79b991ffb2b01042022616ba02b34"} Sep 18 04:07:35.650844 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:35.650793 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-krnws" podStartSLOduration=1.53557701 podStartE2EDuration="3.650777695s" totalImagesPullingTime="2.115200685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:35.650194104 +0000 UTC m=+44.416006134" watchObservedRunningTime="2026-09-18 04:07:35.650777695 +0000 UTC m=+44.416589722" Sep 18 04:07:37.938051 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:37.938010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:37.938509 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:37.938158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:37.938509 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:37.938190 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:07:37.938509 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:37.938246 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:07:37.938509 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:37.938271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:45.938251043 +0000 UTC m=+54.704063055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : secret "insights-runtime-extractor-tls" not found Sep 18 04:07:37.938509 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:37.938307 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:07:45.938291337 +0000 UTC m=+54.704103348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : configmap "kube-rbac-proxy" not found Sep 18 04:07:42.470988 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:42.470952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:42.473171 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:42.473148 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8bf73c-719d-4d6a-90ab-1738f48d77f0-metrics-tls\") pod \"dns-default-lv9jw\" (UID: \"0e8bf73c-719d-4d6a-90ab-1738f48d77f0\") " pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:42.578049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:42.578014 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:42.844058 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:42.843975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lv9jw"] Sep 18 04:07:42.848551 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:42.848524 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8bf73c_719d_4d6a_90ab_1738f48d77f0.slice/crio-38bf9124c4c4080b1bf93c7893b96509b33f77f47d9dfb6ee63a7c8e0e147683 WatchSource:0}: Error finding container 38bf9124c4c4080b1bf93c7893b96509b33f77f47d9dfb6ee63a7c8e0e147683: Status 404 returned error can't find the container with id 38bf9124c4c4080b1bf93c7893b96509b33f77f47d9dfb6ee63a7c8e0e147683 Sep 18 04:07:43.654840 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:43.654799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lv9jw" event={"ID":"0e8bf73c-719d-4d6a-90ab-1738f48d77f0","Type":"ContainerStarted","Data":"38bf9124c4c4080b1bf93c7893b96509b33f77f47d9dfb6ee63a7c8e0e147683"} Sep 18 04:07:45.663374 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.663329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lv9jw" event={"ID":"0e8bf73c-719d-4d6a-90ab-1738f48d77f0","Type":"ContainerStarted","Data":"54f4b8afc0d92baf413befba6d80b5f4a75fda6e43d161fce9c94123351186b5"} Sep 18 04:07:45.663801 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.663395 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lv9jw" event={"ID":"0e8bf73c-719d-4d6a-90ab-1738f48d77f0","Type":"ContainerStarted","Data":"2447d528f3669007a075705cdd65b457046f493a6d6fbe3e394f3cba8a43474b"} Sep 18 04:07:45.663801 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.663465 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:45.682219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.682169 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lv9jw" podStartSLOduration=17.370101579 podStartE2EDuration="19.682154374s" totalImagesPullingTime="2.312052795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:45.681325939 +0000 UTC m=+54.447137966" watchObservedRunningTime="2026-09-18 04:07:45.682154374 +0000 UTC m=+54.447966401" Sep 18 04:07:45.998528 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.998488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:45.998689 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.998536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:45.998689 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:45.998665 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:07:45.998809 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:07:45.998730 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls podName:be87ffa2-f151-462c-a8e0-82642ff66781 nodeName:}" failed. No retries permitted until 2026-09-18 04:08:01.998714991 +0000 UTC m=+70.764526998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zd9lc" (UID: "be87ffa2-f151-462c-a8e0-82642ff66781") : secret "insights-runtime-extractor-tls" not found Sep 18 04:07:45.999085 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:45.999060 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be87ffa2-f151-462c-a8e0-82642ff66781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:07:51.587365 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.587329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6hbz" Sep 18 04:07:51.650474 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.650436 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh"] Sep 18 04:07:51.671446 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.671420 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf"] Sep 18 04:07:51.671606 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.671574 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.674007 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.673984 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fxmp6\"" Sep 18 04:07:51.674491 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.674466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 04:07:51.674622 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.674548 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 18 04:07:51.674883 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.674860 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 04:07:51.674962 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.674869 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 04:07:51.683057 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.683037 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh"] Sep 18 04:07:51.683154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.683063 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf"] Sep 18 04:07:51.683154 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.683145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.686027 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.686008 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 04:07:51.686027 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.686020 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 04:07:51.686196 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.686087 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 04:07:51.686482 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.686467 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 04:07:51.736882 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.736856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-ca\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.737000 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.736887 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7qwj\" (UniqueName: \"kubernetes.io/projected/75a8350b-8f62-41cc-9953-c67eac69efc0-kube-api-access-g7qwj\") pod \"managed-serviceaccount-addon-agent-8568dd5484-l4zbh\" (UID: \"75a8350b-8f62-41cc-9953-c67eac69efc0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.737000 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.736905 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5ss\" (UniqueName: \"kubernetes.io/projected/006e3039-330d-4239-80b1-7c3002a79615-kube-api-access-bs5ss\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.737000 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.736970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.737151 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.737006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/006e3039-330d-4239-80b1-7c3002a79615-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.737151 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.737038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.737151 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.737057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75a8350b-8f62-41cc-9953-c67eac69efc0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8568dd5484-l4zbh\" (UID: \"75a8350b-8f62-41cc-9953-c67eac69efc0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.737151 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.737094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-hub\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.837891 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.837821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-hub\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.837891 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.837854 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-ca\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.837891 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.837887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7qwj\" (UniqueName: \"kubernetes.io/projected/75a8350b-8f62-41cc-9953-c67eac69efc0-kube-api-access-g7qwj\") pod \"managed-serviceaccount-addon-agent-8568dd5484-l4zbh\" (UID: \"75a8350b-8f62-41cc-9953-c67eac69efc0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.838156 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.837913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5ss\" (UniqueName: \"kubernetes.io/projected/006e3039-330d-4239-80b1-7c3002a79615-kube-api-access-bs5ss\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.838156 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.837961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.838156 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.838005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/006e3039-330d-4239-80b1-7c3002a79615-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.838315 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.838184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.838315 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.838222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75a8350b-8f62-41cc-9953-c67eac69efc0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8568dd5484-l4zbh\" (UID: \"75a8350b-8f62-41cc-9953-c67eac69efc0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.838764 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.838739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/006e3039-330d-4239-80b1-7c3002a79615-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.840616 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.840589 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-ca\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.840738 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.840704 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.840833 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.840806 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75a8350b-8f62-41cc-9953-c67eac69efc0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8568dd5484-l4zbh\" (UID: \"75a8350b-8f62-41cc-9953-c67eac69efc0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.840940 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.840920 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.840989 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.840943 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/006e3039-330d-4239-80b1-7c3002a79615-hub\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.846777 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.846756 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7qwj\" (UniqueName: \"kubernetes.io/projected/75a8350b-8f62-41cc-9953-c67eac69efc0-kube-api-access-g7qwj\") pod \"managed-serviceaccount-addon-agent-8568dd5484-l4zbh\" (UID: \"75a8350b-8f62-41cc-9953-c67eac69efc0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.847901 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.847879 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5ss\" (UniqueName: \"kubernetes.io/projected/006e3039-330d-4239-80b1-7c3002a79615-kube-api-access-bs5ss\") pod \"cluster-proxy-proxy-agent-cd5554f69-jlwkf\" (UID: \"006e3039-330d-4239-80b1-7c3002a79615\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:51.988933 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.988905 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" Sep 18 04:07:51.995055 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:51.995029 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" Sep 18 04:07:52.287034 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:52.287002 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh"] Sep 18 04:07:52.289528 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:52.289496 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75a8350b_8f62_41cc_9953_c67eac69efc0.slice/crio-7bbcb9e4b92fdf3e2506d89ad0eac20482b2e05ea35df80f190696ec4ddbee95 WatchSource:0}: Error finding container 7bbcb9e4b92fdf3e2506d89ad0eac20482b2e05ea35df80f190696ec4ddbee95: Status 404 returned error can't find the container with id 7bbcb9e4b92fdf3e2506d89ad0eac20482b2e05ea35df80f190696ec4ddbee95 Sep 18 04:07:52.320373 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:52.320341 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf"] Sep 18 04:07:52.323430 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:52.323404 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod006e3039_330d_4239_80b1_7c3002a79615.slice/crio-cb08940eaecca57e6fc98480319088511349785030123222cc4c5061ad501920 WatchSource:0}: Error finding container cb08940eaecca57e6fc98480319088511349785030123222cc4c5061ad501920: Status 404 returned error can't find the container with id cb08940eaecca57e6fc98480319088511349785030123222cc4c5061ad501920 Sep 18 04:07:52.684551 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:52.684514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" event={"ID":"006e3039-330d-4239-80b1-7c3002a79615","Type":"ContainerStarted","Data":"cb08940eaecca57e6fc98480319088511349785030123222cc4c5061ad501920"} Sep 18 04:07:52.685595 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:52.685572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" event={"ID":"75a8350b-8f62-41cc-9953-c67eac69efc0","Type":"ContainerStarted","Data":"7bbcb9e4b92fdf3e2506d89ad0eac20482b2e05ea35df80f190696ec4ddbee95"} Sep 18 04:07:55.669312 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:55.669266 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lv9jw" Sep 18 04:07:55.699162 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:55.699061 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" event={"ID":"75a8350b-8f62-41cc-9953-c67eac69efc0","Type":"ContainerStarted","Data":"bf46b4b299940b520f2357d2df27db18aac1422f5c99f4bbb9b3e62f72e6f260"} Sep 18 04:07:55.715027 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:55.714969 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8568dd5484-l4zbh" podStartSLOduration=1.846068528 podStartE2EDuration="4.714951009s" totalImagesPullingTime="2.868882481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:55.71362105 +0000 UTC m=+64.479433077" watchObservedRunningTime="2026-09-18 04:07:55.714951009 +0000 UTC m=+64.480763038" Sep 18 04:07:56.703770 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:56.703741 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" event={"ID":"006e3039-330d-4239-80b1-7c3002a79615","Type":"ContainerStarted","Data":"9264493ba7a6fc848b141c38ea1304057d2141b8496d5ffc2cb80ba3b5bfc92f"} Sep 18 04:07:56.704178 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:56.703784 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" event={"ID":"006e3039-330d-4239-80b1-7c3002a79615","Type":"ContainerStarted","Data":"65bf7452b5cb875a84103bf3bb2f8f9372fa4391941102b8830c546db493d24c"} Sep 18 04:07:57.709078 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:57.709037 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" event={"ID":"006e3039-330d-4239-80b1-7c3002a79615","Type":"ContainerStarted","Data":"dbca04ed98bfb3c53773f86ed30b7fbd4c1f6b0c98d880795aed67c903b670bd"} Sep 18 04:07:58.995017 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:58.994973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:58.995017 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:58.995018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:58.997787 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:58.997767 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 04:07:58.998737 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:58.998723 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 04:07:59.007869 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.007846 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cbd097f-667b-4edf-a3fd-f8db1971b314-metrics-certs\") pod \"network-metrics-daemon-k8j66\" (UID: \"5cbd097f-667b-4edf-a3fd-f8db1971b314\") " pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:59.007984 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.007964 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a823d1f9-c5bd-4ac9-924b-de7cf049c1e5-original-pull-secret\") pod \"global-pull-secret-syncer-6lctk\" (UID: \"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5\") " pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:59.096304 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.096272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:59.098817 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.098801 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 04:07:59.108928 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.108911 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 04:07:59.119075 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.119054 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5jz\" (UniqueName: \"kubernetes.io/projected/aee70705-d493-48e8-8702-dbd968534c55-kube-api-access-bb5jz\") pod \"network-check-target-nwjpx\" (UID: \"aee70705-d493-48e8-8702-dbd968534c55\") " pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:59.253464 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.253391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lctk" Sep 18 04:07:59.261847 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.261828 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mt76n\"" Sep 18 04:07:59.267996 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.267977 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cw2bm\"" Sep 18 04:07:59.269565 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.269552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k8j66" Sep 18 04:07:59.276782 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.276766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:07:59.545943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.545843 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd5554f69-jlwkf" podStartSLOduration=4.315514539 podStartE2EDuration="8.545822195s" totalImagesPullingTime="4.230307656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:07:57.748900794 +0000 UTC m=+66.514712821" watchObservedRunningTime="2026-09-18 04:07:59.545822195 +0000 UTC m=+68.311634223" Sep 18 04:07:59.546376 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.546355 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lctk"] Sep 18 04:07:59.549371 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:59.549344 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda823d1f9_c5bd_4ac9_924b_de7cf049c1e5.slice/crio-25301beac1eebe31c239a1d2943898b1d5c63464984b7fc57f8cf89cacf94b34 WatchSource:0}: Error finding container 25301beac1eebe31c239a1d2943898b1d5c63464984b7fc57f8cf89cacf94b34: Status 404 returned error can't find the container with id 25301beac1eebe31c239a1d2943898b1d5c63464984b7fc57f8cf89cacf94b34 Sep 18 04:07:59.584246 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.584205 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k8j66"] Sep 18 04:07:59.587169 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:59.587139 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbd097f_667b_4edf_a3fd_f8db1971b314.slice/crio-1041f4ffcf2b59bb3d910be313e675ec19998847bd4af224cec7b029271d87b1 WatchSource:0}: Error finding container 1041f4ffcf2b59bb3d910be313e675ec19998847bd4af224cec7b029271d87b1: Status 404 returned error can't find the container with id 1041f4ffcf2b59bb3d910be313e675ec19998847bd4af224cec7b029271d87b1 Sep 18 04:07:59.634464 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.634416 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nwjpx"] Sep 18 04:07:59.636949 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:07:59.636917 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee70705_d493_48e8_8702_dbd968534c55.slice/crio-e5ce902dc6679b1f93d3b3f11357d5bd065e3cf33439cccd3bef025cf4529a50 WatchSource:0}: Error finding container e5ce902dc6679b1f93d3b3f11357d5bd065e3cf33439cccd3bef025cf4529a50: Status 404 returned error can't find the container with id e5ce902dc6679b1f93d3b3f11357d5bd065e3cf33439cccd3bef025cf4529a50 Sep 18 04:07:59.715497 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.715468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lctk" event={"ID":"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5","Type":"ContainerStarted","Data":"25301beac1eebe31c239a1d2943898b1d5c63464984b7fc57f8cf89cacf94b34"} Sep 18 04:07:59.716622 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.716593 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k8j66" event={"ID":"5cbd097f-667b-4edf-a3fd-f8db1971b314","Type":"ContainerStarted","Data":"1041f4ffcf2b59bb3d910be313e675ec19998847bd4af224cec7b029271d87b1"} Sep 18 04:07:59.717728 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:07:59.717707 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nwjpx" event={"ID":"aee70705-d493-48e8-8702-dbd968534c55","Type":"ContainerStarted","Data":"e5ce902dc6679b1f93d3b3f11357d5bd065e3cf33439cccd3bef025cf4529a50"} Sep 18 04:08:01.727676 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:01.727169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k8j66" event={"ID":"5cbd097f-667b-4edf-a3fd-f8db1971b314","Type":"ContainerStarted","Data":"64ff0399fa7cde2c2423dbb5bd1fd906562284ecee6b64a1f09a9376dc83c380"} Sep 18 04:08:01.727676 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:01.727252 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k8j66" event={"ID":"5cbd097f-667b-4edf-a3fd-f8db1971b314","Type":"ContainerStarted","Data":"b766a920abd7ee187bf5484bee49f417c9ddc93b92e35c60cd1340c5c0cc579b"} Sep 18 04:08:01.744194 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:01.744119 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k8j66" podStartSLOduration=67.619173548 podStartE2EDuration="1m8.744102463s" totalImagesPullingTime="1.124928915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:01.743205856 +0000 UTC m=+70.509017885" watchObservedRunningTime="2026-09-18 04:08:01.744102463 +0000 UTC m=+70.509914491" Sep 18 04:08:02.018549 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:02.018465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:08:02.021216 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:02.021163 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be87ffa2-f151-462c-a8e0-82642ff66781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zd9lc\" (UID: \"be87ffa2-f151-462c-a8e0-82642ff66781\") " pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:08:02.305618 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:02.305535 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s75gn\"" Sep 18 04:08:02.314082 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:02.314051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zd9lc" Sep 18 04:08:04.469459 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.469426 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zd9lc"] Sep 18 04:08:04.472117 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:08:04.472090 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe87ffa2_f151_462c_a8e0_82642ff66781.slice/crio-c91ef68efc3bb050d92af7401a192d7f1a43c808f0da713b356b8b16ab9cd5ae WatchSource:0}: Error finding container c91ef68efc3bb050d92af7401a192d7f1a43c808f0da713b356b8b16ab9cd5ae: Status 404 returned error can't find the container with id c91ef68efc3bb050d92af7401a192d7f1a43c808f0da713b356b8b16ab9cd5ae Sep 18 04:08:04.738540 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.738449 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nwjpx" event={"ID":"aee70705-d493-48e8-8702-dbd968534c55","Type":"ContainerStarted","Data":"8f3d0b87073b1f9e5b025eae4a6a02de1f9f3ef6cfe71fa3dc0e84bb4a10274e"} Sep 18 04:08:04.738679 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.738543 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:08:04.740079 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.740051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zd9lc" event={"ID":"be87ffa2-f151-462c-a8e0-82642ff66781","Type":"ContainerStarted","Data":"845a3deadc9238b63a83ba498450aba5c829016ed11a51aed2fb342ac913744a"} Sep 18 04:08:04.740268 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.740101 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zd9lc" event={"ID":"be87ffa2-f151-462c-a8e0-82642ff66781","Type":"ContainerStarted","Data":"c91ef68efc3bb050d92af7401a192d7f1a43c808f0da713b356b8b16ab9cd5ae"} Sep 18 04:08:04.741431 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.741406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lctk" event={"ID":"a823d1f9-c5bd-4ac9-924b-de7cf049c1e5","Type":"ContainerStarted","Data":"42b81ef242192205ae25843d207b0860994bdffd96ece2fe5b91b12abc408de7"} Sep 18 04:08:04.755499 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.755457 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nwjpx" podStartSLOduration=67.183636365 podStartE2EDuration="1m11.755442072s" totalImagesPullingTime="4.571805707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:04.754898521 +0000 UTC m=+73.520710540" watchObservedRunningTime="2026-09-18 04:08:04.755442072 +0000 UTC m=+73.521254099" Sep 18 04:08:04.770116 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:04.770065 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6lctk" podStartSLOduration=67.101443163 podStartE2EDuration="1m11.770045204s" totalImagesPullingTime="4.668602041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:04.769749089 +0000 UTC m=+73.535561119" watchObservedRunningTime="2026-09-18 04:08:04.770045204 +0000 UTC m=+73.535857233" Sep 18 04:08:05.748066 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:05.748025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zd9lc" event={"ID":"be87ffa2-f151-462c-a8e0-82642ff66781","Type":"ContainerStarted","Data":"165f2066cb433117a74edf64168755b852f5d741a39486ab49f18d5f50b1c7e7"} Sep 18 04:08:07.755920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:07.755881 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zd9lc" event={"ID":"be87ffa2-f151-462c-a8e0-82642ff66781","Type":"ContainerStarted","Data":"8115807e58cdec5b4c44921155b09bf73ea139c6ea2b10c3dcd8f40156a731aa"} Sep 18 04:08:07.776010 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:07.775963 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zd9lc" podStartSLOduration=35.541165698 podStartE2EDuration="37.775944899s" totalImagesPullingTime="2.234779201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:07:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:07.774147268 +0000 UTC m=+76.539959294" watchObservedRunningTime="2026-09-18 04:08:07.775944899 +0000 UTC m=+76.541756926" Sep 18 04:08:24.811841 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.811810 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cnbd7"] Sep 18 04:08:24.815401 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.815380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.817903 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.817882 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 04:08:24.818024 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.817907 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 04:08:24.818024 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.817984 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2wxtl\"" Sep 18 04:08:24.818986 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.818840 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 04:08:24.818986 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.818868 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 04:08:24.818986 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.818881 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 04:08:24.818986 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.818898 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 04:08:24.879314 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-tls\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879314 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-sys\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-textfile\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpk8q\" (UniqueName: \"kubernetes.io/projected/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-kube-api-access-gpk8q\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-wtmp\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-metrics-client-ca\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879494 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-root\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.879530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.879523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980592 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-wtmp\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980721 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-metrics-client-ca\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980721 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-root\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980721 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980721 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-tls\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-sys\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-wtmp\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980746 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-root\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-textfile\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980787 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-sys\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.980844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpk8q\" (UniqueName: \"kubernetes.io/projected/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-kube-api-access-gpk8q\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.980920 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:08:24.980855 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 04:08:24.981338 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:08:24.980927 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-tls podName:25136a5c-6723-4547-8e8a-71e2bbfeb3a6 nodeName:}" failed. No retries permitted until 2026-09-18 04:08:25.480907107 +0000 UTC m=+94.246719131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-tls") pod "node-exporter-cnbd7" (UID: "25136a5c-6723-4547-8e8a-71e2bbfeb3a6") : secret "node-exporter-tls" not found Sep 18 04:08:24.981338 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.981071 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-textfile\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.981338 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.981237 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-metrics-client-ca\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.981621 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.981603 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.983015 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.982996 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:24.992478 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:24.992453 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpk8q\" (UniqueName: \"kubernetes.io/projected/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-kube-api-access-gpk8q\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:25.485496 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:25.485456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-tls\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:25.487825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:25.487801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25136a5c-6723-4547-8e8a-71e2bbfeb3a6-node-exporter-tls\") pod \"node-exporter-cnbd7\" (UID: \"25136a5c-6723-4547-8e8a-71e2bbfeb3a6\") " pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:25.725419 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:25.725387 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnbd7" Sep 18 04:08:25.737012 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:08:25.736934 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25136a5c_6723_4547_8e8a_71e2bbfeb3a6.slice/crio-a7734c2e43925244bc62ed5f5a148dea65ed012bc1e13472bbd0c43c1feb7ec9 WatchSource:0}: Error finding container a7734c2e43925244bc62ed5f5a148dea65ed012bc1e13472bbd0c43c1feb7ec9: Status 404 returned error can't find the container with id a7734c2e43925244bc62ed5f5a148dea65ed012bc1e13472bbd0c43c1feb7ec9 Sep 18 04:08:25.817325 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:25.817293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnbd7" event={"ID":"25136a5c-6723-4547-8e8a-71e2bbfeb3a6","Type":"ContainerStarted","Data":"a7734c2e43925244bc62ed5f5a148dea65ed012bc1e13472bbd0c43c1feb7ec9"} Sep 18 04:08:27.831738 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:27.831697 2560 generic.go:356] "Generic (PLEG): container finished" podID="25136a5c-6723-4547-8e8a-71e2bbfeb3a6" containerID="2606c75adfcfd2cc1c469f387cd3d91f41467360360650ac639653b54c1fefce" exitCode=0 Sep 18 04:08:27.832243 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:27.831768 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnbd7" event={"ID":"25136a5c-6723-4547-8e8a-71e2bbfeb3a6","Type":"ContainerDied","Data":"2606c75adfcfd2cc1c469f387cd3d91f41467360360650ac639653b54c1fefce"} Sep 18 04:08:28.837704 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:28.837668 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnbd7" event={"ID":"25136a5c-6723-4547-8e8a-71e2bbfeb3a6","Type":"ContainerStarted","Data":"cf9b8e61e1ed41e5fe737a042a4114dd35e25442b84d7247e9fe5a5b7f2eadda"} Sep 18 04:08:28.838088 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:28.837721 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnbd7" event={"ID":"25136a5c-6723-4547-8e8a-71e2bbfeb3a6","Type":"ContainerStarted","Data":"fe5528abf961058ae1c55149b7a0c277e83bce47b853bc7d19f55e4b935ccbfd"} Sep 18 04:08:28.857554 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:28.857506 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cnbd7" podStartSLOduration=3.766879583 podStartE2EDuration="4.857491553s" totalImagesPullingTime="1.030723373s" totalInitContainerRuntime="59.888597ms" isStatefulPod=true podCreationTimestamp="2026-09-18 04:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:08:28.856377638 +0000 UTC m=+97.622189666" watchObservedRunningTime="2026-09-18 04:08:28.857491553 +0000 UTC m=+97.623303610" Sep 18 04:08:35.750977 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:08:35.750945 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nwjpx" Sep 18 04:10:53.810330 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.810299 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz"] Sep 18 04:10:53.812644 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.812625 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:53.815254 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.815231 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fvctb\"" Sep 18 04:10:53.815348 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.815238 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 04:10:53.816245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.816221 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 04:10:53.823417 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.823391 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz"] Sep 18 04:10:53.978788 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.978742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:53.978788 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.978789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:53.978997 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:53.978810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnv8\" (UniqueName: \"kubernetes.io/projected/f27ff4c7-404b-403e-94a0-40eb82cc63ae-kube-api-access-8tnv8\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.079846 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.079755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.079846 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.079796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.079846 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.079819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnv8\" (UniqueName: \"kubernetes.io/projected/f27ff4c7-404b-403e-94a0-40eb82cc63ae-kube-api-access-8tnv8\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.080214 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.080191 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.080299 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.080271 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.089205 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.089185 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnv8\" (UniqueName: \"kubernetes.io/projected/f27ff4c7-404b-403e-94a0-40eb82cc63ae-kube-api-access-8tnv8\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.121152 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.121110 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:10:54.387520 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:54.387418 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz"] Sep 18 04:10:54.389993 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:10:54.389964 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27ff4c7_404b_403e_94a0_40eb82cc63ae.slice/crio-1dc61330b1b3ab7b22da95442708b8fe0d9b9edaf2b2c6010c57bc7154f2a9ec WatchSource:0}: Error finding container 1dc61330b1b3ab7b22da95442708b8fe0d9b9edaf2b2c6010c57bc7154f2a9ec: Status 404 returned error can't find the container with id 1dc61330b1b3ab7b22da95442708b8fe0d9b9edaf2b2c6010c57bc7154f2a9ec Sep 18 04:10:55.316527 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:55.316486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" event={"ID":"f27ff4c7-404b-403e-94a0-40eb82cc63ae","Type":"ContainerStarted","Data":"1dc61330b1b3ab7b22da95442708b8fe0d9b9edaf2b2c6010c57bc7154f2a9ec"} Sep 18 04:10:56.683974 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.683945 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p"] Sep 18 04:10:56.686186 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.686167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.697033 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.696974 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p"] Sep 18 04:10:56.782204 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.782169 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww"] Sep 18 04:10:56.784607 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.784570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:56.793197 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.793154 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww"] Sep 18 04:10:56.802274 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.802247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.802396 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.802289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknx4\" (UniqueName: \"kubernetes.io/projected/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-kube-api-access-vknx4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.802396 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.802331 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.886765 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.886729 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz"] Sep 18 04:10:56.889400 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.889371 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:56.898307 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.898247 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz"] Sep 18 04:10:56.903417 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.903539 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknx4\" (UniqueName: \"kubernetes.io/projected/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-kube-api-access-vknx4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.903539 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.903657 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:56.903657 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:56.903732 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp88x\" (UniqueName: \"kubernetes.io/projected/651a4ada-4c86-42b3-8d73-2781e5d6b09f-kube-api-access-mp88x\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:56.903833 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903810 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.903872 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.903833 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.912218 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.912194 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknx4\" (UniqueName: \"kubernetes.io/projected/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-kube-api-access-vknx4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:56.996869 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:56.996838 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:10:57.004466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.004602 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.004602 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.004602 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.004780 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxbr\" (UniqueName: \"kubernetes.io/projected/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-kube-api-access-6qxbr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.004780 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp88x\" (UniqueName: \"kubernetes.io/projected/651a4ada-4c86-42b3-8d73-2781e5d6b09f-kube-api-access-mp88x\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.004884 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004861 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.005022 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.004989 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.013624 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.013592 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp88x\" (UniqueName: \"kubernetes.io/projected/651a4ada-4c86-42b3-8d73-2781e5d6b09f-kube-api-access-mp88x\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.095507 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.095477 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:10:57.105496 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.105469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.105603 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.105518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.105939 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.105914 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.106016 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.105937 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.106016 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.105988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxbr\" (UniqueName: \"kubernetes.io/projected/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-kube-api-access-6qxbr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.117780 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.117739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxbr\" (UniqueName: \"kubernetes.io/projected/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-kube-api-access-6qxbr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.200635 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.200604 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:10:57.286869 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.286831 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p"] Sep 18 04:10:57.288820 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:10:57.288787 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacdb8ae7_72c6_4f4b_9279_ef9cbd40bf0b.slice/crio-a7fec5a6206ecf9294c4977a5491874d6ffa7e9535e52fe17377d2c212594db9 WatchSource:0}: Error finding container a7fec5a6206ecf9294c4977a5491874d6ffa7e9535e52fe17377d2c212594db9: Status 404 returned error can't find the container with id a7fec5a6206ecf9294c4977a5491874d6ffa7e9535e52fe17377d2c212594db9 Sep 18 04:10:57.325490 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.325458 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" event={"ID":"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b","Type":"ContainerStarted","Data":"a7fec5a6206ecf9294c4977a5491874d6ffa7e9535e52fe17377d2c212594db9"} Sep 18 04:10:57.373807 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.373776 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww"] Sep 18 04:10:57.376743 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:10:57.376715 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651a4ada_4c86_42b3_8d73_2781e5d6b09f.slice/crio-1eb260c0df23348e55ce6c732ebe989f4c4417c41862e137ae07c6cae9c7cf61 WatchSource:0}: Error finding container 1eb260c0df23348e55ce6c732ebe989f4c4417c41862e137ae07c6cae9c7cf61: Status 404 returned error can't find the container with id 1eb260c0df23348e55ce6c732ebe989f4c4417c41862e137ae07c6cae9c7cf61 Sep 18 04:10:57.475148 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:57.475102 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz"] Sep 18 04:10:58.336989 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.336951 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2"] Sep 18 04:10:58.341599 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.341567 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" event={"ID":"651a4ada-4c86-42b3-8d73-2781e5d6b09f","Type":"ContainerStarted","Data":"1eb260c0df23348e55ce6c732ebe989f4c4417c41862e137ae07c6cae9c7cf61"} Sep 18 04:10:58.341723 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.341694 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.344905 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.344574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9pcdr\"" Sep 18 04:10:58.344905 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.344710 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 04:10:58.344905 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.344783 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 04:10:58.345456 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.345437 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 04:10:58.352618 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.352595 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2"] Sep 18 04:10:58.519458 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519635 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519635 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbade2df-4441-4eb8-af82-15788312c767-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519635 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbade2df-4441-4eb8-af82-15788312c767-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519635 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519823 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519823 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qq75\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-kube-api-access-5qq75\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519823 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.519823 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.519768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.620807 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.620807 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbade2df-4441-4eb8-af82-15788312c767-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbade2df-4441-4eb8-af82-15788312c767-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qq75\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-kube-api-access-5qq75\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.620989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621049 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.621011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621408 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.621228 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621408 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.621242 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621519 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.621413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.621574 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.621531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.622142 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.622087 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbade2df-4441-4eb8-af82-15788312c767-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.623722 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.623697 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.624242 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.624215 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbade2df-4441-4eb8-af82-15788312c767-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.631695 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.631669 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.633043 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.633022 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qq75\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-kube-api-access-5qq75\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-87cd2\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.655406 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.655371 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:10:58.709540 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.709496 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb"] Sep 18 04:10:58.712031 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.712000 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.715041 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.715010 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-2g8q8\"" Sep 18 04:10:58.727491 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.727453 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb"] Sep 18 04:10:58.822797 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.822747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.822797 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.822797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823024 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.822868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823024 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.822944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5lfz\" (UniqueName: \"kubernetes.io/projected/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-kube-api-access-c5lfz\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823024 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.822967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823158 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.823046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823158 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.823067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823158 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.823107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.823299 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.823158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.923941 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.923854 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.923941 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.923903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.923941 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.923941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924227 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.923987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924227 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924227 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924049 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924227 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5lfz\" (UniqueName: \"kubernetes.io/projected/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-kube-api-access-c5lfz\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924227 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924227 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924216 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924515 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924379 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924515 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924447 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924628 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924553 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.924628 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.924615 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.925139 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.925095 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.926581 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.926558 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.926770 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.926749 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.932904 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.932733 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:58.933239 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:58.933193 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5lfz\" (UniqueName: \"kubernetes.io/projected/1e5a8eb1-e04a-4c4b-80be-13d296147a9c-kube-api-access-c5lfz\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb\" (UID: \"1e5a8eb1-e04a-4c4b-80be-13d296147a9c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:59.025569 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:59.025532 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:10:59.373804 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:10:59.373767 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c11eff4_dafb_4057_919c_8d48e9d0aa2d.slice/crio-ede7802f29b3bbd8f7138269297c8d641138d055d7b491447869600a1cf16ee1 WatchSource:0}: Error finding container ede7802f29b3bbd8f7138269297c8d641138d055d7b491447869600a1cf16ee1: Status 404 returned error can't find the container with id ede7802f29b3bbd8f7138269297c8d641138d055d7b491447869600a1cf16ee1 Sep 18 04:10:59.650631 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:59.650532 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb"] Sep 18 04:10:59.653623 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:10:59.653606 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2"] Sep 18 04:10:59.685114 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:10:59.685085 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbade2df_4441_4eb8_af82_15788312c767.slice/crio-7914340f334888c998c671b87dc743b45c5021d52ddb8f9a8e99e1718839dfc9 WatchSource:0}: Error finding container 7914340f334888c998c671b87dc743b45c5021d52ddb8f9a8e99e1718839dfc9: Status 404 returned error can't find the container with id 7914340f334888c998c671b87dc743b45c5021d52ddb8f9a8e99e1718839dfc9 Sep 18 04:10:59.698893 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:10:59.698866 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5a8eb1_e04a_4c4b_80be_13d296147a9c.slice/crio-8f3dd66647f6eeb388be9b482806c64c3517ff49f01f4f48c2e067947265d125 WatchSource:0}: Error finding container 8f3dd66647f6eeb388be9b482806c64c3517ff49f01f4f48c2e067947265d125: Status 404 returned error can't find the container with id 8f3dd66647f6eeb388be9b482806c64c3517ff49f01f4f48c2e067947265d125 Sep 18 04:11:00.349320 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.349230 2560 generic.go:356] "Generic (PLEG): container finished" podID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerID="55785afc9f243a4a090fbfd8dd322302fdec8ac6375f654ed5bfc715bdff0f4b" exitCode=0 Sep 18 04:11:00.349486 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.349346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" event={"ID":"f27ff4c7-404b-403e-94a0-40eb82cc63ae","Type":"ContainerDied","Data":"55785afc9f243a4a090fbfd8dd322302fdec8ac6375f654ed5bfc715bdff0f4b"} Sep 18 04:11:00.352042 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.351918 2560 generic.go:356] "Generic (PLEG): container finished" podID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerID="dfcf89d4ef2e522f6ab17c9a5f0973d538ca23b32c19b0656c1b9344612ed2d0" exitCode=0 Sep 18 04:11:00.352042 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.351974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" event={"ID":"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b","Type":"ContainerDied","Data":"dfcf89d4ef2e522f6ab17c9a5f0973d538ca23b32c19b0656c1b9344612ed2d0"} Sep 18 04:11:00.353966 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.353940 2560 generic.go:356] "Generic (PLEG): container finished" podID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerID="59ef1e3fd267c7ce41eed62881e960b0d7a69e550b16f16f1419cdfad962c981" exitCode=0 Sep 18 04:11:00.354068 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.354037 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" event={"ID":"651a4ada-4c86-42b3-8d73-2781e5d6b09f","Type":"ContainerDied","Data":"59ef1e3fd267c7ce41eed62881e960b0d7a69e550b16f16f1419cdfad962c981"} Sep 18 04:11:00.356051 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.356018 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" event={"ID":"fbade2df-4441-4eb8-af82-15788312c767","Type":"ContainerStarted","Data":"7914340f334888c998c671b87dc743b45c5021d52ddb8f9a8e99e1718839dfc9"} Sep 18 04:11:00.357994 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.357970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" event={"ID":"1e5a8eb1-e04a-4c4b-80be-13d296147a9c","Type":"ContainerStarted","Data":"8f3dd66647f6eeb388be9b482806c64c3517ff49f01f4f48c2e067947265d125"} Sep 18 04:11:00.360372 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.360344 2560 generic.go:356] "Generic (PLEG): container finished" podID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerID="95e182ae95c48deb248a2c571c355d6a9a57d6fd556b24a9b5ea0626cdb5c3c0" exitCode=0 Sep 18 04:11:00.360460 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.360399 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" event={"ID":"7c11eff4-dafb-4057-919c-8d48e9d0aa2d","Type":"ContainerDied","Data":"95e182ae95c48deb248a2c571c355d6a9a57d6fd556b24a9b5ea0626cdb5c3c0"} Sep 18 04:11:00.360460 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:00.360434 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" event={"ID":"7c11eff4-dafb-4057-919c-8d48e9d0aa2d","Type":"ContainerStarted","Data":"ede7802f29b3bbd8f7138269297c8d641138d055d7b491447869600a1cf16ee1"} Sep 18 04:11:01.365953 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:01.365916 2560 generic.go:356] "Generic (PLEG): container finished" podID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerID="071eb5f9fc7f3b4f5261a130ae00b60f7764b6ca1dd005104c53ae32189c1115" exitCode=0 Sep 18 04:11:01.366394 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:01.365968 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" event={"ID":"f27ff4c7-404b-403e-94a0-40eb82cc63ae","Type":"ContainerDied","Data":"071eb5f9fc7f3b4f5261a130ae00b60f7764b6ca1dd005104c53ae32189c1115"} Sep 18 04:11:02.244303 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.244253 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:02.244423 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.244338 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:02.244423 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.244374 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:02.244423 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.244326 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:02.244547 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.244468 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:02.244547 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.244506 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:02.375332 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.375261 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" event={"ID":"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b","Type":"ContainerStarted","Data":"dcaea2bdf891274ef8f0fa8894e5d6ec5fe514c666734f468f9dcda5a18301ac"} Sep 18 04:11:02.379966 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.379773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" event={"ID":"651a4ada-4c86-42b3-8d73-2781e5d6b09f","Type":"ContainerStarted","Data":"ea9b9e9fcb11b3fb62ad67563a4c18540d43f91c3a8660079c989d1c49c171f8"} Sep 18 04:11:02.383073 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.383021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" event={"ID":"fbade2df-4441-4eb8-af82-15788312c767","Type":"ContainerStarted","Data":"8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335"} Sep 18 04:11:02.387212 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.386601 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" event={"ID":"1e5a8eb1-e04a-4c4b-80be-13d296147a9c","Type":"ContainerStarted","Data":"4b2fec58c94810fde17167372521264cb942d057e9701c588de89d805b88f5ee"} Sep 18 04:11:02.390340 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.390314 2560 generic.go:356] "Generic (PLEG): container finished" podID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerID="e78a0b90a38f7c4de8aac2b854f0916492515628af12c39f998dacef43f66bd8" exitCode=0 Sep 18 04:11:02.390442 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.390362 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" event={"ID":"7c11eff4-dafb-4057-919c-8d48e9d0aa2d","Type":"ContainerDied","Data":"e78a0b90a38f7c4de8aac2b854f0916492515628af12c39f998dacef43f66bd8"} Sep 18 04:11:02.413099 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.413038 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" podStartSLOduration=1.856416727 podStartE2EDuration="4.412991788s" totalImagesPullingTime="2.556575061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:02.411958363 +0000 UTC m=+251.177770402" watchObservedRunningTime="2026-09-18 04:11:02.412991788 +0000 UTC m=+251.178803813" Sep 18 04:11:02.466986 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.466829 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" podStartSLOduration=1.923712487 podStartE2EDuration="4.466813532s" totalImagesPullingTime="2.543101045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:02.464307075 +0000 UTC m=+251.230119104" watchObservedRunningTime="2026-09-18 04:11:02.466813532 +0000 UTC m=+251.232625560" Sep 18 04:11:02.655958 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:02.655916 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:11:03.026724 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.026687 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:11:03.032186 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.032157 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:11:03.397653 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.397569 2560 generic.go:356] "Generic (PLEG): container finished" podID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerID="dcaea2bdf891274ef8f0fa8894e5d6ec5fe514c666734f468f9dcda5a18301ac" exitCode=0 Sep 18 04:11:03.398076 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.397686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" event={"ID":"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b","Type":"ContainerDied","Data":"dcaea2bdf891274ef8f0fa8894e5d6ec5fe514c666734f468f9dcda5a18301ac"} Sep 18 04:11:03.400142 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.400096 2560 generic.go:356] "Generic (PLEG): container finished" podID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerID="ea9b9e9fcb11b3fb62ad67563a4c18540d43f91c3a8660079c989d1c49c171f8" exitCode=0 Sep 18 04:11:03.400331 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.400299 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" event={"ID":"651a4ada-4c86-42b3-8d73-2781e5d6b09f","Type":"ContainerDied","Data":"ea9b9e9fcb11b3fb62ad67563a4c18540d43f91c3a8660079c989d1c49c171f8"} Sep 18 04:11:03.401284 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.400842 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:11:03.402587 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.402567 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb" Sep 18 04:11:03.658213 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.658104 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.17:15021/healthz/ready\": dial tcp 10.134.0.17:15021: connect: connection refused" start-of-body= Sep 18 04:11:03.658213 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:03.658187 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" podUID="fbade2df-4441-4eb8-af82-15788312c767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.17:15021/healthz/ready\": dial tcp 10.134.0.17:15021: connect: connection refused" Sep 18 04:11:04.655819 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:04.655780 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.17:15021/healthz/ready\": dial tcp 10.134.0.17:15021: connect: connection refused" start-of-body= Sep 18 04:11:04.656402 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:04.655852 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" podUID="fbade2df-4441-4eb8-af82-15788312c767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.17:15021/healthz/ready\": dial tcp 10.134.0.17:15021: connect: connection refused" Sep 18 04:11:05.459450 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:05.458436 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2"] Sep 18 04:11:05.459450 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:05.458721 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" podUID="fbade2df-4441-4eb8-af82-15788312c767" containerName="istio-proxy" containerID="cri-o://8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335" gracePeriod=30 Sep 18 04:11:10.448379 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.448346 2560 generic.go:356] "Generic (PLEG): container finished" podID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerID="f65fd9a20484899e9852a0a326bfd840d73e5620597091c76833709813ccef65" exitCode=0 Sep 18 04:11:10.448781 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.448420 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" event={"ID":"f27ff4c7-404b-403e-94a0-40eb82cc63ae","Type":"ContainerDied","Data":"f65fd9a20484899e9852a0a326bfd840d73e5620597091c76833709813ccef65"} Sep 18 04:11:10.450518 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.450493 2560 generic.go:356] "Generic (PLEG): container finished" podID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerID="96773837959ce36042e5c6cbf78e61ba5d8273323d0fa36249c2a4f61a9120c3" exitCode=0 Sep 18 04:11:10.450610 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.450572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" event={"ID":"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b","Type":"ContainerDied","Data":"96773837959ce36042e5c6cbf78e61ba5d8273323d0fa36249c2a4f61a9120c3"} Sep 18 04:11:10.456994 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.456963 2560 generic.go:356] "Generic (PLEG): container finished" podID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerID="fd0f56fc42805a117e1523cc2a6d593b34ea5de5d22b642944bbda9ad8f923c7" exitCode=0 Sep 18 04:11:10.457098 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.457041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" event={"ID":"651a4ada-4c86-42b3-8d73-2781e5d6b09f","Type":"ContainerDied","Data":"fd0f56fc42805a117e1523cc2a6d593b34ea5de5d22b642944bbda9ad8f923c7"} Sep 18 04:11:10.459066 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.459044 2560 generic.go:356] "Generic (PLEG): container finished" podID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerID="5088c6fa7af8c6a0f24d2e501b5a04525ea89bc4fde839bfc679480f50ae46f4" exitCode=0 Sep 18 04:11:10.459174 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.459082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" event={"ID":"7c11eff4-dafb-4057-919c-8d48e9d0aa2d","Type":"ContainerDied","Data":"5088c6fa7af8c6a0f24d2e501b5a04525ea89bc4fde839bfc679480f50ae46f4"} Sep 18 04:11:10.691304 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.691279 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:11:10.730853 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.730827 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbade2df-4441-4eb8-af82-15788312c767-istiod-ca-cert\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731011 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.730870 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-data\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731011 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.730889 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-istio-token\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731011 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.730918 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbade2df-4441-4eb8-af82-15788312c767-istio-podinfo\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731181 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731030 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-envoy\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731181 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731070 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-certs\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731181 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731095 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-credential-socket\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731181 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731144 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:10.731369 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731156 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-socket\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731369 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731238 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qq75\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-kube-api-access-5qq75\") pod \"fbade2df-4441-4eb8-af82-15788312c767\" (UID: \"fbade2df-4441-4eb8-af82-15788312c767\") " Sep 18 04:11:10.731369 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731256 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbade2df-4441-4eb8-af82-15788312c767-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:11:10.731523 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731382 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:10.731577 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731517 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:10.731577 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731552 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-socket\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.731577 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731571 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbade2df-4441-4eb8-af82-15788312c767-istiod-ca-cert\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.731729 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731585 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.731781 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.731753 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:10.733296 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.733276 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:11:10.733394 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.733319 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:10.733437 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.733422 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbade2df-4441-4eb8-af82-15788312c767-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 18 04:11:10.733528 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.733512 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-kube-api-access-5qq75" (OuterVolumeSpecName: "kube-api-access-5qq75") pod "fbade2df-4441-4eb8-af82-15788312c767" (UID: "fbade2df-4441-4eb8-af82-15788312c767"). InnerVolumeSpecName "kube-api-access-5qq75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:11:10.832347 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.832319 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-istio-token\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.832347 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.832342 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbade2df-4441-4eb8-af82-15788312c767-istio-podinfo\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.832347 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.832350 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-istio-envoy\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.832540 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.832361 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-workload-certs\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.832540 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.832368 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbade2df-4441-4eb8-af82-15788312c767-credential-socket\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:10.832540 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:10.832378 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qq75\" (UniqueName: \"kubernetes.io/projected/fbade2df-4441-4eb8-af82-15788312c767-kube-api-access-5qq75\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.463453 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.463366 2560 generic.go:356] "Generic (PLEG): container finished" podID="fbade2df-4441-4eb8-af82-15788312c767" containerID="8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335" exitCode=0 Sep 18 04:11:11.463453 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.463412 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" Sep 18 04:11:11.463453 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.463444 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" event={"ID":"fbade2df-4441-4eb8-af82-15788312c767","Type":"ContainerDied","Data":"8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335"} Sep 18 04:11:11.463935 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.463497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2" event={"ID":"fbade2df-4441-4eb8-af82-15788312c767","Type":"ContainerDied","Data":"7914340f334888c998c671b87dc743b45c5021d52ddb8f9a8e99e1718839dfc9"} Sep 18 04:11:11.463935 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.463527 2560 scope.go:117] "RemoveContainer" containerID="8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335" Sep 18 04:11:11.475849 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.475823 2560 scope.go:117] "RemoveContainer" containerID="8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335" Sep 18 04:11:11.476295 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:11:11.476267 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335\": container with ID starting with 8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335 not found: ID does not exist" containerID="8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335" Sep 18 04:11:11.476430 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.476301 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335"} err="failed to get container status \"8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335\": rpc error: code = NotFound desc = could not find container \"8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335\": container with ID starting with 8aa6b7250b51e7e9f0a3a68366fe97cd27e57474ab1def94cd3fef80b4a66335 not found: ID does not exist" Sep 18 04:11:11.483334 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.483301 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2"] Sep 18 04:11:11.488929 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.488890 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-87cd2"] Sep 18 04:11:11.601170 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.601144 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:11:11.637346 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.637319 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vknx4\" (UniqueName: \"kubernetes.io/projected/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-kube-api-access-vknx4\") pod \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " Sep 18 04:11:11.637450 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.637416 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-util\") pod \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " Sep 18 04:11:11.637521 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.637460 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-bundle\") pod \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\" (UID: \"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b\") " Sep 18 04:11:11.640003 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.638117 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-bundle" (OuterVolumeSpecName: "bundle") pod "acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" (UID: "acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.640303 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.640277 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-kube-api-access-vknx4" (OuterVolumeSpecName: "kube-api-access-vknx4") pod "acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" (UID: "acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b"). InnerVolumeSpecName "kube-api-access-vknx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:11:11.643179 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.643152 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-util" (OuterVolumeSpecName: "util") pod "acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" (UID: "acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.648076 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.648057 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:11:11.650806 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.650787 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:11:11.653403 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.653388 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:11:11.738671 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738642 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-bundle\") pod \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738683 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tnv8\" (UniqueName: \"kubernetes.io/projected/f27ff4c7-404b-403e-94a0-40eb82cc63ae-kube-api-access-8tnv8\") pod \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738712 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-bundle\") pod \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738734 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-util\") pod \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\" (UID: \"f27ff4c7-404b-403e-94a0-40eb82cc63ae\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738754 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp88x\" (UniqueName: \"kubernetes.io/projected/651a4ada-4c86-42b3-8d73-2781e5d6b09f-kube-api-access-mp88x\") pod \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738768 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-bundle\") pod \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738785 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qxbr\" (UniqueName: \"kubernetes.io/projected/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-kube-api-access-6qxbr\") pod \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " Sep 18 04:11:11.738842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.738812 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-util\") pod \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\" (UID: \"651a4ada-4c86-42b3-8d73-2781e5d6b09f\") " Sep 18 04:11:11.739665 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.739356 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-bundle" (OuterVolumeSpecName: "bundle") pod "651a4ada-4c86-42b3-8d73-2781e5d6b09f" (UID: "651a4ada-4c86-42b3-8d73-2781e5d6b09f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.739665 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.739409 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-util\") pod \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\" (UID: \"7c11eff4-dafb-4057-919c-8d48e9d0aa2d\") " Sep 18 04:11:11.739665 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.739406 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-bundle" (OuterVolumeSpecName: "bundle") pod "7c11eff4-dafb-4057-919c-8d48e9d0aa2d" (UID: "7c11eff4-dafb-4057-919c-8d48e9d0aa2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.739665 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.739476 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-bundle" (OuterVolumeSpecName: "bundle") pod "f27ff4c7-404b-403e-94a0-40eb82cc63ae" (UID: "f27ff4c7-404b-403e-94a0-40eb82cc63ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.740021 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.740002 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-bundle\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.740061 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.740026 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-bundle\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.740061 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.740040 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vknx4\" (UniqueName: \"kubernetes.io/projected/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-kube-api-access-vknx4\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.740061 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.740054 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-bundle\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.740172 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.740067 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-bundle\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.740172 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.740078 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b-util\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.741405 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.741383 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-kube-api-access-6qxbr" (OuterVolumeSpecName: "kube-api-access-6qxbr") pod "7c11eff4-dafb-4057-919c-8d48e9d0aa2d" (UID: "7c11eff4-dafb-4057-919c-8d48e9d0aa2d"). InnerVolumeSpecName "kube-api-access-6qxbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:11:11.741475 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.741420 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651a4ada-4c86-42b3-8d73-2781e5d6b09f-kube-api-access-mp88x" (OuterVolumeSpecName: "kube-api-access-mp88x") pod "651a4ada-4c86-42b3-8d73-2781e5d6b09f" (UID: "651a4ada-4c86-42b3-8d73-2781e5d6b09f"). InnerVolumeSpecName "kube-api-access-mp88x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:11:11.741951 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.741932 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27ff4c7-404b-403e-94a0-40eb82cc63ae-kube-api-access-8tnv8" (OuterVolumeSpecName: "kube-api-access-8tnv8") pod "f27ff4c7-404b-403e-94a0-40eb82cc63ae" (UID: "f27ff4c7-404b-403e-94a0-40eb82cc63ae"). InnerVolumeSpecName "kube-api-access-8tnv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:11:11.743868 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.743849 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-util" (OuterVolumeSpecName: "util") pod "651a4ada-4c86-42b3-8d73-2781e5d6b09f" (UID: "651a4ada-4c86-42b3-8d73-2781e5d6b09f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.744012 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.743993 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-util" (OuterVolumeSpecName: "util") pod "f27ff4c7-404b-403e-94a0-40eb82cc63ae" (UID: "f27ff4c7-404b-403e-94a0-40eb82cc63ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.744254 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.744235 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-util" (OuterVolumeSpecName: "util") pod "7c11eff4-dafb-4057-919c-8d48e9d0aa2d" (UID: "7c11eff4-dafb-4057-919c-8d48e9d0aa2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:11:11.840999 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.840954 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tnv8\" (UniqueName: \"kubernetes.io/projected/f27ff4c7-404b-403e-94a0-40eb82cc63ae-kube-api-access-8tnv8\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.840999 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.840995 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27ff4c7-404b-403e-94a0-40eb82cc63ae-util\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.840999 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.841009 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp88x\" (UniqueName: \"kubernetes.io/projected/651a4ada-4c86-42b3-8d73-2781e5d6b09f-kube-api-access-mp88x\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.841245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.841022 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qxbr\" (UniqueName: \"kubernetes.io/projected/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-kube-api-access-6qxbr\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.841245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.841033 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/651a4ada-4c86-42b3-8d73-2781e5d6b09f-util\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:11.841245 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:11.841044 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c11eff4-dafb-4057-919c-8d48e9d0aa2d-util\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:11:12.468671 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.468639 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" Sep 18 04:11:12.469152 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.468638 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v8dww" event={"ID":"651a4ada-4c86-42b3-8d73-2781e5d6b09f","Type":"ContainerDied","Data":"1eb260c0df23348e55ce6c732ebe989f4c4417c41862e137ae07c6cae9c7cf61"} Sep 18 04:11:12.469152 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.468768 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eb260c0df23348e55ce6c732ebe989f4c4417c41862e137ae07c6cae9c7cf61" Sep 18 04:11:12.471520 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.471499 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" Sep 18 04:11:12.471639 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.471495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgcshz" event={"ID":"7c11eff4-dafb-4057-919c-8d48e9d0aa2d","Type":"ContainerDied","Data":"ede7802f29b3bbd8f7138269297c8d641138d055d7b491447869600a1cf16ee1"} Sep 18 04:11:12.471639 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.471616 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ede7802f29b3bbd8f7138269297c8d641138d055d7b491447869600a1cf16ee1" Sep 18 04:11:12.473334 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.473318 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" Sep 18 04:11:12.473453 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.473316 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954envwgz" event={"ID":"f27ff4c7-404b-403e-94a0-40eb82cc63ae","Type":"ContainerDied","Data":"1dc61330b1b3ab7b22da95442708b8fe0d9b9edaf2b2c6010c57bc7154f2a9ec"} Sep 18 04:11:12.473453 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.473436 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dc61330b1b3ab7b22da95442708b8fe0d9b9edaf2b2c6010c57bc7154f2a9ec" Sep 18 04:11:12.475239 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.475217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" event={"ID":"acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b","Type":"ContainerDied","Data":"a7fec5a6206ecf9294c4977a5491874d6ffa7e9535e52fe17377d2c212594db9"} Sep 18 04:11:12.475319 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.475252 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tjv7p" Sep 18 04:11:12.475319 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:12.475256 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7fec5a6206ecf9294c4977a5491874d6ffa7e9535e52fe17377d2c212594db9" Sep 18 04:11:13.344915 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:13.344884 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbade2df-4441-4eb8-af82-15788312c767" path="/var/lib/kubelet/pods/fbade2df-4441-4eb8-af82-15788312c767/volumes" Sep 18 04:11:15.508286 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508252 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm"] Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508476 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508486 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508495 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbade2df-4441-4eb8-af82-15788312c767" containerName="istio-proxy" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508500 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbade2df-4441-4eb8-af82-15788312c767" containerName="istio-proxy" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508508 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508513 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508523 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508528 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508535 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508540 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508547 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508552 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508558 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508564 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508570 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508575 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508580 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508585 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="pull" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508590 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508595 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508601 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508606 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508611 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508615 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508620 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508624 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="util" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508658 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c11eff4-dafb-4057-919c-8d48e9d0aa2d" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508665 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27ff4c7-404b-403e-94a0-40eb82cc63ae" containerName="extract" Sep 18 04:11:15.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508670 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="acdb8ae7-72c6-4f4b-9279-ef9cbd40bf0b" containerName="extract" Sep 18 04:11:15.509487 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508676 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbade2df-4441-4eb8-af82-15788312c767" containerName="istio-proxy" Sep 18 04:11:15.509487 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.508683 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="651a4ada-4c86-42b3-8d73-2781e5d6b09f" containerName="extract" Sep 18 04:11:15.516281 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.516262 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.518928 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.518909 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8mkt2\"" Sep 18 04:11:15.519002 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.518923 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 18 04:11:15.519002 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.518936 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:11:15.526464 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.526439 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm"] Sep 18 04:11:15.570011 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.569989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2hnd\" (UniqueName: \"kubernetes.io/projected/d212a72b-a25a-4b4d-bb24-08931defece5-kube-api-access-k2hnd\") pod \"cert-manager-operator-controller-manager-684f79c9b9-nskmm\" (UID: \"d212a72b-a25a-4b4d-bb24-08931defece5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.570159 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.570046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d212a72b-a25a-4b4d-bb24-08931defece5-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-nskmm\" (UID: \"d212a72b-a25a-4b4d-bb24-08931defece5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.671237 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.671205 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2hnd\" (UniqueName: \"kubernetes.io/projected/d212a72b-a25a-4b4d-bb24-08931defece5-kube-api-access-k2hnd\") pod \"cert-manager-operator-controller-manager-684f79c9b9-nskmm\" (UID: \"d212a72b-a25a-4b4d-bb24-08931defece5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.671389 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.671264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d212a72b-a25a-4b4d-bb24-08931defece5-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-nskmm\" (UID: \"d212a72b-a25a-4b4d-bb24-08931defece5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.671591 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.671574 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d212a72b-a25a-4b4d-bb24-08931defece5-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-nskmm\" (UID: \"d212a72b-a25a-4b4d-bb24-08931defece5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.678943 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.678922 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2hnd\" (UniqueName: \"kubernetes.io/projected/d212a72b-a25a-4b4d-bb24-08931defece5-kube-api-access-k2hnd\") pod \"cert-manager-operator-controller-manager-684f79c9b9-nskmm\" (UID: \"d212a72b-a25a-4b4d-bb24-08931defece5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:15.825344 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:15.825264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" Sep 18 04:11:16.127322 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:16.127298 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm"] Sep 18 04:11:16.129384 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:16.129357 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd212a72b_a25a_4b4d_bb24_08931defece5.slice/crio-5414eba73ac182276d53811a61801b01e9627aeafc18e604ef268fea4bc85ded WatchSource:0}: Error finding container 5414eba73ac182276d53811a61801b01e9627aeafc18e604ef268fea4bc85ded: Status 404 returned error can't find the container with id 5414eba73ac182276d53811a61801b01e9627aeafc18e604ef268fea4bc85ded Sep 18 04:11:16.491917 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:16.491883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" event={"ID":"d212a72b-a25a-4b4d-bb24-08931defece5","Type":"ContainerStarted","Data":"5414eba73ac182276d53811a61801b01e9627aeafc18e604ef268fea4bc85ded"} Sep 18 04:11:20.515142 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:20.515085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" event={"ID":"d212a72b-a25a-4b4d-bb24-08931defece5","Type":"ContainerStarted","Data":"3fd5f1e72958bb19414ce0a905c523f91f6791435dadfe026908e167bfbe0cb8"} Sep 18 04:11:20.544848 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:20.544799 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-nskmm" podStartSLOduration=1.5549837960000001 podStartE2EDuration="5.544771071s" totalImagesPullingTime="3.989787275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:20.543197114 +0000 UTC m=+269.309009134" watchObservedRunningTime="2026-09-18 04:11:20.544771071 +0000 UTC m=+269.310583099" Sep 18 04:11:21.042810 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.042775 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h6grv"] Sep 18 04:11:21.065337 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.065310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.069910 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.069890 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 04:11:21.070392 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.070369 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2wjjt\"" Sep 18 04:11:21.071229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.071208 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 04:11:21.087863 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.087838 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h6grv"] Sep 18 04:11:21.115242 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.115208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6d4f271-5cb7-40f2-aba2-1e66619a5e9f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h6grv\" (UID: \"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.115389 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.115285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n75d\" (UniqueName: \"kubernetes.io/projected/d6d4f271-5cb7-40f2-aba2-1e66619a5e9f-kube-api-access-2n75d\") pod \"cert-manager-webhook-6486ffd997-h6grv\" (UID: \"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.216192 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.216151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6d4f271-5cb7-40f2-aba2-1e66619a5e9f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h6grv\" (UID: \"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.216192 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.216193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n75d\" (UniqueName: \"kubernetes.io/projected/d6d4f271-5cb7-40f2-aba2-1e66619a5e9f-kube-api-access-2n75d\") pod \"cert-manager-webhook-6486ffd997-h6grv\" (UID: \"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.234026 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.233991 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6d4f271-5cb7-40f2-aba2-1e66619a5e9f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h6grv\" (UID: \"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.234026 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.234008 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n75d\" (UniqueName: \"kubernetes.io/projected/d6d4f271-5cb7-40f2-aba2-1e66619a5e9f-kube-api-access-2n75d\") pod \"cert-manager-webhook-6486ffd997-h6grv\" (UID: \"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.374113 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.374037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:21.683488 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:21.683408 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h6grv"] Sep 18 04:11:21.686172 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:21.686140 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6d4f271_5cb7_40f2_aba2_1e66619a5e9f.slice/crio-62b82df8059972c439c2b85055f61b1ed1171f9bf1f707af0d7223e5d9089ab3 WatchSource:0}: Error finding container 62b82df8059972c439c2b85055f61b1ed1171f9bf1f707af0d7223e5d9089ab3: Status 404 returned error can't find the container with id 62b82df8059972c439c2b85055f61b1ed1171f9bf1f707af0d7223e5d9089ab3 Sep 18 04:11:22.525385 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:22.525345 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" event={"ID":"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f","Type":"ContainerStarted","Data":"62b82df8059972c439c2b85055f61b1ed1171f9bf1f707af0d7223e5d9089ab3"} Sep 18 04:11:23.078531 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.078492 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6"] Sep 18 04:11:23.080742 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.080715 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.083188 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.083163 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 04:11:23.083401 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.083380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 04:11:23.083560 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.083535 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 18 04:11:23.083772 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.083752 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 18 04:11:23.084250 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.084229 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-gskpr\"" Sep 18 04:11:23.084333 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.084294 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 04:11:23.099209 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.099179 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6"] Sep 18 04:11:23.129667 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.129637 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.129825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.129683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jrh\" (UniqueName: \"kubernetes.io/projected/2ee14ffa-da0b-4f26-954a-44208fe4a377-kube-api-access-75jrh\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.129825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.129722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.129825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.129756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ee14ffa-da0b-4f26-954a-44208fe4a377-manifests\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.129825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.129797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee14ffa-da0b-4f26-954a-44208fe4a377-tmp\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.129825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.129819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.230981 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.230935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee14ffa-da0b-4f26-954a-44208fe4a377-tmp\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.231171 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.230989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.231171 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.231032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.231171 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.231069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jrh\" (UniqueName: \"kubernetes.io/projected/2ee14ffa-da0b-4f26-954a-44208fe4a377-kube-api-access-75jrh\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.231171 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.231099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.231171 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.231161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ee14ffa-da0b-4f26-954a-44208fe4a377-manifests\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.231579 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.231530 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ee14ffa-da0b-4f26-954a-44208fe4a377-manifests\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.233912 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.233884 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee14ffa-da0b-4f26-954a-44208fe4a377-tmp\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.234182 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.234162 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.234270 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.234165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.234334 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.234313 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee14ffa-da0b-4f26-954a-44208fe4a377-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.243780 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.243758 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jrh\" (UniqueName: \"kubernetes.io/projected/2ee14ffa-da0b-4f26-954a-44208fe4a377-kube-api-access-75jrh\") pod \"opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6\" (UID: \"2ee14ffa-da0b-4f26-954a-44208fe4a377\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.394691 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.394612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:23.690841 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:23.690808 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6"] Sep 18 04:11:24.435617 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:24.435578 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee14ffa_da0b_4f26_954a_44208fe4a377.slice/crio-c715a696858d51e1a6ceddebf414ecaac07bd013c498e150ac36b8bec208e159 WatchSource:0}: Error finding container c715a696858d51e1a6ceddebf414ecaac07bd013c498e150ac36b8bec208e159: Status 404 returned error can't find the container with id c715a696858d51e1a6ceddebf414ecaac07bd013c498e150ac36b8bec208e159 Sep 18 04:11:24.536259 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:24.536226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" event={"ID":"d6d4f271-5cb7-40f2-aba2-1e66619a5e9f","Type":"ContainerStarted","Data":"7c29c08fe3fe3b368cea38a61db46798fa385b4120a2b60ad481617b62b487b5"} Sep 18 04:11:24.536359 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:24.536292 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:24.537717 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:24.537695 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" event={"ID":"2ee14ffa-da0b-4f26-954a-44208fe4a377","Type":"ContainerStarted","Data":"c715a696858d51e1a6ceddebf414ecaac07bd013c498e150ac36b8bec208e159"} Sep 18 04:11:24.555756 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:24.555705 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" podStartSLOduration=0.771162761 podStartE2EDuration="3.555690059s" totalImagesPullingTime="2.784527298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:24.554262722 +0000 UTC m=+273.320074751" watchObservedRunningTime="2026-09-18 04:11:24.555690059 +0000 UTC m=+273.321502087" Sep 18 04:11:27.381059 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.380983 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r8485"] Sep 18 04:11:27.384803 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.384783 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.387046 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.387026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xmd67\"" Sep 18 04:11:27.393827 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.393805 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r8485"] Sep 18 04:11:27.463740 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.463708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q52b9\" (UniqueName: \"kubernetes.io/projected/41a7da2c-04b1-4a64-a1d5-ca607888af91-kube-api-access-q52b9\") pod \"cert-manager-cainjector-559cdd8c87-r8485\" (UID: \"41a7da2c-04b1-4a64-a1d5-ca607888af91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.463883 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.463784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a7da2c-04b1-4a64-a1d5-ca607888af91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r8485\" (UID: \"41a7da2c-04b1-4a64-a1d5-ca607888af91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.554888 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.554849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" event={"ID":"2ee14ffa-da0b-4f26-954a-44208fe4a377","Type":"ContainerStarted","Data":"723641e3c2ebbfcd02c9090a91addf289b099c2800d44627e4c91c007b777bf1"} Sep 18 04:11:27.564257 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.564237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a7da2c-04b1-4a64-a1d5-ca607888af91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r8485\" (UID: \"41a7da2c-04b1-4a64-a1d5-ca607888af91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.564354 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.564283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q52b9\" (UniqueName: \"kubernetes.io/projected/41a7da2c-04b1-4a64-a1d5-ca607888af91-kube-api-access-q52b9\") pod \"cert-manager-cainjector-559cdd8c87-r8485\" (UID: \"41a7da2c-04b1-4a64-a1d5-ca607888af91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.579088 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.579063 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q52b9\" (UniqueName: \"kubernetes.io/projected/41a7da2c-04b1-4a64-a1d5-ca607888af91-kube-api-access-q52b9\") pod \"cert-manager-cainjector-559cdd8c87-r8485\" (UID: \"41a7da2c-04b1-4a64-a1d5-ca607888af91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.580004 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.579987 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a7da2c-04b1-4a64-a1d5-ca607888af91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r8485\" (UID: \"41a7da2c-04b1-4a64-a1d5-ca607888af91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.693637 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.693568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" Sep 18 04:11:27.986908 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:27.982197 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r8485"] Sep 18 04:11:28.559780 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:28.559743 2560 generic.go:356] "Generic (PLEG): container finished" podID="2ee14ffa-da0b-4f26-954a-44208fe4a377" containerID="723641e3c2ebbfcd02c9090a91addf289b099c2800d44627e4c91c007b777bf1" exitCode=0 Sep 18 04:11:28.560302 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:28.559829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" event={"ID":"2ee14ffa-da0b-4f26-954a-44208fe4a377","Type":"ContainerDied","Data":"723641e3c2ebbfcd02c9090a91addf289b099c2800d44627e4c91c007b777bf1"} Sep 18 04:11:28.561487 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:28.561456 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" event={"ID":"41a7da2c-04b1-4a64-a1d5-ca607888af91","Type":"ContainerStarted","Data":"f9f3bc63b218c8f6832908713103bebcf2f0b4734192e4e44ce102b5da8dd5ee"} Sep 18 04:11:28.561593 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:28.561499 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" event={"ID":"41a7da2c-04b1-4a64-a1d5-ca607888af91","Type":"ContainerStarted","Data":"e18ea5365f6d19d037e57d05d43ad6d8c769521f3e0d98fd0376b1a7efe2649f"} Sep 18 04:11:28.605606 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:28.605565 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8485" podStartSLOduration=1.605552033 podStartE2EDuration="1.605552033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:28.604109701 +0000 UTC m=+277.369921728" watchObservedRunningTime="2026-09-18 04:11:28.605552033 +0000 UTC m=+277.371364061" Sep 18 04:11:29.568401 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:29.568361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" event={"ID":"2ee14ffa-da0b-4f26-954a-44208fe4a377","Type":"ContainerStarted","Data":"39b48b7877fee36af10e65ee6930d867fcbd0c49c0166cd716be44d3e37848e4"} Sep 18 04:11:29.605105 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:29.605055 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" podStartSLOduration=3.176841641 podStartE2EDuration="6.605039994s" totalImagesPullingTime="2.952332294s" totalInitContainerRuntime="475.866059ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:29.602440989 +0000 UTC m=+278.368253016" watchObservedRunningTime="2026-09-18 04:11:29.605039994 +0000 UTC m=+278.370852022" Sep 18 04:11:30.546653 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:30.546623 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h6grv" Sep 18 04:11:30.572788 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:30.572757 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:32.281740 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.281707 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqd2m"] Sep 18 04:11:32.284078 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.284062 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.286343 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.286320 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hnfqd\"" Sep 18 04:11:32.295707 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.295682 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqd2m"] Sep 18 04:11:32.400148 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.400096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-728rn\" (UniqueName: \"kubernetes.io/projected/33565a9c-cc7f-47f0-aa47-1dd5a0dfa215-kube-api-access-728rn\") pod \"cert-manager-55b4d954d5-mqd2m\" (UID: \"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215\") " pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.400353 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.400255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33565a9c-cc7f-47f0-aa47-1dd5a0dfa215-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqd2m\" (UID: \"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215\") " pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.501692 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.501659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-728rn\" (UniqueName: \"kubernetes.io/projected/33565a9c-cc7f-47f0-aa47-1dd5a0dfa215-kube-api-access-728rn\") pod \"cert-manager-55b4d954d5-mqd2m\" (UID: \"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215\") " pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.501692 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.501696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33565a9c-cc7f-47f0-aa47-1dd5a0dfa215-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqd2m\" (UID: \"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215\") " pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.509851 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.509824 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33565a9c-cc7f-47f0-aa47-1dd5a0dfa215-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqd2m\" (UID: \"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215\") " pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.509991 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.509973 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-728rn\" (UniqueName: \"kubernetes.io/projected/33565a9c-cc7f-47f0-aa47-1dd5a0dfa215-kube-api-access-728rn\") pod \"cert-manager-55b4d954d5-mqd2m\" (UID: \"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215\") " pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.592600 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.592519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mqd2m" Sep 18 04:11:32.862565 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:32.862547 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqd2m"] Sep 18 04:11:32.865119 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:32.865092 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33565a9c_cc7f_47f0_aa47_1dd5a0dfa215.slice/crio-1face5184bde80ca0729ac1e8c257942069f11c378821224e1f1206f73476d1a WatchSource:0}: Error finding container 1face5184bde80ca0729ac1e8c257942069f11c378821224e1f1206f73476d1a: Status 404 returned error can't find the container with id 1face5184bde80ca0729ac1e8c257942069f11c378821224e1f1206f73476d1a Sep 18 04:11:33.587026 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:33.586994 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mqd2m" event={"ID":"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215","Type":"ContainerStarted","Data":"671bb4b30f865c89eb1ca1f078f5f1bcba9abf2ae5bee6dca463abe48f777597"} Sep 18 04:11:33.587455 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:33.587042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mqd2m" event={"ID":"33565a9c-cc7f-47f0-aa47-1dd5a0dfa215","Type":"ContainerStarted","Data":"1face5184bde80ca0729ac1e8c257942069f11c378821224e1f1206f73476d1a"} Sep 18 04:11:33.602427 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:33.602374 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mqd2m" podStartSLOduration=1.602356709 podStartE2EDuration="1.602356709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:33.601435379 +0000 UTC m=+282.367247408" watchObservedRunningTime="2026-09-18 04:11:33.602356709 +0000 UTC m=+282.368168737" Sep 18 04:11:41.578906 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:41.578873 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6" Sep 18 04:11:47.853688 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.853652 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69"] Sep 18 04:11:47.855908 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.855891 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:47.859635 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.859610 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 18 04:11:47.859841 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.859662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-htjm9\"" Sep 18 04:11:47.859961 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.859661 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 04:11:47.859961 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.859671 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 04:11:47.859961 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.859670 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 18 04:11:47.869434 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:47.869412 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69"] Sep 18 04:11:48.026065 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.026027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9vf\" (UniqueName: \"kubernetes.io/projected/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-kube-api-access-px9vf\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.026283 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.026100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.026283 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.026148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.127407 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.127319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.127407 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.127354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.127407 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.127379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9vf\" (UniqueName: \"kubernetes.io/projected/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-kube-api-access-px9vf\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.127668 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:11:48.127472 2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 18 04:11:48.127668 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:11:48.127553 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-plugin-serving-cert podName:89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22 nodeName:}" failed. No retries permitted until 2026-09-18 04:11:48.627534132 +0000 UTC m=+297.393346146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-74d69" (UID: "89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22") : secret "plugin-serving-cert" not found Sep 18 04:11:48.127981 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.127962 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.140047 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.140021 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9vf\" (UniqueName: \"kubernetes.io/projected/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-kube-api-access-px9vf\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.631524 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.631478 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.633818 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.633800 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-74d69\" (UID: \"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:48.766117 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:48.766083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" Sep 18 04:11:49.041359 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:49.041334 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69"] Sep 18 04:11:49.043514 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:49.043489 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89b61aa3_8b54_4c9c_9bde_6cd4ee43cc22.slice/crio-fa25550951f6138e19ffec4c8db739ae6bbf509d8a7cf69c64b2c43332f91176 WatchSource:0}: Error finding container fa25550951f6138e19ffec4c8db739ae6bbf509d8a7cf69c64b2c43332f91176: Status 404 returned error can't find the container with id fa25550951f6138e19ffec4c8db739ae6bbf509d8a7cf69c64b2c43332f91176 Sep 18 04:11:49.655662 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:49.655627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" event={"ID":"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22","Type":"ContainerStarted","Data":"fa25550951f6138e19ffec4c8db739ae6bbf509d8a7cf69c64b2c43332f91176"} Sep 18 04:11:52.995138 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:52.995092 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc"] Sep 18 04:11:53.015525 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.015497 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc"] Sep 18 04:11:53.015691 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.015597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.018253 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.018227 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 04:11:53.018499 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.018484 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zfbkf\"" Sep 18 04:11:53.019145 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.019107 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 04:11:53.166200 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.166114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48f5fef-bc3e-402c-ac7b-249537ba357a-tls-certs\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.166469 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.166214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/b48f5fef-bc3e-402c-ac7b-249537ba357a-kube-api-access-b94sq\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.166469 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.166253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b48f5fef-bc3e-402c-ac7b-249537ba357a-tmp\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.203070 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.203034 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5"] Sep 18 04:11:53.208540 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.208516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.211466 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.211420 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2q5h4\"" Sep 18 04:11:53.233958 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.233897 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5"] Sep 18 04:11:53.268060 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.267996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48f5fef-bc3e-402c-ac7b-249537ba357a-tls-certs\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.268219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.268057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/b48f5fef-bc3e-402c-ac7b-249537ba357a-kube-api-access-b94sq\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.268219 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.268095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b48f5fef-bc3e-402c-ac7b-249537ba357a-tmp\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.277714 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.277544 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 04:11:53.277714 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.277564 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b48f5fef-bc3e-402c-ac7b-249537ba357a-tmp\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.279814 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:11:53.279790 2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 18 04:11:53.280023 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:11:53.279862 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48f5fef-bc3e-402c-ac7b-249537ba357a-tls-certs podName:b48f5fef-bc3e-402c-ac7b-249537ba357a nodeName:}" failed. No retries permitted until 2026-09-18 04:11:53.779841187 +0000 UTC m=+302.545653198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b48f5fef-bc3e-402c-ac7b-249537ba357a-tls-certs") pod "kube-auth-proxy-c4f5c7b75-pmkvc" (UID: "b48f5fef-bc3e-402c-ac7b-249537ba357a") : secret "kube-auth-proxy-tls" not found Sep 18 04:11:53.281545 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.281511 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/b48f5fef-bc3e-402c-ac7b-249537ba357a-kube-api-access-b94sq\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.368665 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.368848 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.368848 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwn7j\" (UniqueName: \"kubernetes.io/projected/b910d1ee-5e63-42b8-be90-3aa7e66be788-kube-api-access-gwn7j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.368848 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b910d1ee-5e63-42b8-be90-3aa7e66be788-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.368848 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.369028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.369028 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.368977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.369118 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.369029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.369118 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.369070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.469847 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469858 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwn7j\" (UniqueName: \"kubernetes.io/projected/b910d1ee-5e63-42b8-be90-3aa7e66be788-kube-api-access-gwn7j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b910d1ee-5e63-42b8-be90-3aa7e66be788-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.469971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470348 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470348 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470261 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470444 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470424 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470612 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470587 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470676 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470649 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b910d1ee-5e63-42b8-be90-3aa7e66be788-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.470738 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.470721 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.472150 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.472116 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.472644 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.472629 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.480918 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.480893 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b910d1ee-5e63-42b8-be90-3aa7e66be788-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.481267 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.481248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwn7j\" (UniqueName: \"kubernetes.io/projected/b910d1ee-5e63-42b8-be90-3aa7e66be788-kube-api-access-gwn7j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5\" (UID: \"b910d1ee-5e63-42b8-be90-3aa7e66be788\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.521545 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.521448 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:53.873714 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.873631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48f5fef-bc3e-402c-ac7b-249537ba357a-tls-certs\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.876500 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.876474 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48f5fef-bc3e-402c-ac7b-249537ba357a-tls-certs\") pod \"kube-auth-proxy-c4f5c7b75-pmkvc\" (UID: \"b48f5fef-bc3e-402c-ac7b-249537ba357a\") " pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:53.928508 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.928478 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zfbkf\"" Sep 18 04:11:53.936624 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:53.936589 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" Sep 18 04:11:54.105829 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.105797 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qp828"] Sep 18 04:11:54.128661 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.128574 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qp828"] Sep 18 04:11:54.128818 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.128704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.131507 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.131384 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 18 04:11:54.131684 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.131612 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 18 04:11:54.131684 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.131635 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 18 04:11:54.131684 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.131677 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wfqzp\"" Sep 18 04:11:54.148553 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.148525 2560 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 04:11:54.277057 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.277026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5nmp\" (UniqueName: \"kubernetes.io/projected/de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89-kube-api-access-k5nmp\") pod \"postgres-69fb4594cf-qp828\" (UID: \"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.277226 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.277101 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89-data\") pod \"postgres-69fb4594cf-qp828\" (UID: \"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.377574 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.377547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89-data\") pod \"postgres-69fb4594cf-qp828\" (UID: \"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.377755 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.377597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5nmp\" (UniqueName: \"kubernetes.io/projected/de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89-kube-api-access-k5nmp\") pod \"postgres-69fb4594cf-qp828\" (UID: \"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.377953 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.377933 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89-data\") pod \"postgres-69fb4594cf-qp828\" (UID: \"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.384412 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.384391 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc"] Sep 18 04:11:54.387644 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.387623 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5"] Sep 18 04:11:54.389502 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.389482 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5nmp\" (UniqueName: \"kubernetes.io/projected/de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89-kube-api-access-k5nmp\") pod \"postgres-69fb4594cf-qp828\" (UID: \"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.441939 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.441904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:11:54.502383 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:54.502348 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48f5fef_bc3e_402c_ac7b_249537ba357a.slice/crio-533bf850f796ce50e54530bc68338d59a103d93b287de8ff2a17ec23137bbbf5 WatchSource:0}: Error finding container 533bf850f796ce50e54530bc68338d59a103d93b287de8ff2a17ec23137bbbf5: Status 404 returned error can't find the container with id 533bf850f796ce50e54530bc68338d59a103d93b287de8ff2a17ec23137bbbf5 Sep 18 04:11:54.503156 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:54.503118 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb910d1ee_5e63_42b8_be90_3aa7e66be788.slice/crio-0bc5057afaf5eee3897b779365c39735876e97c477ad8bac566eba1706efad28 WatchSource:0}: Error finding container 0bc5057afaf5eee3897b779365c39735876e97c477ad8bac566eba1706efad28: Status 404 returned error can't find the container with id 0bc5057afaf5eee3897b779365c39735876e97c477ad8bac566eba1706efad28 Sep 18 04:11:54.528993 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.528962 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:11:54.529307 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.529272 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:54.529456 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.529359 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:54.529456 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.529398 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:11:54.687340 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.687282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" event={"ID":"b910d1ee-5e63-42b8-be90-3aa7e66be788","Type":"ContainerStarted","Data":"b42b476e7d353a7ff1ca1bbed79f5f2cdc462a01c38da693076f4e1a5ad6a4db"} Sep 18 04:11:54.687505 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.687354 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" event={"ID":"b910d1ee-5e63-42b8-be90-3aa7e66be788","Type":"ContainerStarted","Data":"0bc5057afaf5eee3897b779365c39735876e97c477ad8bac566eba1706efad28"} Sep 18 04:11:54.689074 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.689049 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" event={"ID":"89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22","Type":"ContainerStarted","Data":"1230c2289ff38a3ee21bdd770d0d88bf9d13f460ba1e66353a798f0a631dbc67"} Sep 18 04:11:54.693898 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.693857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" event={"ID":"b48f5fef-bc3e-402c-ac7b-249537ba357a","Type":"ContainerStarted","Data":"533bf850f796ce50e54530bc68338d59a103d93b287de8ff2a17ec23137bbbf5"} Sep 18 04:11:54.731596 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.731545 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" podStartSLOduration=1.731527998 podStartE2EDuration="1.731527998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:54.728734385 +0000 UTC m=+303.494546414" watchObservedRunningTime="2026-09-18 04:11:54.731527998 +0000 UTC m=+303.497340025" Sep 18 04:11:54.768530 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.768476 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-74d69" podStartSLOduration=2.270125916 podStartE2EDuration="7.768460578s" totalImagesPullingTime="5.498334662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:54.767240108 +0000 UTC m=+303.533052133" watchObservedRunningTime="2026-09-18 04:11:54.768460578 +0000 UTC m=+303.534272608" Sep 18 04:11:54.800823 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:54.800794 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qp828"] Sep 18 04:11:54.803199 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:11:54.803171 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde715f1c_6ec5_4dd4_a1f6_fc167cb1bf89.slice/crio-826b4b84c692a5beed44424c3ec68faf3683dcc9cad51bca7645af0c24c84561 WatchSource:0}: Error finding container 826b4b84c692a5beed44424c3ec68faf3683dcc9cad51bca7645af0c24c84561: Status 404 returned error can't find the container with id 826b4b84c692a5beed44424c3ec68faf3683dcc9cad51bca7645af0c24c84561 Sep 18 04:11:55.521882 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:55.521820 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:55.527968 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:55.527941 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:55.701835 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:55.701794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" event={"ID":"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89","Type":"ContainerStarted","Data":"826b4b84c692a5beed44424c3ec68faf3683dcc9cad51bca7645af0c24c84561"} Sep 18 04:11:55.702336 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:55.702306 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:55.703700 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:55.703667 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5" Sep 18 04:11:57.065736 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:57.065653 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 04:11:57.713503 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:57.713459 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" event={"ID":"b48f5fef-bc3e-402c-ac7b-249537ba357a","Type":"ContainerStarted","Data":"c9c9a05441ff282be0e6f2f792cc8cec2a675fc6d9764966ff625fed63278d71"} Sep 18 04:11:57.736226 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:11:57.736170 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c4f5c7b75-pmkvc" podStartSLOduration=3.203259197 podStartE2EDuration="5.736149749s" totalImagesPullingTime="2.532890552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:11:57.734885316 +0000 UTC m=+306.500697343" watchObservedRunningTime="2026-09-18 04:11:57.736149749 +0000 UTC m=+306.501961782" Sep 18 04:12:00.728677 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:00.728640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" event={"ID":"de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89","Type":"ContainerStarted","Data":"01ec163461ad73a3b120e2b9ced3331cd05193a0e8e43aff19e65f35283d60c5"} Sep 18 04:12:00.729084 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:00.728757 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:12:00.752615 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:00.752565 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" podStartSLOduration=1.6853312790000001 podStartE2EDuration="6.752551104s" totalImagesPullingTime="5.067219825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:00.750363647 +0000 UTC m=+309.516175679" watchObservedRunningTime="2026-09-18 04:12:00.752551104 +0000 UTC m=+309.518363131" Sep 18 04:12:06.761256 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:06.761227 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp828" Sep 18 04:12:26.952551 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:26.952518 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-ckgmp"] Sep 18 04:12:26.972595 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:26.972569 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-ckgmp"] Sep 18 04:12:26.972738 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:26.972653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:26.975150 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:26.975114 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gxqfl\"" Sep 18 04:12:27.034628 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:27.034598 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpxd5\" (UniqueName: \"kubernetes.io/projected/1c0b11cb-b5d2-4036-8e43-12c20189b36f-kube-api-access-wpxd5\") pod \"authorino-7bcfd8f9cd-ckgmp\" (UID: \"1c0b11cb-b5d2-4036-8e43-12c20189b36f\") " pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:27.135834 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:27.135801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpxd5\" (UniqueName: \"kubernetes.io/projected/1c0b11cb-b5d2-4036-8e43-12c20189b36f-kube-api-access-wpxd5\") pod \"authorino-7bcfd8f9cd-ckgmp\" (UID: \"1c0b11cb-b5d2-4036-8e43-12c20189b36f\") " pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:27.143439 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:27.143409 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpxd5\" (UniqueName: \"kubernetes.io/projected/1c0b11cb-b5d2-4036-8e43-12c20189b36f-kube-api-access-wpxd5\") pod \"authorino-7bcfd8f9cd-ckgmp\" (UID: \"1c0b11cb-b5d2-4036-8e43-12c20189b36f\") " pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:27.281211 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:27.281175 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:27.550026 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:27.550000 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-ckgmp"] Sep 18 04:12:27.552767 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:27.552740 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c0b11cb_b5d2_4036_8e43_12c20189b36f.slice/crio-46bcf84c06aa1d53025c59d222346bdd2ae0f6fc0adc13449f1b6a5e17edd7c5 WatchSource:0}: Error finding container 46bcf84c06aa1d53025c59d222346bdd2ae0f6fc0adc13449f1b6a5e17edd7c5: Status 404 returned error can't find the container with id 46bcf84c06aa1d53025c59d222346bdd2ae0f6fc0adc13449f1b6a5e17edd7c5 Sep 18 04:12:27.849715 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:27.849632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" event={"ID":"1c0b11cb-b5d2-4036-8e43-12c20189b36f","Type":"ContainerStarted","Data":"46bcf84c06aa1d53025c59d222346bdd2ae0f6fc0adc13449f1b6a5e17edd7c5"} Sep 18 04:12:29.860620 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:29.860586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" event={"ID":"1c0b11cb-b5d2-4036-8e43-12c20189b36f","Type":"ContainerStarted","Data":"0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b"} Sep 18 04:12:29.878163 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:29.878101 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" podStartSLOduration=2.137281926 podStartE2EDuration="3.878086613s" totalImagesPullingTime="1.740804687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:29.875997693 +0000 UTC m=+338.641809721" watchObservedRunningTime="2026-09-18 04:12:29.878086613 +0000 UTC m=+338.643898640" Sep 18 04:12:29.915749 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:29.915715 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-ckgmp"] Sep 18 04:12:31.869822 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:31.869764 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" podUID="1c0b11cb-b5d2-4036-8e43-12c20189b36f" containerName="authorino" containerID="cri-o://0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b" gracePeriod=30 Sep 18 04:12:32.649529 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.649506 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:32.780802 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.780729 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpxd5\" (UniqueName: \"kubernetes.io/projected/1c0b11cb-b5d2-4036-8e43-12c20189b36f-kube-api-access-wpxd5\") pod \"1c0b11cb-b5d2-4036-8e43-12c20189b36f\" (UID: \"1c0b11cb-b5d2-4036-8e43-12c20189b36f\") " Sep 18 04:12:32.782867 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.782842 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0b11cb-b5d2-4036-8e43-12c20189b36f-kube-api-access-wpxd5" (OuterVolumeSpecName: "kube-api-access-wpxd5") pod "1c0b11cb-b5d2-4036-8e43-12c20189b36f" (UID: "1c0b11cb-b5d2-4036-8e43-12c20189b36f"). InnerVolumeSpecName "kube-api-access-wpxd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:12:32.875876 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.875846 2560 generic.go:356] "Generic (PLEG): container finished" podID="1c0b11cb-b5d2-4036-8e43-12c20189b36f" containerID="0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b" exitCode=0 Sep 18 04:12:32.876277 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.875883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" event={"ID":"1c0b11cb-b5d2-4036-8e43-12c20189b36f","Type":"ContainerDied","Data":"0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b"} Sep 18 04:12:32.876277 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.875887 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" Sep 18 04:12:32.876277 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.875913 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-ckgmp" event={"ID":"1c0b11cb-b5d2-4036-8e43-12c20189b36f","Type":"ContainerDied","Data":"46bcf84c06aa1d53025c59d222346bdd2ae0f6fc0adc13449f1b6a5e17edd7c5"} Sep 18 04:12:32.876277 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.875930 2560 scope.go:117] "RemoveContainer" containerID="0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b" Sep 18 04:12:32.881455 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.881427 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpxd5\" (UniqueName: \"kubernetes.io/projected/1c0b11cb-b5d2-4036-8e43-12c20189b36f-kube-api-access-wpxd5\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Sep 18 04:12:32.884369 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.884355 2560 scope.go:117] "RemoveContainer" containerID="0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b" Sep 18 04:12:32.884622 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:12:32.884607 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b\": container with ID starting with 0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b not found: ID does not exist" containerID="0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b" Sep 18 04:12:32.884671 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.884629 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b"} err="failed to get container status \"0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b\": rpc error: code = NotFound desc = could not find container \"0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b\": container with ID starting with 0aae0c6191685c4f039d91f96de3b6f8475b634bfc7f6ed673b8b7e4b6ccdc9b not found: ID does not exist" Sep 18 04:12:32.895781 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.895758 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-ckgmp"] Sep 18 04:12:32.899678 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:32.899660 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-ckgmp"] Sep 18 04:12:33.345972 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:33.345946 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c0b11cb-b5d2-4036-8e43-12c20189b36f" path="/var/lib/kubelet/pods/1c0b11cb-b5d2-4036-8e43-12c20189b36f/volumes" Sep 18 04:12:47.729755 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.729568 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp"] Sep 18 04:12:47.730218 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.729984 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0b11cb-b5d2-4036-8e43-12c20189b36f" containerName="authorino" Sep 18 04:12:47.730218 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.730000 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0b11cb-b5d2-4036-8e43-12c20189b36f" containerName="authorino" Sep 18 04:12:47.730218 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.730079 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c0b11cb-b5d2-4036-8e43-12c20189b36f" containerName="authorino" Sep 18 04:12:47.732443 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.732414 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:47.735232 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.735209 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 18 04:12:47.735528 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.735511 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dpxqb\"" Sep 18 04:12:47.736893 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.736873 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 04:12:47.737327 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.737161 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 04:12:47.743433 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.743275 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp"] Sep 18 04:12:47.770229 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.770203 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-77df98bf98-8pl5m"] Sep 18 04:12:47.772860 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.772843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:47.775236 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.775217 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lkg2s\"" Sep 18 04:12:47.775379 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.775324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 18 04:12:47.801318 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.796165 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-77df98bf98-8pl5m"] Sep 18 04:12:47.808876 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.808849 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7db885c774-mrk79"] Sep 18 04:12:47.809972 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.809949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhkm6\" (UniqueName: \"kubernetes.io/projected/9de7bf21-816b-4599-81f9-beab1927a1fd-kube-api-access-fhkm6\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:47.810085 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.810021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9de7bf21-816b-4599-81f9-beab1927a1fd-cert\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:47.812027 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.812011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:47.814316 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.814295 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 18 04:12:47.814468 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.814351 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Sep 18 04:12:47.814619 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.814424 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bjpzb\"" Sep 18 04:12:47.823944 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.823869 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-mrk79"] Sep 18 04:12:47.911349 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911313 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmx7\" (UniqueName: \"kubernetes.io/projected/4c3e14e8-57f1-4577-9912-4f18d52794c6-kube-api-access-vsmx7\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:47.911521 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9de7bf21-816b-4599-81f9-beab1927a1fd-cert\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:47.911521 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-metrics-certs\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:47.911521 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kckm2\" (UniqueName: \"kubernetes.io/projected/dbe09061-012d-4e8a-b0da-aa9a7606da89-kube-api-access-kckm2\") pod \"model-serving-api-77df98bf98-8pl5m\" (UID: \"dbe09061-012d-4e8a-b0da-aa9a7606da89\") " pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:47.911521 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-cert\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:47.911521 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:12:47.911489 2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 18 04:12:47.911766 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhkm6\" (UniqueName: \"kubernetes.io/projected/9de7bf21-816b-4599-81f9-beab1927a1fd-kube-api-access-fhkm6\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:47.911766 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:12:47.911563 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9de7bf21-816b-4599-81f9-beab1927a1fd-cert podName:9de7bf21-816b-4599-81f9-beab1927a1fd nodeName:}" failed. No retries permitted until 2026-09-18 04:12:48.411542459 +0000 UTC m=+357.177354467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9de7bf21-816b-4599-81f9-beab1927a1fd-cert") pod "kserve-controller-manager-7645b9c6f5-fzcdp" (UID: "9de7bf21-816b-4599-81f9-beab1927a1fd") : secret "kserve-webhook-server-cert" not found Sep 18 04:12:47.911766 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.911594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbe09061-012d-4e8a-b0da-aa9a7606da89-tls-certs\") pod \"model-serving-api-77df98bf98-8pl5m\" (UID: \"dbe09061-012d-4e8a-b0da-aa9a7606da89\") " pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:47.923002 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:47.922978 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhkm6\" (UniqueName: \"kubernetes.io/projected/9de7bf21-816b-4599-81f9-beab1927a1fd-kube-api-access-fhkm6\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:48.012800 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.012706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmx7\" (UniqueName: \"kubernetes.io/projected/4c3e14e8-57f1-4577-9912-4f18d52794c6-kube-api-access-vsmx7\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.012968 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.012856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-metrics-certs\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.013029 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.012985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kckm2\" (UniqueName: \"kubernetes.io/projected/dbe09061-012d-4e8a-b0da-aa9a7606da89-kube-api-access-kckm2\") pod \"model-serving-api-77df98bf98-8pl5m\" (UID: \"dbe09061-012d-4e8a-b0da-aa9a7606da89\") " pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:48.013029 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.013012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-cert\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.013140 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.013086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbe09061-012d-4e8a-b0da-aa9a7606da89-tls-certs\") pod \"model-serving-api-77df98bf98-8pl5m\" (UID: \"dbe09061-012d-4e8a-b0da-aa9a7606da89\") " pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:48.013312 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:12:48.013289 2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 18 04:12:48.013418 ip-10-0-132-223 kubenswrapper[2560]: E0918 04:12:48.013406 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-cert podName:4c3e14e8-57f1-4577-9912-4f18d52794c6 nodeName:}" failed. No retries permitted until 2026-09-18 04:12:48.513385893 +0000 UTC m=+357.279197910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-cert") pod "odh-model-controller-7db885c774-mrk79" (UID: "4c3e14e8-57f1-4577-9912-4f18d52794c6") : secret "odh-model-controller-webhook-cert" not found Sep 18 04:12:48.015833 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.015808 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbe09061-012d-4e8a-b0da-aa9a7606da89-tls-certs\") pod \"model-serving-api-77df98bf98-8pl5m\" (UID: \"dbe09061-012d-4e8a-b0da-aa9a7606da89\") " pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:48.015944 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.015808 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-metrics-certs\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.030830 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.030809 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kckm2\" (UniqueName: \"kubernetes.io/projected/dbe09061-012d-4e8a-b0da-aa9a7606da89-kube-api-access-kckm2\") pod \"model-serving-api-77df98bf98-8pl5m\" (UID: \"dbe09061-012d-4e8a-b0da-aa9a7606da89\") " pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:48.031338 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.031322 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmx7\" (UniqueName: \"kubernetes.io/projected/4c3e14e8-57f1-4577-9912-4f18d52794c6-kube-api-access-vsmx7\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.100773 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.100737 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:48.157035 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.157007 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xlx7m"] Sep 18 04:12:48.159415 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.159393 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.162390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.162114 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 18 04:12:48.164236 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.164020 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lfzmp\"" Sep 18 04:12:48.172942 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.172873 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xlx7m"] Sep 18 04:12:48.222640 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.222610 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp"] Sep 18 04:12:48.224893 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.224876 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.239328 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.239305 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp"] Sep 18 04:12:48.316160 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.316067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c2fk\" (UniqueName: \"kubernetes.io/projected/426d1659-5425-43a8-af84-26551efff22b-kube-api-access-2c2fk\") pod \"payload-pre-processing-59fbc47bf8-wj5qp\" (UID: \"426d1659-5425-43a8-af84-26551efff22b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.316160 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.316108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zhwk\" (UniqueName: \"kubernetes.io/projected/850ce62f-ae6a-4e85-a492-8bad1037d370-kube-api-access-6zhwk\") pod \"payload-processing-5b54b7fbb7-xlx7m\" (UID: \"850ce62f-ae6a-4e85-a492-8bad1037d370\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.316335 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.316245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/426d1659-5425-43a8-af84-26551efff22b-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wj5qp\" (UID: \"426d1659-5425-43a8-af84-26551efff22b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.316335 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.316284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/850ce62f-ae6a-4e85-a492-8bad1037d370-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xlx7m\" (UID: \"850ce62f-ae6a-4e85-a492-8bad1037d370\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.372706 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.372675 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-77df98bf98-8pl5m"] Sep 18 04:12:48.375756 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:48.375729 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe09061_012d_4e8a_b0da_aa9a7606da89.slice/crio-c3d16be88c8c2160ccd84abdfbf40318d3036cf9172bf85bb8787539e9ed013f WatchSource:0}: Error finding container c3d16be88c8c2160ccd84abdfbf40318d3036cf9172bf85bb8787539e9ed013f: Status 404 returned error can't find the container with id c3d16be88c8c2160ccd84abdfbf40318d3036cf9172bf85bb8787539e9ed013f Sep 18 04:12:48.417562 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.417524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/426d1659-5425-43a8-af84-26551efff22b-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wj5qp\" (UID: \"426d1659-5425-43a8-af84-26551efff22b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.417713 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.417565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/850ce62f-ae6a-4e85-a492-8bad1037d370-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xlx7m\" (UID: \"850ce62f-ae6a-4e85-a492-8bad1037d370\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.417713 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.417640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9de7bf21-816b-4599-81f9-beab1927a1fd-cert\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:48.417844 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.417823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2fk\" (UniqueName: \"kubernetes.io/projected/426d1659-5425-43a8-af84-26551efff22b-kube-api-access-2c2fk\") pod \"payload-pre-processing-59fbc47bf8-wj5qp\" (UID: \"426d1659-5425-43a8-af84-26551efff22b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.417907 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.417865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zhwk\" (UniqueName: \"kubernetes.io/projected/850ce62f-ae6a-4e85-a492-8bad1037d370-kube-api-access-6zhwk\") pod \"payload-processing-5b54b7fbb7-xlx7m\" (UID: \"850ce62f-ae6a-4e85-a492-8bad1037d370\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.418486 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.418459 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/426d1659-5425-43a8-af84-26551efff22b-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wj5qp\" (UID: \"426d1659-5425-43a8-af84-26551efff22b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.418563 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.418493 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/850ce62f-ae6a-4e85-a492-8bad1037d370-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xlx7m\" (UID: \"850ce62f-ae6a-4e85-a492-8bad1037d370\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.420052 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.420029 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9de7bf21-816b-4599-81f9-beab1927a1fd-cert\") pod \"kserve-controller-manager-7645b9c6f5-fzcdp\" (UID: \"9de7bf21-816b-4599-81f9-beab1927a1fd\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:48.431842 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.431820 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c2fk\" (UniqueName: \"kubernetes.io/projected/426d1659-5425-43a8-af84-26551efff22b-kube-api-access-2c2fk\") pod \"payload-pre-processing-59fbc47bf8-wj5qp\" (UID: \"426d1659-5425-43a8-af84-26551efff22b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.432072 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.432052 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zhwk\" (UniqueName: \"kubernetes.io/projected/850ce62f-ae6a-4e85-a492-8bad1037d370-kube-api-access-6zhwk\") pod \"payload-processing-5b54b7fbb7-xlx7m\" (UID: \"850ce62f-ae6a-4e85-a492-8bad1037d370\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.476109 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.476080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:48.519386 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.519350 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-cert\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.521592 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.521570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3e14e8-57f1-4577-9912-4f18d52794c6-cert\") pod \"odh-model-controller-7db885c774-mrk79\" (UID: \"4c3e14e8-57f1-4577-9912-4f18d52794c6\") " pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.534555 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.534532 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:48.654489 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.654461 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:48.728649 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.728619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:48.750272 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.750245 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xlx7m"] Sep 18 04:12:48.751580 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:48.751550 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850ce62f_ae6a_4e85_a492_8bad1037d370.slice/crio-4d6ef7c84104b0ceec0721d2c5dcc8e521755b53a21833b7e67053eabdfa88bf WatchSource:0}: Error finding container 4d6ef7c84104b0ceec0721d2c5dcc8e521755b53a21833b7e67053eabdfa88bf: Status 404 returned error can't find the container with id 4d6ef7c84104b0ceec0721d2c5dcc8e521755b53a21833b7e67053eabdfa88bf Sep 18 04:12:48.811542 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.811480 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp"] Sep 18 04:12:48.814608 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:48.814571 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426d1659_5425_43a8_af84_26551efff22b.slice/crio-62a63fa17a7c9177ef99937b61f87e54397040281ee2b1af011eb649f90140b1 WatchSource:0}: Error finding container 62a63fa17a7c9177ef99937b61f87e54397040281ee2b1af011eb649f90140b1: Status 404 returned error can't find the container with id 62a63fa17a7c9177ef99937b61f87e54397040281ee2b1af011eb649f90140b1 Sep 18 04:12:48.929277 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.929252 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp"] Sep 18 04:12:48.931053 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:48.931025 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de7bf21_816b_4599_81f9_beab1927a1fd.slice/crio-9a5142783f9238b8d64c4886a7963f3014d3c5c128cc27c76b14ee6389bb48e9 WatchSource:0}: Error finding container 9a5142783f9238b8d64c4886a7963f3014d3c5c128cc27c76b14ee6389bb48e9: Status 404 returned error can't find the container with id 9a5142783f9238b8d64c4886a7963f3014d3c5c128cc27c76b14ee6389bb48e9 Sep 18 04:12:48.946703 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.946672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" event={"ID":"9de7bf21-816b-4599-81f9-beab1927a1fd","Type":"ContainerStarted","Data":"9a5142783f9238b8d64c4886a7963f3014d3c5c128cc27c76b14ee6389bb48e9"} Sep 18 04:12:48.948094 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.948071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" event={"ID":"426d1659-5425-43a8-af84-26551efff22b","Type":"ContainerStarted","Data":"62a63fa17a7c9177ef99937b61f87e54397040281ee2b1af011eb649f90140b1"} Sep 18 04:12:48.949325 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.949306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" event={"ID":"850ce62f-ae6a-4e85-a492-8bad1037d370","Type":"ContainerStarted","Data":"4d6ef7c84104b0ceec0721d2c5dcc8e521755b53a21833b7e67053eabdfa88bf"} Sep 18 04:12:48.950402 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:48.950384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" event={"ID":"dbe09061-012d-4e8a-b0da-aa9a7606da89","Type":"ContainerStarted","Data":"c3d16be88c8c2160ccd84abdfbf40318d3036cf9172bf85bb8787539e9ed013f"} Sep 18 04:12:49.015193 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:49.015163 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-mrk79"] Sep 18 04:12:49.017414 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:49.017382 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3e14e8_57f1_4577_9912_4f18d52794c6.slice/crio-b77df2d462e5e5591b61771df4d6cef67527bced5e4b41f8568346398a231d7f WatchSource:0}: Error finding container b77df2d462e5e5591b61771df4d6cef67527bced5e4b41f8568346398a231d7f: Status 404 returned error can't find the container with id b77df2d462e5e5591b61771df4d6cef67527bced5e4b41f8568346398a231d7f Sep 18 04:12:49.957390 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:49.957349 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-mrk79" event={"ID":"4c3e14e8-57f1-4577-9912-4f18d52794c6","Type":"ContainerStarted","Data":"b77df2d462e5e5591b61771df4d6cef67527bced5e4b41f8568346398a231d7f"} Sep 18 04:12:50.969205 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.968264 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" event={"ID":"426d1659-5425-43a8-af84-26551efff22b","Type":"ContainerStarted","Data":"42b79618408599ef8bf89c269d660cb3886464baf9a204d710dcb715a9432fea"} Sep 18 04:12:50.969205 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.969120 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:12:50.972577 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.972440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" event={"ID":"850ce62f-ae6a-4e85-a492-8bad1037d370","Type":"ContainerStarted","Data":"66b04ecf190ccbadd8921a75e9e8f146d2b334755611700302080900ed0d32b2"} Sep 18 04:12:50.972996 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.972973 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:12:50.975062 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.975009 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" event={"ID":"dbe09061-012d-4e8a-b0da-aa9a7606da89","Type":"ContainerStarted","Data":"2fcf9ceffd3d3ccba2c7c1fd0600c1901f7e57a1d5237537397cc84e1efc42fd"} Sep 18 04:12:50.975204 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.975163 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:12:50.988432 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:50.987532 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" podStartSLOduration=1.48387708 podStartE2EDuration="2.987515295s" totalImagesPullingTime="1.503638215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:50.985210156 +0000 UTC m=+359.751022179" watchObservedRunningTime="2026-09-18 04:12:50.987515295 +0000 UTC m=+359.753327323" Sep 18 04:12:51.003173 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:51.001333 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" podStartSLOduration=2.06123634 podStartE2EDuration="4.001316516s" totalImagesPullingTime="1.940080176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:51.000003443 +0000 UTC m=+359.765815497" watchObservedRunningTime="2026-09-18 04:12:51.001316516 +0000 UTC m=+359.767128545" Sep 18 04:12:51.016976 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:51.016924 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" podStartSLOduration=1.452940163 podStartE2EDuration="3.016905377s" totalImagesPullingTime="1.563965214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:51.013866732 +0000 UTC m=+359.779678764" watchObservedRunningTime="2026-09-18 04:12:51.016905377 +0000 UTC m=+359.782717407" Sep 18 04:12:53.994234 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:53.994193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" event={"ID":"9de7bf21-816b-4599-81f9-beab1927a1fd","Type":"ContainerStarted","Data":"f4c02158319afd6f39746253c606a57ac339aee8ce9e26075d78a9355fe37f30"} Sep 18 04:12:53.994741 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:53.994304 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:12:53.995847 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:53.995825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-mrk79" event={"ID":"4c3e14e8-57f1-4577-9912-4f18d52794c6","Type":"ContainerStarted","Data":"32d7bfac7dbf422feba0c8d8bcad13cd4fb81ea2689921852b21bb6c756ab8f7"} Sep 18 04:12:53.995975 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:53.995959 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:12:54.012700 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:54.012636 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" podStartSLOduration=2.082107306 podStartE2EDuration="7.012614689s" totalImagesPullingTime="4.930507383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:54.010085963 +0000 UTC m=+362.775897992" watchObservedRunningTime="2026-09-18 04:12:54.012614689 +0000 UTC m=+362.778426718" Sep 18 04:12:54.026397 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:54.026349 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7db885c774-mrk79" podStartSLOduration=2.172811662 podStartE2EDuration="7.026334921s" totalImagesPullingTime="4.853523259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:12:54.025494558 +0000 UTC m=+362.791306578" watchObservedRunningTime="2026-09-18 04:12:54.026334921 +0000 UTC m=+362.792146973" Sep 18 04:12:58.690210 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.690172 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l"] Sep 18 04:12:58.693414 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.693391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.697118 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.697098 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 18 04:12:58.697118 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.697103 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 18 04:12:58.697312 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.697141 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pj9r2\"" Sep 18 04:12:58.704116 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.704092 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l"] Sep 18 04:12:58.816825 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.816786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/589ea8ea-d742-41f9-8288-7bfabd597c24-metrics-certs\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.817099 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.817070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/589ea8ea-d742-41f9-8288-7bfabd597c24-maas-api-tls\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.817253 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.817119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/589ea8ea-d742-41f9-8288-7bfabd597c24-openshift-service-ca\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.817253 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.817210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cw65\" (UniqueName: \"kubernetes.io/projected/589ea8ea-d742-41f9-8288-7bfabd597c24-kube-api-access-6cw65\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.918266 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.918234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/589ea8ea-d742-41f9-8288-7bfabd597c24-openshift-service-ca\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.918474 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.918291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cw65\" (UniqueName: \"kubernetes.io/projected/589ea8ea-d742-41f9-8288-7bfabd597c24-kube-api-access-6cw65\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.918474 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.918351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/589ea8ea-d742-41f9-8288-7bfabd597c24-metrics-certs\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.918474 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.918383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/589ea8ea-d742-41f9-8288-7bfabd597c24-maas-api-tls\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.919392 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.919357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/589ea8ea-d742-41f9-8288-7bfabd597c24-openshift-service-ca\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.920859 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.920833 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/589ea8ea-d742-41f9-8288-7bfabd597c24-metrics-certs\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.920962 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.920900 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/589ea8ea-d742-41f9-8288-7bfabd597c24-maas-api-tls\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:58.934631 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:58.934608 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cw65\" (UniqueName: \"kubernetes.io/projected/589ea8ea-d742-41f9-8288-7bfabd597c24-kube-api-access-6cw65\") pod \"maas-api-dc9c5d49d-fwm5l\" (UID: \"589ea8ea-d742-41f9-8288-7bfabd597c24\") " pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:59.004386 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:59.004359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:12:59.275640 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:12:59.275591 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l"] Sep 18 04:12:59.278205 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:12:59.278168 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589ea8ea_d742_41f9_8288_7bfabd597c24.slice/crio-35460b5b9ab1db88a93db91b2c613f7eff232f8f9bb7301eb7af584a2a633b34 WatchSource:0}: Error finding container 35460b5b9ab1db88a93db91b2c613f7eff232f8f9bb7301eb7af584a2a633b34: Status 404 returned error can't find the container with id 35460b5b9ab1db88a93db91b2c613f7eff232f8f9bb7301eb7af584a2a633b34 Sep 18 04:13:00.025198 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:00.025164 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" event={"ID":"589ea8ea-d742-41f9-8288-7bfabd597c24","Type":"ContainerStarted","Data":"35460b5b9ab1db88a93db91b2c613f7eff232f8f9bb7301eb7af584a2a633b34"} Sep 18 04:13:01.031653 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:01.031614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" event={"ID":"589ea8ea-d742-41f9-8288-7bfabd597c24","Type":"ContainerStarted","Data":"e32cf296a507562188b5b1612ce0c0caa3717241d7bb60a2058a7c889ee002e7"} Sep 18 04:13:01.032044 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:01.031745 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:13:01.049184 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:01.049139 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" podStartSLOduration=1.7655438669999999 podStartE2EDuration="3.049111211s" totalImagesPullingTime="1.283567344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:13:01.048086959 +0000 UTC m=+369.813898990" watchObservedRunningTime="2026-09-18 04:13:01.049111211 +0000 UTC m=+369.814923238" Sep 18 04:13:01.986220 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:01.986194 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-77df98bf98-8pl5m" Sep 18 04:13:02.989544 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:02.989516 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wj5qp" Sep 18 04:13:02.989978 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:02.989584 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xlx7m" Sep 18 04:13:05.002041 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:05.002006 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7db885c774-mrk79" Sep 18 04:13:07.042673 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:07.042640 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dc9c5d49d-fwm5l" Sep 18 04:13:25.004949 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:13:25.004920 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7645b9c6f5-fzcdp" Sep 18 04:16:12.276764 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.276688 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v"] Sep 18 04:16:12.279048 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.279026 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.281923 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.281894 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 04:16:12.282911 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.282892 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 04:16:12.283188 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.283172 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vpnt7\"" Sep 18 04:16:12.283252 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.283227 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 18 04:16:12.290676 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.290647 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v"] Sep 18 04:16:12.303309 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.303287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.303411 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.303318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.303411 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.303338 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.303411 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.303382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/532877ce-40e2-4a86-aa99-9877ee59c747-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.303607 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.303434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.303607 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.303530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq2wr\" (UniqueName: \"kubernetes.io/projected/532877ce-40e2-4a86-aa99-9877ee59c747-kube-api-access-zq2wr\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404050 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404009 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq2wr\" (UniqueName: \"kubernetes.io/projected/532877ce-40e2-4a86-aa99-9877ee59c747-kube-api-access-zq2wr\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404235 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404235 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404235 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404399 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/532877ce-40e2-4a86-aa99-9877ee59c747-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404399 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404520 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404498 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404578 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.404626 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.404603 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.406465 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.406439 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/532877ce-40e2-4a86-aa99-9877ee59c747-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.406641 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.406623 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/532877ce-40e2-4a86-aa99-9877ee59c747-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.411956 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.411935 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq2wr\" (UniqueName: \"kubernetes.io/projected/532877ce-40e2-4a86-aa99-9877ee59c747-kube-api-access-zq2wr\") pod \"facebook-opt-125m-simulated-kserve-89945f574-jrd4v\" (UID: \"532877ce-40e2-4a86-aa99-9877ee59c747\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.590273 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.590191 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:12.860626 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.860598 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v"] Sep 18 04:16:12.861944 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:16:12.861919 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532877ce_40e2_4a86_aa99_9877ee59c747.slice/crio-9da5720fc9920193b5b8e73d7a5bb94f6f80c98a405f72038e253356880846c8 WatchSource:0}: Error finding container 9da5720fc9920193b5b8e73d7a5bb94f6f80c98a405f72038e253356880846c8: Status 404 returned error can't find the container with id 9da5720fc9920193b5b8e73d7a5bb94f6f80c98a405f72038e253356880846c8 Sep 18 04:16:12.918233 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:12.918204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" event={"ID":"532877ce-40e2-4a86-aa99-9877ee59c747","Type":"ContainerStarted","Data":"9da5720fc9920193b5b8e73d7a5bb94f6f80c98a405f72038e253356880846c8"} Sep 18 04:16:13.924755 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:13.924716 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" event={"ID":"532877ce-40e2-4a86-aa99-9877ee59c747","Type":"ContainerStarted","Data":"750e94793de88053517aa4ffcd76757a04ef8250e4dbf9f7c5886c37c2660fd6"} Sep 18 04:16:13.942023 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:13.941975 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" podStartSLOduration=1.019925395 podStartE2EDuration="1.941959485s" totalImagesPullingTime="922.03409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:16:13.940346787 +0000 UTC m=+562.706158816" watchObservedRunningTime="2026-09-18 04:16:13.941959485 +0000 UTC m=+562.707771527" Sep 18 04:16:14.591073 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:14.591044 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:22.590779 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:22.590745 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:22.603353 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:22.603327 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:22.976753 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:22.976727 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-jrd4v" Sep 18 04:16:26.779239 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.779202 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5"] Sep 18 04:16:26.781823 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.781803 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.784396 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.784370 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 18 04:16:26.793289 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.793267 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5"] Sep 18 04:16:26.820023 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.819996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.820163 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.820045 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30034c9-0803-422e-8dd6-4a0a0da0594f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.820163 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.820119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2q59\" (UniqueName: \"kubernetes.io/projected/c30034c9-0803-422e-8dd6-4a0a0da0594f-kube-api-access-c2q59\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.820259 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.820168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.820259 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.820211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.820259 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.820243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.920640 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.920607 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.920792 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.920663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.920792 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.920688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.920792 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.920711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.920792 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.920745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30034c9-0803-422e-8dd6-4a0a0da0594f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.920792 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.920777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2q59\" (UniqueName: \"kubernetes.io/projected/c30034c9-0803-422e-8dd6-4a0a0da0594f-kube-api-access-c2q59\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.921069 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.921047 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.921188 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.921164 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.921250 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.921168 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.923012 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.922988 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30034c9-0803-422e-8dd6-4a0a0da0594f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.923243 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.923226 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30034c9-0803-422e-8dd6-4a0a0da0594f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:26.928556 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:26.928534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2q59\" (UniqueName: \"kubernetes.io/projected/c30034c9-0803-422e-8dd6-4a0a0da0594f-kube-api-access-c2q59\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5\" (UID: \"c30034c9-0803-422e-8dd6-4a0a0da0594f\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:27.091090 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:27.091016 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:27.360473 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:27.360450 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5"] Sep 18 04:16:27.362135 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:16:27.362092 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc30034c9_0803_422e_8dd6_4a0a0da0594f.slice/crio-3142c4648884a270947ac4f2647b753979f1fd234a924847148cd9456c4c641b WatchSource:0}: Error finding container 3142c4648884a270947ac4f2647b753979f1fd234a924847148cd9456c4c641b: Status 404 returned error can't find the container with id 3142c4648884a270947ac4f2647b753979f1fd234a924847148cd9456c4c641b Sep 18 04:16:27.992956 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:27.992921 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" event={"ID":"c30034c9-0803-422e-8dd6-4a0a0da0594f","Type":"ContainerStarted","Data":"6ca188373806da8bc9138f919e556b29ea65e91c8ca370749d12cd39617606cb"} Sep 18 04:16:27.992956 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:27.992962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" event={"ID":"c30034c9-0803-422e-8dd6-4a0a0da0594f","Type":"ContainerStarted","Data":"3142c4648884a270947ac4f2647b753979f1fd234a924847148cd9456c4c641b"} Sep 18 04:16:28.010423 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:28.010375 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" podStartSLOduration=1.8498682199999998 podStartE2EDuration="2.010360775s" totalImagesPullingTime="160.492555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:16:28.009433744 +0000 UTC m=+576.775245771" watchObservedRunningTime="2026-09-18 04:16:28.010360775 +0000 UTC m=+576.776172803" Sep 18 04:16:28.091937 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:28.091908 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:37.091208 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:37.091167 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:37.105180 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:37.105152 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:16:38.056194 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:16:38.056166 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5" Sep 18 04:22:24.556838 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:24.556804 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7645b9c6f5-fzcdp_9de7bf21-816b-4599-81f9-beab1927a1fd/manager/0.log" Sep 18 04:22:25.047262 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:25.047232 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-77df98bf98-8pl5m_dbe09061-012d-4e8a-b0da-aa9a7606da89/server/0.log" Sep 18 04:22:25.164387 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:25.164352 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-mrk79_4c3e14e8-57f1-4577-9912-4f18d52794c6/manager/0.log" Sep 18 04:22:25.497414 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:25.497383 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dc9c5d49d-fwm5l_589ea8ea-d742-41f9-8288-7bfabd597c24/maas-api/0.log" Sep 18 04:22:25.735252 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:25.735223 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qp828_de715f1c-6ec5-4dd4-a1f6-fc167cb1bf89/postgres/0.log" Sep 18 04:22:26.829442 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:26.829414 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-74d69_89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22/kuadrant-console-plugin/0.log" Sep 18 04:22:27.518137 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:27.518094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5_b910d1ee-5e63-42b8-be90-3aa7e66be788/istio-proxy/0.log" Sep 18 04:22:27.857187 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:27.857075 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c4f5c7b75-pmkvc_b48f5fef-bc3e-402c-ac7b-249537ba357a/kube-auth-proxy/0.log" Sep 18 04:22:28.079039 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:28.079011 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb_1e5a8eb1-e04a-4c4b-80be-13d296147a9c/istio-proxy/0.log" Sep 18 04:22:28.184433 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:28.184355 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wj5qp_426d1659-5425-43a8-af84-26551efff22b/payload-pre-processing/0.log" Sep 18 04:22:28.296192 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:28.296161 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xlx7m_850ce62f-ae6a-4e85-a492-8bad1037d370/payload-processing/0.log" Sep 18 04:22:29.322886 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:29.322854 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-jrd4v_532877ce-40e2-4a86-aa99-9877ee59c747/main/0.log" Sep 18 04:22:29.433209 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:29.433183 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-xsjc5_c30034c9-0803-422e-8dd6-4a0a0da0594f/main/0.log" Sep 18 04:22:37.836072 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:37.836040 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6lctk_a823d1f9-c5bd-4ac9-924b-de7cf049c1e5/global-pull-secret-syncer/0.log" Sep 18 04:22:37.994849 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:37.994820 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xpqlg_14fc9f49-e30e-4799-b4d6-766dff65f85d/konnectivity-agent/0.log" Sep 18 04:22:38.065992 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:38.065954 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-223.ec2.internal_1b6211f16feaea8a35000a897638fac3/haproxy/0.log" Sep 18 04:22:42.591969 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:42.591941 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-74d69_89b61aa3-8b54-4c9c-9bde-6cd4ee43cc22/kuadrant-console-plugin/0.log" Sep 18 04:22:44.478958 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:44.478906 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnbd7_25136a5c-6723-4547-8e8a-71e2bbfeb3a6/node-exporter/0.log" Sep 18 04:22:44.508659 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:44.508637 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnbd7_25136a5c-6723-4547-8e8a-71e2bbfeb3a6/kube-rbac-proxy/0.log" Sep 18 04:22:44.523399 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:44.523375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnbd7_25136a5c-6723-4547-8e8a-71e2bbfeb3a6/init-textfile/0.log" Sep 18 04:22:47.204404 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.204371 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87"] Sep 18 04:22:47.207580 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.207561 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.210317 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.210287 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h5svb\"/\"openshift-service-ca.crt\"" Sep 18 04:22:47.210435 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.210295 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h5svb\"/\"kube-root-ca.crt\"" Sep 18 04:22:47.210435 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.210327 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h5svb\"/\"default-dockercfg-6nqjg\"" Sep 18 04:22:47.215893 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.215866 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87"] Sep 18 04:22:47.243529 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.243502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-proc\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.243624 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.243536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vv8j\" (UniqueName: \"kubernetes.io/projected/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-kube-api-access-6vv8j\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.243624 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.243608 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-podres\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.243697 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.243640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-lib-modules\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.243697 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.243669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-sys\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344074 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-podres\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344261 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-lib-modules\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344261 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344213 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-podres\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344261 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-sys\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344481 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344272 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-lib-modules\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344481 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344316 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-sys\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344481 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344330 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-proc\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344481 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vv8j\" (UniqueName: \"kubernetes.io/projected/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-kube-api-access-6vv8j\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.344481 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.344408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-proc\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.353271 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.353250 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vv8j\" (UniqueName: \"kubernetes.io/projected/63dd17d3-700c-4a0f-b8d5-4caa32e6ee49-kube-api-access-6vv8j\") pod \"perf-node-gather-daemonset-c7l87\" (UID: \"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49\") " pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.518537 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.518506 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:47.787206 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.787179 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87"] Sep 18 04:22:47.789257 ip-10-0-132-223 kubenswrapper[2560]: W0918 04:22:47.789228 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod63dd17d3_700c_4a0f_b8d5_4caa32e6ee49.slice/crio-18f46e97cb986621dda944d38792ffbefa68c742c578db47a1065afee6d34c21 WatchSource:0}: Error finding container 18f46e97cb986621dda944d38792ffbefa68c742c578db47a1065afee6d34c21: Status 404 returned error can't find the container with id 18f46e97cb986621dda944d38792ffbefa68c742c578db47a1065afee6d34c21 Sep 18 04:22:47.845978 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:47.845953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" event={"ID":"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49","Type":"ContainerStarted","Data":"18f46e97cb986621dda944d38792ffbefa68c742c578db47a1065afee6d34c21"} Sep 18 04:22:48.852242 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:48.852206 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" event={"ID":"63dd17d3-700c-4a0f-b8d5-4caa32e6ee49","Type":"ContainerStarted","Data":"47b5b7d941199dd8d936c8aee077492630369b288738bf0ecfba95af0c8eb2c2"} Sep 18 04:22:48.852733 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:48.852353 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:48.870254 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:48.870204 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" podStartSLOduration=1.8701886669999999 podStartE2EDuration="1.870188667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:48.867906261 +0000 UTC m=+957.633718288" watchObservedRunningTime="2026-09-18 04:22:48.870188667 +0000 UTC m=+957.636000695" Sep 18 04:22:49.428900 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:49.428875 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lv9jw_0e8bf73c-719d-4d6a-90ab-1738f48d77f0/dns/0.log" Sep 18 04:22:49.449685 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:49.449659 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lv9jw_0e8bf73c-719d-4d6a-90ab-1738f48d77f0/kube-rbac-proxy/0.log" Sep 18 04:22:49.472393 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:49.472367 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nwtr5_03f47ad4-073b-4dcb-89a8-5055a26988ff/dns-node-resolver/0.log" Sep 18 04:22:50.069106 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:50.069079 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nkhgd_d0b951b1-163f-4376-8992-875ad0219de6/node-ca/0.log" Sep 18 04:22:50.962870 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:50.962843 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5_b910d1ee-5e63-42b8-be90-3aa7e66be788/istio-proxy/0.log" Sep 18 04:22:51.057979 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:51.057955 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c4f5c7b75-pmkvc_b48f5fef-bc3e-402c-ac7b-249537ba357a/kube-auth-proxy/0.log" Sep 18 04:22:51.106645 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:51.106617 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb_1e5a8eb1-e04a-4c4b-80be-13d296147a9c/istio-proxy/0.log" Sep 18 04:22:51.132078 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:51.132055 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wj5qp_426d1659-5425-43a8-af84-26551efff22b/payload-pre-processing/0.log" Sep 18 04:22:51.153117 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:51.153094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xlx7m_850ce62f-ae6a-4e85-a492-8bad1037d370/payload-processing/0.log" Sep 18 04:22:51.818772 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:51.818744 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgx4l_9edb819a-eb6f-4820-aec2-af752857ab8a/serve-healthcheck-canary/0.log" Sep 18 04:22:52.502671 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:52.502633 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zd9lc_be87ffa2-f151-462c-a8e0-82642ff66781/kube-rbac-proxy/0.log" Sep 18 04:22:52.526850 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:52.526821 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zd9lc_be87ffa2-f151-462c-a8e0-82642ff66781/exporter/0.log" Sep 18 04:22:52.546340 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:52.546317 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zd9lc_be87ffa2-f151-462c-a8e0-82642ff66781/extractor/0.log" Sep 18 04:22:54.671836 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:54.671802 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6_2ee14ffa-da0b-4f26-954a-44208fe4a377/manager/0.log" Sep 18 04:22:54.696060 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:54.696036 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7c7cdfcfb9-84gw6_2ee14ffa-da0b-4f26-954a-44208fe4a377/copy-manifests/0.log" Sep 18 04:22:54.866560 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:54.866533 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h5svb/perf-node-gather-daemonset-c7l87" Sep 18 04:22:56.184172 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.184136 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5_b910d1ee-5e63-42b8-be90-3aa7e66be788/istio-proxy/0.log" Sep 18 04:22:56.257222 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.257194 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c4f5c7b75-pmkvc_b48f5fef-bc3e-402c-ac7b-249537ba357a/kube-auth-proxy/0.log" Sep 18 04:22:56.291272 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.291181 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb_1e5a8eb1-e04a-4c4b-80be-13d296147a9c/istio-proxy/0.log" Sep 18 04:22:56.310380 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.310360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wj5qp_426d1659-5425-43a8-af84-26551efff22b/payload-pre-processing/0.log" Sep 18 04:22:56.327043 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.327027 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xlx7m_850ce62f-ae6a-4e85-a492-8bad1037d370/payload-processing/0.log" Sep 18 04:22:56.720094 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.720070 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7645b9c6f5-fzcdp_9de7bf21-816b-4599-81f9-beab1927a1fd/manager/0.log" Sep 18 04:22:56.859939 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.859910 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-77df98bf98-8pl5m_dbe09061-012d-4e8a-b0da-aa9a7606da89/server/0.log" Sep 18 04:22:56.894336 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:56.894306 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-mrk79_4c3e14e8-57f1-4577-9912-4f18d52794c6/manager/0.log" Sep 18 04:22:57.567703 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:57.567678 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vqhk5_b910d1ee-5e63-42b8-be90-3aa7e66be788/istio-proxy/0.log" Sep 18 04:22:57.628347 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:57.628321 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c4f5c7b75-pmkvc_b48f5fef-bc3e-402c-ac7b-249537ba357a/kube-auth-proxy/0.log" Sep 18 04:22:57.674507 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:57.674482 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-tvrhb_1e5a8eb1-e04a-4c4b-80be-13d296147a9c/istio-proxy/0.log" Sep 18 04:22:57.690291 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:57.690247 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wj5qp_426d1659-5425-43a8-af84-26551efff22b/payload-pre-processing/0.log" Sep 18 04:22:57.705318 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:22:57.705298 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xlx7m_850ce62f-ae6a-4e85-a492-8bad1037d370/payload-processing/0.log" Sep 18 04:23:01.522397 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:01.522368 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-tnbbx_4a257edd-e624-4e75-a373-c3412bcc205c/migrator/0.log" Sep 18 04:23:01.541583 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:01.541552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-tnbbx_4a257edd-e624-4e75-a373-c3412bcc205c/graceful-termination/0.log" Sep 18 04:23:02.830585 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.830558 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/kube-multus-additional-cni-plugins/0.log" Sep 18 04:23:02.850148 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.850094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/egress-router-binary-copy/0.log" Sep 18 04:23:02.868886 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.868839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/cni-plugins/0.log" Sep 18 04:23:02.888527 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.888318 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/bond-cni-plugin/0.log" Sep 18 04:23:02.905957 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.905918 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/routeoverride-cni/0.log" Sep 18 04:23:02.923453 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.923432 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/whereabouts-cni-bincopy/0.log" Sep 18 04:23:02.941346 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:02.941317 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vc4c_d620b21a-d1cc-4952-a1c0-23086877f2fe/whereabouts-cni/0.log" Sep 18 04:23:03.313058 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:03.313028 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t2r79_6b3566b3-59fa-47b3-a9ba-b626c8625ed5/kube-multus/0.log" Sep 18 04:23:03.374950 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:03.374913 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k8j66_5cbd097f-667b-4edf-a3fd-f8db1971b314/network-metrics-daemon/0.log" Sep 18 04:23:03.395740 ip-10-0-132-223 kubenswrapper[2560]: I0918 04:23:03.395722 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k8j66_5cbd097f-667b-4edf-a3fd-f8db1971b314/kube-rbac-proxy/0.log"