Jul 10 20:55:36.479626 ip-10-0-137-232 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 20:55:36.479654 ip-10-0-137-232 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 20:55:36.479663 ip-10-0-137-232 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 20:55:36.479975 ip-10-0-137-232 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 20:55:45.859916 ip-10-0-137-232 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 10 20:55:45.859931 ip-10-0-137-232 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 814d97c15b554e8e8f512ba9b4110876 -- Jul 10 20:57:36.441214 ip-10-0-137-232 systemd[1]: Starting Kubernetes Kubelet... Jul 10 20:57:36.889378 ip-10-0-137-232 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:57:36.889378 ip-10-0-137-232 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 20:57:36.889378 ip-10-0-137-232 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:57:36.889378 ip-10-0-137-232 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 20:57:36.889378 ip-10-0-137-232 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:57:36.891731 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.891606 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 20:57:36.900221 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900204 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900222 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900227 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900231 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900234 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900237 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900241 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900244 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900247 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900250 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900252 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900256 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900258 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900261 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900264 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900267 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900270 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:57:36.900265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900273 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900276 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900283 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900287 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900289 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900292 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900295 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900298 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900300 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900303 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900305 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900308 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900311 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900314 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900316 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900319 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900322 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900324 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900328 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:57:36.900708 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900332 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900335 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900338 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900341 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900344 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900347 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900350 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900353 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900355 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900358 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900361 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900363 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900366 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900368 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900371 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900375 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900378 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900381 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900383 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900387 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:57:36.901208 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900389 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900392 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900395 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900398 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900400 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900403 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900405 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900408 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900411 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900413 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900416 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900419 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900422 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900424 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900427 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900430 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900432 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900435 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900438 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900441 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:57:36.901749 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900443 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900446 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900448 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900464 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900467 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900469 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900473 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900480 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900484 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900487 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900490 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900493 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900496 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900498 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900501 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900504 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900507 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900510 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900513 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:57:36.902262 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900515 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900518 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900521 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.900524 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901263 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901270 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901273 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901278 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901280 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901283 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901286 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901289 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901292 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901295 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901298 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901300 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901303 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901306 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901308 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901311 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:57:36.902770 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901315 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901318 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901321 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901324 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901327 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901330 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901333 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901335 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901339 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901343 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901347 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901351 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901354 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901357 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901359 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901362 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901365 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901367 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901370 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:57:36.903519 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901373 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901375 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901378 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901381 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901384 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901387 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901390 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901393 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901396 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901399 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901402 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901405 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901410 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901415 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901418 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901421 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901425 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901427 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901430 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901433 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:57:36.904361 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901436 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901439 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901442 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901444 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901448 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901451 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901453 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901456 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901459 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901462 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901464 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901467 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901470 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901472 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901475 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901478 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901481 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901483 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901486 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901489 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:57:36.904909 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901510 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901514 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901517 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901519 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901522 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901526 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901529 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901532 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901535 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901538 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901541 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901544 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901547 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901550 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901552 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901555 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901558 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901561 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901563 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901566 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:57:36.905422 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901569 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901571 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901574 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901577 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901967 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901973 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901976 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901979 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901982 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901985 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901988 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901991 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901993 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901996 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.901999 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902002 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902005 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902009 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902012 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902015 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:57:36.905941 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902018 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902021 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902024 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902027 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902030 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902032 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902036 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902039 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902041 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902044 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902047 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902049 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902052 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902055 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902059 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902063 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902067 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902070 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902073 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:57:36.906442 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902075 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902078 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902081 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902084 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902086 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902089 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902091 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902094 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902097 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902102 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902105 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902108 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902111 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902114 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902117 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902120 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902123 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902126 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902129 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902132 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:57:36.906948 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902134 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902138 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902140 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902143 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902146 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902149 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902151 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902154 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902157 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902160 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902162 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902165 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902168 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902171 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902174 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902176 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902179 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902182 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902184 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902187 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:57:36.907469 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902190 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902194 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902197 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902201 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902205 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902208 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902211 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902214 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902218 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902221 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902225 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902228 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902230 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902233 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902236 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902239 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902242 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902245 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902248 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:57:36.908002 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902250 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902254 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902258 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902261 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.902264 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902339 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902346 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902353 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902358 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902362 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902365 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902370 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902374 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902378 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902382 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902386 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902390 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902393 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902396 2585 flags.go:64] FLAG: --cgroup-root="" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902400 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902403 2585 flags.go:64] FLAG: --client-ca-file="" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902406 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902409 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 20:57:36.908487 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902414 2585 flags.go:64] FLAG: --cluster-domain="" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902417 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902421 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902424 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902428 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902432 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902435 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902438 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902441 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902445 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902448 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902451 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902454 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902457 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902461 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902465 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902468 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902471 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902474 2585 flags.go:64] FLAG: --enable-server="true" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902477 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902483 2585 flags.go:64] FLAG: --event-burst="100" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902486 2585 flags.go:64] FLAG: --event-qps="50" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902504 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902509 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 20:57:36.909134 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902514 2585 flags.go:64] FLAG: --eviction-hard="" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902518 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902522 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902525 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902528 2585 flags.go:64] FLAG: --eviction-soft="" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902532 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902535 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902538 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902542 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902545 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902548 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902552 2585 flags.go:64] FLAG: --feature-gates="" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902556 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902559 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902562 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902566 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902569 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902573 2585 flags.go:64] FLAG: --help="false" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902576 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-137-232.ec2.internal" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902579 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902582 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902585 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902588 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 20:57:36.909785 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902592 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902595 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902598 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902601 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902604 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902607 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902611 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902614 2585 flags.go:64] FLAG: --kube-reserved="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902618 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902623 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902626 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902630 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902633 2585 flags.go:64] FLAG: --lock-file="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902635 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902639 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902642 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902648 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902651 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902654 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902658 2585 flags.go:64] FLAG: --logging-format="text" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902661 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902664 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902667 2585 flags.go:64] FLAG: --manifest-url="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902670 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902675 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 20:57:36.910448 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902678 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902682 2585 flags.go:64] FLAG: --max-pods="110" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902685 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902688 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902692 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902695 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902698 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902701 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902704 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902712 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902715 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902718 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902722 2585 flags.go:64] FLAG: --pod-cidr="" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902725 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902730 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902733 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902739 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902742 2585 flags.go:64] FLAG: --port="10250" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902746 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902749 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078a45587dd82348c" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902752 2585 flags.go:64] FLAG: --qos-reserved="" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902755 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902758 2585 flags.go:64] FLAG: --register-node="true" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902761 2585 flags.go:64] FLAG: --register-with-taints="" Jul 10 20:57:36.911119 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902765 2585 flags.go:64] FLAG: --registry-burst="10" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902768 2585 flags.go:64] FLAG: --registry-qps="5" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902772 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902776 2585 flags.go:64] FLAG: --reserved-memory="" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902780 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902784 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902787 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902790 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902793 2585 flags.go:64] FLAG: --runonce="false" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902796 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902799 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902802 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902805 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902808 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902811 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902814 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902818 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902821 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902824 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902827 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902830 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902833 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902836 2585 flags.go:64] FLAG: --system-cgroups="" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902839 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902847 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 20:57:36.911776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902850 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902853 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902857 2585 flags.go:64] FLAG: --tls-min-version="" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902860 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902863 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902866 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902869 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902872 2585 flags.go:64] FLAG: --v="2" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902876 2585 flags.go:64] FLAG: --version="false" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902881 2585 flags.go:64] FLAG: --vmodule="" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902885 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.902889 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903609 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903625 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903633 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903638 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903643 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903648 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903653 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903658 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903663 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903669 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:57:36.912421 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903680 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903685 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903691 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903696 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903701 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903706 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903710 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903715 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903722 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903732 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903737 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903741 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903746 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903757 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903761 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903766 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903770 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903776 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903780 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:57:36.913004 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903785 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903790 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903795 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903800 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903805 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903810 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903820 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903825 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903829 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903834 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903838 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903843 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903847 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903852 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903856 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903862 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903869 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903875 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903880 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:57:36.913622 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903890 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903894 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903899 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903905 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903909 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903914 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903918 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903923 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903928 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903932 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903938 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903955 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.903960 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904003 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904008 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904013 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904030 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904033 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904036 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904039 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:57:36.914178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904144 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904148 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904152 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904156 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904161 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904166 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904170 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904173 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904176 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904179 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904181 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904184 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904190 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904195 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904197 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904202 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904205 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904208 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904211 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904214 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:57:36.914717 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904217 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904220 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904223 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904226 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904228 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904231 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904234 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904237 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904240 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904244 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.904247 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.905162 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.912926 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.912943 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.913966 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 20:57:36.915256 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.913975 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914038 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914044 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914048 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914052 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914055 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914058 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914062 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914065 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914068 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914071 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914074 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914077 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914080 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914083 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914086 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914089 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914091 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914094 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914097 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:57:36.915674 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914100 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914102 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914105 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914108 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914111 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914114 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914116 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914119 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914122 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914125 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914129 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914132 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914135 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914138 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914141 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914143 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914146 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914149 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914151 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914154 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:57:36.916179 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914157 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914160 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914162 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914165 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914168 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914171 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914174 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914176 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914179 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914182 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914185 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914188 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914191 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914194 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914196 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914199 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914203 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914206 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914208 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914211 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:57:36.916722 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914214 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914217 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914220 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914223 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914225 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914228 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914231 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914234 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914237 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914242 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914246 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914248 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914252 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914254 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914257 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914261 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914266 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914269 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914273 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:57:36.917237 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914276 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914279 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914282 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914285 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914288 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914290 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914293 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914296 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914299 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914301 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914304 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914307 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914309 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914312 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914315 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914318 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914321 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914325 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914328 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914332 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:57:36.917824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914336 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.914342 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914466 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914471 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914474 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914477 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914480 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914484 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914487 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914501 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914505 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914508 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914512 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914516 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914519 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:57:36.918350 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914522 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914525 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914528 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914531 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914534 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914537 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914540 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914542 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914545 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914548 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914550 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914553 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914556 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914559 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914562 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914567 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914571 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914574 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914577 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914580 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:57:36.918758 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914583 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914586 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914589 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914591 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914594 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914597 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914600 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914602 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914605 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914608 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914612 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914614 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914617 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914620 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914623 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914625 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914628 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914631 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914633 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914636 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:57:36.919257 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914639 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914642 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914645 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914647 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914651 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914654 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914657 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914661 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914664 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914666 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914669 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914672 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914675 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914677 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914680 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914683 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914687 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914691 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914694 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:57:36.919778 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914697 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914700 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914703 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914706 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914709 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914712 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914715 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914717 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914720 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914724 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914727 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914729 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914732 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914735 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914738 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914742 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914746 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914749 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914752 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914755 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:57:36.920265 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914758 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914761 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914764 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914767 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914770 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914773 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:36.914776 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.914781 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.914898 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.917380 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.919138 2585 server.go:1019] "Starting client certificate rotation" Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.919242 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 20:57:36.920792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.919281 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 20:57:36.922261 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.922247 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 20:57:36.923544 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.923518 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 20:57:36.933571 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.933554 2585 log.go:25] "Validated CRI v1 runtime API" Jul 10 20:57:36.937752 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.937734 2585 log.go:25] "Validated CRI v1 image API" Jul 10 20:57:36.938670 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.938653 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 20:57:36.941399 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.941377 2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a2fcf72c-9720-4921-9c44-00dd88303059:/dev/nvme0n1p3 f03aefae-c479-4a9d-a96d-6afc9759913d:/dev/nvme0n1p4] Jul 10 20:57:36.941455 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.941399 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 20:57:36.948184 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.948052 2585 manager.go:216] Machine: {Timestamp:2026-07-10 20:57:36.94660325 +0000 UTC m=+0.383572474 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099186 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec271444c6d8e0f3f5e9d97ad5cc59e2 SystemUUID:ec271444-c6d8-e0f3-f5e9-d97ad5cc59e2 BootID:814d97c1-5b55-4e8e-8f51-2ba9b4110876 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2c:b5:cc:44:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2c:b5:cc:44:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:28:c7:17:cf:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 20:57:36.948184 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.948171 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 20:57:36.948327 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.948263 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 20:57:36.951080 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.951062 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 20:57:36.951926 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.951887 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 20:57:36.952068 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.951924 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 20:57:36.952755 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.952744 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 20:57:36.952802 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.952757 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 20:57:36.952802 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.952765 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 20:57:36.953524 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.953511 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 20:57:36.955342 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.955332 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 20:57:36.959160 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959146 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 10 20:57:36.959300 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959290 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 20:57:36.959344 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959320 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 10 20:57:36.959344 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959330 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 20:57:36.959406 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959346 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 20:57:36.959406 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959357 2585 kubelet.go:398] "Adding apiserver pod source" Jul 10 20:57:36.959406 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959366 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 20:57:36.959769 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959756 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 20:57:36.959827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.959777 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 20:57:36.962827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.962800 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 20:57:36.964682 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.964665 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 20:57:36.964752 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.964699 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 20:57:36.965560 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965548 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965572 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965578 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965585 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965594 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965599 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965607 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965613 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965620 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 20:57:36.965622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965625 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 20:57:36.965870 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965634 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 20:57:36.965870 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.965640 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 20:57:36.966529 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.966519 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 20:57:36.966529 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.966528 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 20:57:36.970216 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.970201 2585 server.go:1268] "Started kubelet" Jul 10 20:57:36.970402 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.970342 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 20:57:36.970727 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:36.970694 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 20:57:36.970825 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.970730 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 20:57:36.970937 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:36.970899 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 20:57:36.971092 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.971043 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 20:57:36.971159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.971124 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 20:57:36.971239 ip-10-0-137-232 systemd[1]: Started Kubernetes Kubelet. Jul 10 20:57:36.972709 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.972685 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 10 20:57:36.976947 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.976921 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 20:57:36.977376 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.977349 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzzlz" Jul 10 20:57:36.978137 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:36.978115 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 20:57:36.980551 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:36.979467 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-232.ec2.internal.18c10936788344a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-232.ec2.internal,UID:ip-10-0-137-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-232.ec2.internal,},FirstTimestamp:2026-07-10 20:57:36.970179753 +0000 UTC m=+0.407148977,LastTimestamp:2026-07-10 20:57:36.970179753 +0000 UTC m=+0.407148977,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-232.ec2.internal,}" Jul 10 20:57:36.983479 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.983458 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzzlz" Jul 10 20:57:36.984042 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984023 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 20:57:36.984128 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984055 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 20:57:36.984819 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:36.984418 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:36.984819 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984783 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 20:57:36.984819 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984781 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 20:57:36.984819 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984801 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 20:57:36.985062 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984926 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 10 20:57:36.985062 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.984938 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 10 20:57:36.985272 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985255 2585 factory.go:55] Registering systemd factory Jul 10 20:57:36.985332 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985299 2585 factory.go:223] Registration of the systemd container factory successfully Jul 10 20:57:36.985623 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985602 2585 factory.go:153] Registering CRI-O factory Jul 10 20:57:36.985693 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985627 2585 factory.go:223] Registration of the crio container factory successfully Jul 10 20:57:36.985693 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985685 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 20:57:36.985814 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985711 2585 factory.go:103] Registering Raw factory Jul 10 20:57:36.985814 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.985729 2585 manager.go:1196] Started watching for new ooms in manager Jul 10 20:57:36.986160 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.986146 2585 manager.go:349] Starting recovery of all containers Jul 10 20:57:36.990424 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.990402 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:57:36.995366 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:36.995325 2585 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-232.ec2.internal\" not found" node="ip-10-0-137-232.ec2.internal" Jul 10 20:57:36.998343 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:36.998321 2585 manager.go:354] Recovery completed Jul 10 20:57:37.002362 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.002349 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.005383 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005368 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.005471 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005398 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.005471 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005414 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.005969 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005956 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 20:57:37.005969 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005963 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.005969 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005969 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 20:57:37.006108 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.005987 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 10 20:57:37.006737 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.006723 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.006794 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.006749 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.006794 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.006759 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.007319 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.007307 2585 policy_none.go:49] "None policy: Start" Jul 10 20:57:37.007352 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.007325 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 20:57:37.007352 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.007336 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 20:57:37.008477 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.008465 2585 policy_none.go:47] "Start" Jul 10 20:57:37.045042 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045027 2585 manager.go:337] "Starting Device Plugin manager" Jul 10 20:57:37.045126 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.045059 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 20:57:37.045126 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045073 2585 server.go:87] "Starting device plugin registration server" Jul 10 20:57:37.045336 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045321 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 20:57:37.045385 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045338 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 20:57:37.045466 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045445 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 20:57:37.045574 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045558 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 20:57:37.045574 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.045572 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 20:57:37.046241 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.046213 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 20:57:37.046337 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.046290 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.118917 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.118883 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 20:57:37.120162 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.120059 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 20:57:37.120162 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.120111 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 20:57:37.120162 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.120143 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 20:57:37.120341 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.120191 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 20:57:37.122944 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.122926 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:57:37.146394 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.146367 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.147407 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.147390 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.147493 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.147434 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.147493 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.147447 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.147493 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.147474 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.156081 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.156066 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.156126 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.156089 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-232.ec2.internal\": node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.171776 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.171752 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.222685 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.222642 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal"] Jul 10 20:57:37.222756 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.222728 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.223896 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.223881 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.223966 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.223910 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.223966 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.223920 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.225634 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.225621 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.225774 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.225760 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.225812 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.225794 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.226473 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.226450 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.226473 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.226469 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.226594 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.226481 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.226594 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.226492 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.226594 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.226493 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.226594 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.226505 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.227929 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.227914 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.228017 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.227941 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:57:37.228726 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.228707 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:57:37.228803 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.228743 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:57:37.228803 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.228761 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:57:37.253063 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.253047 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-232.ec2.internal\" not found" node="ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.257587 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.257571 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-232.ec2.internal\" not found" node="ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.272057 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.272038 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.286714 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.286665 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0127d2ec01b877d00e82a4cfb7aa59ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"0127d2ec01b877d00e82a4cfb7aa59ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.286714 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.286690 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0127d2ec01b877d00e82a4cfb7aa59ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"0127d2ec01b877d00e82a4cfb7aa59ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.286810 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.286721 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7713125ec15419b626d4a5eab444dc0f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-232.ec2.internal\" (UID: \"7713125ec15419b626d4a5eab444dc0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.372388 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.372355 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.387931 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.387903 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0127d2ec01b877d00e82a4cfb7aa59ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"0127d2ec01b877d00e82a4cfb7aa59ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.387985 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.387937 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7713125ec15419b626d4a5eab444dc0f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-232.ec2.internal\" (UID: \"7713125ec15419b626d4a5eab444dc0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.387985 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.387956 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0127d2ec01b877d00e82a4cfb7aa59ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"0127d2ec01b877d00e82a4cfb7aa59ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.388059 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.388006 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0127d2ec01b877d00e82a4cfb7aa59ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"0127d2ec01b877d00e82a4cfb7aa59ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.388059 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.388015 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0127d2ec01b877d00e82a4cfb7aa59ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"0127d2ec01b877d00e82a4cfb7aa59ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.388059 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.388031 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7713125ec15419b626d4a5eab444dc0f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-232.ec2.internal\" (UID: \"7713125ec15419b626d4a5eab444dc0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.472691 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.472658 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.559982 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.559897 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.561045 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.561025 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 10 20:57:37.573702 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.573666 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.679835 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.679787 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.786477 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.786445 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.886750 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.886674 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.918761 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.918734 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 20:57:37.919234 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.918883 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:57:37.919234 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.918936 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:57:37.987013 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:37.986972 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:37.988158 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.988120 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 20:52:37 +0000 UTC" deadline="2028-02-08 06:18:36.531834537 +0000 UTC" Jul 10 20:57:37.988158 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:37.988153 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13857h20m58.543685205s" Jul 10 20:57:38.023669 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.023626 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:57:38.065576 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:38.065547 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7713125ec15419b626d4a5eab444dc0f.slice/crio-3448797acbf0920a6c6dea25cd4f9f17467d9f831fa96138ef519d4a6c583d73 WatchSource:0}: Error finding container 3448797acbf0920a6c6dea25cd4f9f17467d9f831fa96138ef519d4a6c583d73: Status 404 returned error can't find the container with id 3448797acbf0920a6c6dea25cd4f9f17467d9f831fa96138ef519d4a6c583d73 Jul 10 20:57:38.065824 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:38.065803 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0127d2ec01b877d00e82a4cfb7aa59ea.slice/crio-c3a6423b59c1721d5c17b099c75776e45c5035bcd3d337e199b751d5d23e13af WatchSource:0}: Error finding container c3a6423b59c1721d5c17b099c75776e45c5035bcd3d337e199b751d5d23e13af: Status 404 returned error can't find the container with id c3a6423b59c1721d5c17b099c75776e45c5035bcd3d337e199b751d5d23e13af Jul 10 20:57:38.070757 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.070742 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 20:57:38.088090 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:38.088069 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:38.123903 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.123856 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"0127d2ec01b877d00e82a4cfb7aa59ea","Type":"ContainerStarted","Data":"c3a6423b59c1721d5c17b099c75776e45c5035bcd3d337e199b751d5d23e13af"} Jul 10 20:57:38.124857 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.124833 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" event={"ID":"7713125ec15419b626d4a5eab444dc0f","Type":"ContainerStarted","Data":"3448797acbf0920a6c6dea25cd4f9f17467d9f831fa96138ef519d4a6c583d73"} Jul 10 20:57:38.188662 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:38.188604 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:38.289483 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:38.289446 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 10 20:57:38.301686 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.301665 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:57:38.390503 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.390468 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 10 20:57:38.398807 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.398786 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 20:57:38.399995 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.399981 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 10 20:57:38.411254 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.411236 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 20:57:38.917851 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.917659 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:57:38.961665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.961638 2585 apiserver.go:52] "Watching apiserver" Jul 10 20:57:38.972851 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.972824 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 20:57:38.973454 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.973416 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-pthg9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal","openshift-multus/multus-additional-cni-plugins-hzmlm","openshift-network-diagnostics/network-check-target-pfqh2","openshift-network-operator/iptables-alerter-45hbw","openshift-ovn-kubernetes/ovnkube-node-nlxcl","kube-system/global-pull-secret-syncer-r85lp","kube-system/konnectivity-agent-c25vl","kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv","openshift-cluster-node-tuning-operator/tuned-c78qd","openshift-dns/node-resolver-8pnff","openshift-multus/multus-67m8b","openshift-multus/network-metrics-daemon-hmwmh"] Jul 10 20:57:38.975409 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.975386 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:38.975536 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:38.975493 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:38.976829 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.976807 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.978289 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.978265 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.979598 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.979547 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.979975 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.980774 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kch8d\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.981437 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.981588 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.981903 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.981975 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:38.981981 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.982140 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.982285 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-945rn\"" Jul 10 20:57:38.983519 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.982916 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:38.985302 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.984723 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 20:57:38.985302 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.985064 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.986022 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.985871 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.986022 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.985871 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4njcv\"" Jul 10 20:57:38.986022 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.985937 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.986022 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.985875 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 20:57:38.986777 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.986757 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:38.986914 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:38.986830 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:38.988353 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.987465 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.988353 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.987530 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 20:57:38.988353 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.987955 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 20:57:38.988353 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.988030 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5kgwf\"" Jul 10 20:57:38.988353 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.988270 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:38.989125 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.988979 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 20:57:38.989125 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.989002 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.989125 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.989013 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 20:57:38.990268 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.990181 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:38.991050 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.990742 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 20:57:38.991050 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.990779 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.991050 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.990803 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.991539 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.991522 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7k9jx\"" Jul 10 20:57:38.992399 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.992378 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:38.994394 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.993748 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 20:57:38.994394 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.993763 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 20:57:38.994394 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.994043 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gqv85\"" Jul 10 20:57:38.994394 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.994340 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:38.994937 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.994898 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.995165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.995122 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 20:57:38.995165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.995137 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.995280 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.995243 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jksst\"" Jul 10 20:57:38.996072 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.996049 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:38.997385 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.997365 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.997742 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.997678 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.997742 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.997733 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5xp4g\"" Jul 10 20:57:38.998016 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.997992 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-var-lib-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998099 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-k8s-cni-cncf-io\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998099 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998064 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-multus-certs\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998099 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998088 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9w7r\" (UniqueName: \"kubernetes.io/projected/630c28ce-029a-48f4-a419-41779dcf7b6b-kube-api-access-h9w7r\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998259 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998113 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-ovn\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998259 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998136 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-node-log\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998259 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998159 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-log-socket\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998259 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998201 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-ovnkube-config\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998259 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998245 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-hostroot\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998269 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-cnibin\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998298 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e516423-ad86-43f0-8dd0-fe65121f5645-iptables-alerter-script\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998322 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-cni-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998373 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/630c28ce-029a-48f4-a419-41779dcf7b6b-cni-binary-copy\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998401 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-etc-kubernetes\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998434 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-slash\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998488 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998529 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-env-overrides\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998563 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfqm\" (UniqueName: \"kubernetes.io/projected/db753256-3709-478f-9611-0649fe0b3fed-kube-api-access-czfqm\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-cnibin\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.998601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998602 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-82m9p\"" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998625 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-cni-netd\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998652 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-run-netns\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96nnc\" (UniqueName: \"kubernetes.io/projected/1e516423-ad86-43f0-8dd0-fe65121f5645-kube-api-access-96nnc\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-os-release\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998778 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998816 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmp8l\" (UniqueName: \"kubernetes.io/projected/db26601d-93b4-4a24-b54c-49ba2d7ea316-kube-api-access-hmp8l\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998842 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-kubelet\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998901 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-cni-multus\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998936 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.998974 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999057 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-system-cni-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999071 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999092 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-netns\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999122 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmx7j\" (UniqueName: \"kubernetes.io/projected/526d28e7-0053-4420-a596-cf8ae88873d0-kube-api-access-hmx7j\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.999165 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999148 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999204 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999238 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999290 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e516423-ad86-43f0-8dd0-fe65121f5645-host-slash\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999295 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999365 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-daemon-config\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999394 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-cni-bin\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999457 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-conf-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999495 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-os-release\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999525 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-ovnkube-script-lib\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999536 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-socket-dir-parent\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-etc-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999624 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-cni-bin\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999662 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-kubelet-config\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999695 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-kubelet\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999732 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:38.999859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999769 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-systemd\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.000696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db753256-3709-478f-9611-0649fe0b3fed-ovn-node-metrics-cert\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.000696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999829 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-dbus\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.000696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999855 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-system-cni-dir\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.000696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999887 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:39.000696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:38.999922 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-systemd-units\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.018627 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.018607 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5jqn" Jul 10 20:57:39.027097 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.027077 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5jqn" Jul 10 20:57:39.086263 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.086221 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 20:57:39.100237 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100205 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-kubelet\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.100410 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100251 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369a8078-18e9-4a26-9718-5ca221b76763-host\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.100410 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100274 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-systemd\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.100410 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100329 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-cni-multus\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100410 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100377 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100410 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100453 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-socket-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100460 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-cni-multus\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100479 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-system-cni-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100514 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-netns\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100540 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-system-cni-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmx7j\" (UniqueName: \"kubernetes.io/projected/526d28e7-0053-4420-a596-cf8ae88873d0-kube-api-access-hmx7j\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100335 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-kubelet\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100606 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.100655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100634 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eb908d-afe1-4855-b566-0b638812f04f-tmp-dir\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100658 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100688 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e516423-ad86-43f0-8dd0-fe65121f5645-host-slash\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100711 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5eb908d-afe1-4855-b566-0b638812f04f-hosts-file\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100737 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb066bc5-4c41-4b1d-8835-432965030fa2-agent-certs\") pod \"konnectivity-agent-c25vl\" (UID: \"fb066bc5-4c41-4b1d-8835-432965030fa2\") " pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100761 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-sys-fs\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100783 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-tmp\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-daemon-config\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100845 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hnc\" (UniqueName: \"kubernetes.io/projected/c5eb908d-afe1-4855-b566-0b638812f04f-kube-api-access-56hnc\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100894 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-cni-bin\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100894 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-netns\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100928 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-conf-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100949 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e516423-ad86-43f0-8dd0-fe65121f5645-host-slash\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.100988 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100954 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-os-release\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.100981 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-ovnkube-script-lib\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101023 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb066bc5-4c41-4b1d-8835-432965030fa2-konnectivity-ca\") pod \"konnectivity-agent-c25vl\" (UID: \"fb066bc5-4c41-4b1d-8835-432965030fa2\") " pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101046 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbrb\" (UniqueName: \"kubernetes.io/projected/643cded5-05ff-4722-9b24-54b6d87dffc8-kube-api-access-tgbrb\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101071 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-var-lib-kubelet\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-socket-dir-parent\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-etc-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101147 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-cni-bin\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101170 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-etc-selinux\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101209 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-tuned\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101241 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-kubelet-config\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101267 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-kubelet\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101300 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101326 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-systemd\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db753256-3709-478f-9611-0649fe0b3fed-ovn-node-metrics-cert\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101396 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-lib-modules\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101419 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-dbus\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.101566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101447 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-system-cni-dir\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101543 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-systemd-units\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-var-lib-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101596 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/369a8078-18e9-4a26-9718-5ca221b76763-serviceca\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101630 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-registration-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101659 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-k8s-cni-cncf-io\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101698 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-multus-certs\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101706 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-k8s-cni-cncf-io\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.101746 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-run-multus-certs\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.101799 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.101874 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:39.601851923 +0000 UTC m=+3.038821150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102110 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102190 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102157 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102244 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-kubelet-config\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9w7r\" (UniqueName: \"kubernetes.io/projected/630c28ce-029a-48f4-a419-41779dcf7b6b-kube-api-access-h9w7r\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102334 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-ovn\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102361 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-node-log\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102384 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-log-socket\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102410 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-ovnkube-config\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102454 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-device-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-hostroot\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102507 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-cnibin\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102519 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-daemon-config\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102531 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e516423-ad86-43f0-8dd0-fe65121f5645-iptables-alerter-script\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102555 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysctl-d\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102583 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-run\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102606 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-cni-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102655 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/630c28ce-029a-48f4-a419-41779dcf7b6b-cni-binary-copy\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102674 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-dbus\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-etc-kubernetes\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.102898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102709 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-slash\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102722 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-systemd\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102735 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102738 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102765 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-env-overrides\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.102937 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102940 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-kubelet\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102984 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czfqm\" (UniqueName: \"kubernetes.io/projected/db753256-3709-478f-9611-0649fe0b3fed-kube-api-access-czfqm\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.102993 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-socket-dir-parent\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.102999 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:39.602980358 +0000 UTC m=+3.039949634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103039 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-node-log\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103038 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgnd9\" (UniqueName: \"kubernetes.io/projected/369a8078-18e9-4a26-9718-5ca221b76763-kube-api-access-qgnd9\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103080 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-host-var-lib-cni-bin\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103085 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-cnibin\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103115 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-cni-netd\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103139 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-os-release\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.103800 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103179 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-conf-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-kubernetes\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103218 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-systemd-units\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103219 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-run-netns\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103258 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-run-ovn\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103259 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96nnc\" (UniqueName: \"kubernetes.io/projected/1e516423-ad86-43f0-8dd0-fe65121f5645-kube-api-access-96nnc\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103295 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-run-netns\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103296 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-modprobe-d\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103329 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysctl-conf\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103335 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-system-cni-dir\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103225 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-cni-bin\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103264 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-log-socket\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103532 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-os-release\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103560 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103585 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103613 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmp8l\" (UniqueName: \"kubernetes.io/projected/db26601d-93b4-4a24-b54c-49ba2d7ea316-kube-api-access-hmp8l\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:39.104665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103638 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysconfig\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103663 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-sys\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103685 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-host\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103709 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjfv\" (UniqueName: \"kubernetes.io/projected/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-kube-api-access-6qjfv\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103838 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-env-overrides\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103895 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-ovnkube-config\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103951 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-etc-kubernetes\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.103992 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-slash\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104031 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104090 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-cnibin\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104161 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-host-cni-netd\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104216 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-etc-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104347 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/630c28ce-029a-48f4-a419-41779dcf7b6b-cni-binary-copy\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104431 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-multus-cni-dir\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104484 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e516423-ad86-43f0-8dd0-fe65121f5645-iptables-alerter-script\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104495 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db753256-3709-478f-9611-0649fe0b3fed-var-lib-openvswitch\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104541 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-hostroot\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104565 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/630c28ce-029a-48f4-a419-41779dcf7b6b-os-release\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.105568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104577 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-cnibin\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.106466 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104703 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526d28e7-0053-4420-a596-cf8ae88873d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.106466 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.104767 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526d28e7-0053-4420-a596-cf8ae88873d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.106466 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.105292 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db753256-3709-478f-9611-0649fe0b3fed-ovnkube-script-lib\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.107714 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.107652 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db753256-3709-478f-9611-0649fe0b3fed-ovn-node-metrics-cert\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.109785 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.109567 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:57:39.109785 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.109590 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:57:39.109785 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.109605 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:39.109785 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.109693 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:39.609674309 +0000 UTC m=+3.046643538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:39.110303 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.109839 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmx7j\" (UniqueName: \"kubernetes.io/projected/526d28e7-0053-4420-a596-cf8ae88873d0-kube-api-access-hmx7j\") pod \"multus-additional-cni-plugins-hzmlm\" (UID: \"526d28e7-0053-4420-a596-cf8ae88873d0\") " pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.112248 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.112210 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9w7r\" (UniqueName: \"kubernetes.io/projected/630c28ce-029a-48f4-a419-41779dcf7b6b-kube-api-access-h9w7r\") pod \"multus-67m8b\" (UID: \"630c28ce-029a-48f4-a419-41779dcf7b6b\") " pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.113117 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.113068 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfqm\" (UniqueName: \"kubernetes.io/projected/db753256-3709-478f-9611-0649fe0b3fed-kube-api-access-czfqm\") pod \"ovnkube-node-nlxcl\" (UID: \"db753256-3709-478f-9611-0649fe0b3fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.113286 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.113261 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmp8l\" (UniqueName: \"kubernetes.io/projected/db26601d-93b4-4a24-b54c-49ba2d7ea316-kube-api-access-hmp8l\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:39.114269 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.114221 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96nnc\" (UniqueName: \"kubernetes.io/projected/1e516423-ad86-43f0-8dd0-fe65121f5645-kube-api-access-96nnc\") pod \"iptables-alerter-45hbw\" (UID: \"1e516423-ad86-43f0-8dd0-fe65121f5645\") " pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.204036 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.203945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-host\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.204472 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.204342 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjfv\" (UniqueName: \"kubernetes.io/projected/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-kube-api-access-6qjfv\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.204472 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.204419 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369a8078-18e9-4a26-9718-5ca221b76763-host\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.204472 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.204425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-host\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.204691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.204474 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-systemd\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205093 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369a8078-18e9-4a26-9718-5ca221b76763-host\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-socket-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205214 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eb908d-afe1-4855-b566-0b638812f04f-tmp-dir\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205262 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5eb908d-afe1-4855-b566-0b638812f04f-hosts-file\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb066bc5-4c41-4b1d-8835-432965030fa2-agent-certs\") pod \"konnectivity-agent-c25vl\" (UID: \"fb066bc5-4c41-4b1d-8835-432965030fa2\") " pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205330 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-sys-fs\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205363 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-tmp\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205399 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hnc\" (UniqueName: \"kubernetes.io/projected/c5eb908d-afe1-4855-b566-0b638812f04f-kube-api-access-56hnc\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205432 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb066bc5-4c41-4b1d-8835-432965030fa2-konnectivity-ca\") pod \"konnectivity-agent-c25vl\" (UID: \"fb066bc5-4c41-4b1d-8835-432965030fa2\") " pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbrb\" (UniqueName: \"kubernetes.io/projected/643cded5-05ff-4722-9b24-54b6d87dffc8-kube-api-access-tgbrb\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205514 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-var-lib-kubelet\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205552 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-etc-selinux\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-tuned\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205618 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-lib-modules\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205672 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/369a8078-18e9-4a26-9718-5ca221b76763-serviceca\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-registration-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.206795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205743 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-device-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205780 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysctl-d\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205811 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-run\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205852 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgnd9\" (UniqueName: \"kubernetes.io/projected/369a8078-18e9-4a26-9718-5ca221b76763-kube-api-access-qgnd9\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205883 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205916 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-kubernetes\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205950 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-modprobe-d\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.205982 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysctl-conf\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206033 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysconfig\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206062 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-sys\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206179 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-sys\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206411 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb066bc5-4c41-4b1d-8835-432965030fa2-konnectivity-ca\") pod \"konnectivity-agent-c25vl\" (UID: \"fb066bc5-4c41-4b1d-8835-432965030fa2\") " pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206521 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-var-lib-kubelet\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206652 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-etc-selinux\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206714 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-systemd\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.206821 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-socket-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207099 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eb908d-afe1-4855-b566-0b638812f04f-tmp-dir\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.207748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207217 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5eb908d-afe1-4855-b566-0b638812f04f-hosts-file\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207787 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-lib-modules\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207887 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-registration-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207904 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-kubernetes\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207904 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-device-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.207975 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208074 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-modprobe-d\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208088 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysctl-conf\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208149 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/369a8078-18e9-4a26-9718-5ca221b76763-serviceca\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208162 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysconfig\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208217 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-run\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208366 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-sysctl-d\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.208691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.208436 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/643cded5-05ff-4722-9b24-54b6d87dffc8-sys-fs\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.210518 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.210490 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-etc-tuned\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.210658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.210638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-tmp\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.210749 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.210727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb066bc5-4c41-4b1d-8835-432965030fa2-agent-certs\") pod \"konnectivity-agent-c25vl\" (UID: \"fb066bc5-4c41-4b1d-8835-432965030fa2\") " pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.212676 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.212654 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjfv\" (UniqueName: \"kubernetes.io/projected/0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160-kube-api-access-6qjfv\") pod \"tuned-c78qd\" (UID: \"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160\") " pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.213622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.213577 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbrb\" (UniqueName: \"kubernetes.io/projected/643cded5-05ff-4722-9b24-54b6d87dffc8-kube-api-access-tgbrb\") pod \"aws-ebs-csi-driver-node-7gskv\" (UID: \"643cded5-05ff-4722-9b24-54b6d87dffc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.215844 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.215822 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgnd9\" (UniqueName: \"kubernetes.io/projected/369a8078-18e9-4a26-9718-5ca221b76763-kube-api-access-qgnd9\") pod \"node-ca-pthg9\" (UID: \"369a8078-18e9-4a26-9718-5ca221b76763\") " pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.216113 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.216093 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hnc\" (UniqueName: \"kubernetes.io/projected/c5eb908d-afe1-4855-b566-0b638812f04f-kube-api-access-56hnc\") pod \"node-resolver-8pnff\" (UID: \"c5eb908d-afe1-4855-b566-0b638812f04f\") " pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.292636 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.292597 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-67m8b" Jul 10 20:57:39.302036 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.302010 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" Jul 10 20:57:39.311250 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.311229 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-45hbw" Jul 10 20:57:39.318296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.318274 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:57:39.324307 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.324281 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pthg9" Jul 10 20:57:39.334492 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.334467 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:57:39.336345 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.336246 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:57:39.342851 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.342827 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" Jul 10 20:57:39.350895 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.350876 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c78qd" Jul 10 20:57:39.357649 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.357627 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8pnff" Jul 10 20:57:39.609374 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.609283 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:39.609374 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.609328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:39.609615 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.609475 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:39.609615 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.609543 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:40.609528423 +0000 UTC m=+4.046497635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:39.609615 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.609475 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:39.609754 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.609619 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:40.609605199 +0000 UTC m=+4.046574426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:39.710769 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:39.710730 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:39.710940 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.710895 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:57:39.710940 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.710914 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:57:39.710940 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.710927 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:39.711130 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:39.710992 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:40.71097586 +0000 UTC m=+4.147945091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:40.034317 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.034277 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:52:39 +0000 UTC" deadline="2028-01-30 05:10:56.55600251 +0000 UTC" Jul 10 20:57:40.034730 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.034323 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13640h13m16.521688448s" Jul 10 20:57:40.038632 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:40.038605 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526d28e7_0053_4420_a596_cf8ae88873d0.slice/crio-7bf53106bbccebd547c4d3d3854ff46df52238f5b2d369e042b9f7ed027e30d4 WatchSource:0}: Error finding container 7bf53106bbccebd547c4d3d3854ff46df52238f5b2d369e042b9f7ed027e30d4: Status 404 returned error can't find the container with id 7bf53106bbccebd547c4d3d3854ff46df52238f5b2d369e042b9f7ed027e30d4 Jul 10 20:57:40.040254 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:40.040226 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630c28ce_029a_48f4_a419_41779dcf7b6b.slice/crio-bde7c575771b7b50152912f85a5580b7da79e393134b8d42257e31e9a31a3ce5 WatchSource:0}: Error finding container bde7c575771b7b50152912f85a5580b7da79e393134b8d42257e31e9a31a3ce5: Status 404 returned error can't find the container with id bde7c575771b7b50152912f85a5580b7da79e393134b8d42257e31e9a31a3ce5 Jul 10 20:57:40.043538 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:57:40.043509 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643cded5_05ff_4722_9b24_54b6d87dffc8.slice/crio-8e68ff1a99e535a3042b94287044ef48fae829f467a5ebf8088244095c5d070b WatchSource:0}: Error finding container 8e68ff1a99e535a3042b94287044ef48fae829f467a5ebf8088244095c5d070b: Status 404 returned error can't find the container with id 8e68ff1a99e535a3042b94287044ef48fae829f467a5ebf8088244095c5d070b Jul 10 20:57:40.120567 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.120408 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:40.120665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.120409 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:40.120665 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.120649 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:40.120753 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.120737 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:40.129018 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.128988 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pthg9" event={"ID":"369a8078-18e9-4a26-9718-5ca221b76763","Type":"ContainerStarted","Data":"c44dd7a2c6f66a3839c83b713ab7a3c1b9ae72bee8b2c621f5e8256719a2f563"} Jul 10 20:57:40.130343 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.130316 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"03886228a2709d4d52525d50cee0f6b5598f6b237c3a5f6cad34303ae33ab20b"} Jul 10 20:57:40.131456 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.131431 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" event={"ID":"643cded5-05ff-4722-9b24-54b6d87dffc8","Type":"ContainerStarted","Data":"8e68ff1a99e535a3042b94287044ef48fae829f467a5ebf8088244095c5d070b"} Jul 10 20:57:40.132576 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.132552 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-67m8b" event={"ID":"630c28ce-029a-48f4-a419-41779dcf7b6b","Type":"ContainerStarted","Data":"bde7c575771b7b50152912f85a5580b7da79e393134b8d42257e31e9a31a3ce5"} Jul 10 20:57:40.133832 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.133809 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c78qd" event={"ID":"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160","Type":"ContainerStarted","Data":"3e499c4e87305b32d06c6171d109da771a049ee3f37549b7c6a07f64357274ba"} Jul 10 20:57:40.134931 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.134908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8pnff" event={"ID":"c5eb908d-afe1-4855-b566-0b638812f04f","Type":"ContainerStarted","Data":"598250b402f2ac311693193d9ea5fdf272da676d2e3d0a8caabfd6f81ab3e0fe"} Jul 10 20:57:40.136114 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.136095 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c25vl" event={"ID":"fb066bc5-4c41-4b1d-8835-432965030fa2","Type":"ContainerStarted","Data":"d420f1199e22ea70b23361d97c4b75ccc032352026eedb86d3b8460b112f4312"} Jul 10 20:57:40.137187 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.137157 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-45hbw" event={"ID":"1e516423-ad86-43f0-8dd0-fe65121f5645","Type":"ContainerStarted","Data":"93d049c528d8286ba1a7263b251aab7344464a6cf46f1c34ea25d533fb5f9254"} Jul 10 20:57:40.139984 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.139963 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerStarted","Data":"7bf53106bbccebd547c4d3d3854ff46df52238f5b2d369e042b9f7ed027e30d4"} Jul 10 20:57:40.142864 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.142842 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" event={"ID":"7713125ec15419b626d4a5eab444dc0f","Type":"ContainerStarted","Data":"229ff6bdc51a06e84e51d663ca0cdf02ff5b97fdab92ea76db583ab2a2db50da"} Jul 10 20:57:40.156561 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.156511 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" podStartSLOduration=2.156481869 podStartE2EDuration="2.156481869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:57:40.156477098 +0000 UTC m=+3.593446343" watchObservedRunningTime="2026-07-10 20:57:40.156481869 +0000 UTC m=+3.593451102" Jul 10 20:57:40.620999 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.620108 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:40.620999 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.620168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:40.620999 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.620354 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:40.620999 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.620423 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:42.620402421 +0000 UTC m=+6.057371656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:40.620999 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.620862 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:40.620999 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.620914 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:42.62089683 +0000 UTC m=+6.057866059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:40.721816 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:40.721116 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:40.721816 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.721298 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:57:40.721816 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.721323 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:57:40.721816 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.721337 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:40.721816 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:40.721402 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:42.721381318 +0000 UTC m=+6.158350542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:41.035166 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:41.035098 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:52:39 +0000 UTC" deadline="2028-04-03 21:03:17.033881658 +0000 UTC" Jul 10 20:57:41.035166 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:41.035166 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15192h5m35.998720024s" Jul 10 20:57:41.123728 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:41.123689 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:41.123900 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:41.123839 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:41.165983 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:41.165944 2585 generic.go:356] "Generic (PLEG): container finished" podID="0127d2ec01b877d00e82a4cfb7aa59ea" containerID="085b906cffcae3dc4afff9babbaef6b5b9c1c55b4f1696ba964472f555f43461" exitCode=0 Jul 10 20:57:41.167150 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:41.167121 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"0127d2ec01b877d00e82a4cfb7aa59ea","Type":"ContainerDied","Data":"085b906cffcae3dc4afff9babbaef6b5b9c1c55b4f1696ba964472f555f43461"} Jul 10 20:57:42.120682 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:42.120647 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:42.121191 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.120801 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:42.121255 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:42.121223 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:42.121353 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.121324 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:42.178213 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:42.177536 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"0127d2ec01b877d00e82a4cfb7aa59ea","Type":"ContainerStarted","Data":"2d3a0763bd21f0fbf4d85f64891a81ef5853559b4cac96a851c42128d1e05494"} Jul 10 20:57:42.638040 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:42.637989 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:42.638222 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:42.638063 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:42.638222 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.638162 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:42.638222 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.638202 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:42.638401 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.638248 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:46.638225034 +0000 UTC m=+10.075194257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:42.638401 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.638268 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:46.638258889 +0000 UTC m=+10.075228099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:42.739196 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:42.739156 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:42.739414 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.739379 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:57:42.739414 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.739403 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:57:42.739587 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.739418 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:42.739587 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:42.739497 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:46.739475663 +0000 UTC m=+10.176444888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:43.121721 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:43.121682 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:43.122248 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:43.121840 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:44.121218 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:44.120856 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:44.121218 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:44.121021 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:44.121218 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:44.121085 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:44.121218 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:44.121205 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:45.125886 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:45.125294 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:45.125886 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:45.125433 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:46.121105 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:46.121070 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:46.121300 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.121217 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:46.121623 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:46.121598 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:46.121755 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.121686 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:46.679169 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:46.679132 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:46.679630 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:46.679182 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:46.679630 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.679296 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:46.679630 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.679306 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:46.679630 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.679363 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:54.679344513 +0000 UTC m=+18.116313724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:46.679630 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.679382 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:54.679372868 +0000 UTC m=+18.116342075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:46.780258 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:46.780219 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:46.780445 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.780411 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:57:46.780529 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.780452 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:57:46.780529 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.780466 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:46.780529 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:46.780528 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:57:54.780509028 +0000 UTC m=+18.217478254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:47.122535 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:47.122019 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:47.122535 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:47.122136 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:48.120990 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:48.120953 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:48.121535 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:48.121093 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:48.121535 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:48.121139 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:48.121535 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:48.121259 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:49.122595 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:49.122477 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:49.123104 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:49.122612 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:50.121147 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:50.121115 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:50.121315 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:50.121131 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:50.121315 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:50.121236 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:50.121315 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:50.121295 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:51.126055 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:51.126029 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:51.126490 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:51.126126 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:52.120903 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:52.120867 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:52.121070 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:52.120875 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:52.121070 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:52.120986 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:52.121188 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:52.121091 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:53.120859 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:53.120821 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:53.121323 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:53.120965 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:54.120695 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:54.120663 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:54.120695 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:54.120691 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:54.121282 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.120808 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:54.121282 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.120940 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:54.739941 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:54.739901 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:54.740223 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:54.739952 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:54.740223 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.740059 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:54.740223 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.740062 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:54.740223 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.740123 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:10.740107489 +0000 UTC m=+34.177076710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:57:54.740223 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.740149 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:10.740138697 +0000 UTC m=+34.177107916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:57:54.840743 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:54.840709 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:54.840933 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.840854 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:57:54.840933 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.840877 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:57:54.840933 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.840893 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:54.841089 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:54.840960 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:10.840942981 +0000 UTC m=+34.277912196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:57:55.120585 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:55.120544 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:55.120768 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:55.120684 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:56.120892 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:56.120858 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:56.121323 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:56.120899 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:56.121323 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:56.120982 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:56.121323 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:56.121116 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:57.121760 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:57.121726 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:57.122155 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:57.121831 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:57:58.121236 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:58.121201 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:57:58.121412 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:58.121202 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:57:58.121412 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:58.121324 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:57:58.121556 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:58.121433 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:57:59.120827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:57:59.120798 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:57:59.121165 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:57:59.120906 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:00.121607 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.121265 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:00.122246 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.121327 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:00.122246 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:00.121696 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:00.122246 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:00.121760 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:00.220716 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.220690 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 20:58:00.221116 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221083 2585 generic.go:356] "Generic (PLEG): container finished" podID="db753256-3709-478f-9611-0649fe0b3fed" containerID="d8a4c197282c5d36a457f82e8793e7eed47b3bd9c0bd4685c0bee3337bcad8be" exitCode=1 Jul 10 20:58:00.221247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221163 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"d521e9c37c4965002c5e5e2e753f09f1ffd5405aae286bd16a8edb61142f1b1b"} Jul 10 20:58:00.221247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221236 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"b24981a99b482ae3de69b44a78a035ef4d27112f9c61ef87bb9d704c0a16ad09"} Jul 10 20:58:00.221357 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221271 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"d7ed7bbe795b429ed266f3a000493b45294ea789702cc4595124b39316b93bc4"} Jul 10 20:58:00.221357 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221312 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"150cccfe6982882ff412c0441cbcf070ad20b7b95341bd3d187a9196370db7a1"} Jul 10 20:58:00.221476 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221357 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerDied","Data":"d8a4c197282c5d36a457f82e8793e7eed47b3bd9c0bd4685c0bee3337bcad8be"} Jul 10 20:58:00.221476 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.221403 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"c48998d4c5982165262ba545101f88179fc99c79458a1f68df759daaf0c771d8"} Jul 10 20:58:00.222779 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.222756 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" event={"ID":"643cded5-05ff-4722-9b24-54b6d87dffc8","Type":"ContainerStarted","Data":"ccc30cedf3010a347b131b869eb57e3711f337d959eb8aa1a322a5967a619f50"} Jul 10 20:58:00.224187 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.224164 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-67m8b" event={"ID":"630c28ce-029a-48f4-a419-41779dcf7b6b","Type":"ContainerStarted","Data":"0e7e19fcc7be5278557db83a823c047fa1c60732e2c1e119eda2da2f823ac2a9"} Jul 10 20:58:00.225756 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.225718 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c78qd" event={"ID":"0e4e4d4e-8bd3-4c50-ab27-cb0cc705b160","Type":"ContainerStarted","Data":"683c060be197f100fad3957a44d6cc970ce08a6902d678da991486ca2705c489"} Jul 10 20:58:00.227252 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.227221 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8pnff" event={"ID":"c5eb908d-afe1-4855-b566-0b638812f04f","Type":"ContainerStarted","Data":"9b268ae7eebd4c97777387cb6f381c0d40afd66170491db599b736a2b5093ef5"} Jul 10 20:58:00.228972 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.228941 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c25vl" event={"ID":"fb066bc5-4c41-4b1d-8835-432965030fa2","Type":"ContainerStarted","Data":"2d26f92d48f38776437c2b7ed2276f7134a84b7e284aface7ecac6bf1f0585a6"} Jul 10 20:58:00.233907 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.233873 2585 generic.go:356] "Generic (PLEG): container finished" podID="526d28e7-0053-4420-a596-cf8ae88873d0" containerID="21fd7b9715f121bcd1547e0eba68442261b1e38450e6ae59055c6090b42f646d" exitCode=0 Jul 10 20:58:00.234011 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.233928 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerDied","Data":"21fd7b9715f121bcd1547e0eba68442261b1e38450e6ae59055c6090b42f646d"} Jul 10 20:58:00.235765 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.235712 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pthg9" event={"ID":"369a8078-18e9-4a26-9718-5ca221b76763","Type":"ContainerStarted","Data":"a73dd4d914761b680465cb156abe98db00bd619d5f14a9e89462766b547611ed"} Jul 10 20:58:00.240612 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.240575 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-67m8b" podStartSLOduration=4.006027587 podStartE2EDuration="23.240562935s" totalImagesPullingTime="19.234535348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:00.240308529 +0000 UTC m=+23.677277760" watchObservedRunningTime="2026-07-10 20:58:00.240562935 +0000 UTC m=+23.677532164" Jul 10 20:58:00.240768 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.240745 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" podStartSLOduration=22.240738728 podStartE2EDuration="22.240738728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:57:42.195277375 +0000 UTC m=+5.632246610" watchObservedRunningTime="2026-07-10 20:58:00.240738728 +0000 UTC m=+23.677707958" Jul 10 20:58:00.253696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.253661 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pthg9" podStartSLOduration=4.096796996 podStartE2EDuration="23.253644106s" totalImagesPullingTime="19.15684711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:00.253600222 +0000 UTC m=+23.690569474" watchObservedRunningTime="2026-07-10 20:58:00.253644106 +0000 UTC m=+23.690613336" Jul 10 20:58:00.266955 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.266907 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c25vl" podStartSLOduration=4.117245112 podStartE2EDuration="23.266888933s" totalImagesPullingTime="19.149643821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:00.266679313 +0000 UTC m=+23.703648544" watchObservedRunningTime="2026-07-10 20:58:00.266888933 +0000 UTC m=+23.703858164" Jul 10 20:58:00.295711 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.295674 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c78qd" podStartSLOduration=4.118963662 podStartE2EDuration="23.295660723s" totalImagesPullingTime="19.176697061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:00.280852681 +0000 UTC m=+23.717821910" watchObservedRunningTime="2026-07-10 20:58:00.295660723 +0000 UTC m=+23.732629952" Jul 10 20:58:00.295840 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.295760 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8pnff" podStartSLOduration=4.146482754 podStartE2EDuration="23.295756648s" totalImagesPullingTime="19.149273894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:00.295058293 +0000 UTC m=+23.732027522" watchObservedRunningTime="2026-07-10 20:58:00.295756648 +0000 UTC m=+23.732725878" Jul 10 20:58:00.766090 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:00.766062 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 20:58:01.060357 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:01.060210 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T20:58:00.766085364Z","UUID":"688aecfa-5442-4c62-ad90-318fecd57a9b","Handler":null,"Name":"","Endpoint":""} Jul 10 20:58:01.061834 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:01.061812 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 20:58:01.061971 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:01.061853 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 20:58:01.123821 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:01.123791 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:01.124281 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:01.123915 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:01.240148 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:01.240109 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" event={"ID":"643cded5-05ff-4722-9b24-54b6d87dffc8","Type":"ContainerStarted","Data":"d11363245ac9a86ee2bcbd356af16ddb60a65575dbd9cf638d0eac44cad0bd1c"} Jul 10 20:58:01.241691 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:01.241654 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-45hbw" event={"ID":"1e516423-ad86-43f0-8dd0-fe65121f5645","Type":"ContainerStarted","Data":"9a498c72d2e514ba4c2f67e5d639342eeebe88212aa7754539a63fbbcfb1d80b"} Jul 10 20:58:02.121334 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.121305 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:02.121498 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:02.121467 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:02.121582 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.121524 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:02.121637 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:02.121607 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:02.247828 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.247741 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 20:58:02.248253 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.248228 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"ec5ba45af1144422a2198e3b520c1d3f5da40f44113e9628df2fda315685eaad"} Jul 10 20:58:02.250507 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.250477 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" event={"ID":"643cded5-05ff-4722-9b24-54b6d87dffc8","Type":"ContainerStarted","Data":"75bc70f9d3f5825c4f9125753afc00d40386d59a3c7aab7fac86ae41d0bf3d4b"} Jul 10 20:58:02.266370 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.266307 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gskv" podStartSLOduration=3.603887417 podStartE2EDuration="25.266288536s" totalImagesPullingTime="21.662401119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:02.266213034 +0000 UTC m=+25.703182282" watchObservedRunningTime="2026-07-10 20:58:02.266288536 +0000 UTC m=+25.703257768" Jul 10 20:58:02.266865 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:02.266835 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-45hbw" podStartSLOduration=6.1031822 podStartE2EDuration="25.266822841s" totalImagesPullingTime="19.163640641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:01.255904204 +0000 UTC m=+24.692873436" watchObservedRunningTime="2026-07-10 20:58:02.266822841 +0000 UTC m=+25.703792072" Jul 10 20:58:03.120828 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:03.120628 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:03.120990 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:03.120914 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:03.473776 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:03.473698 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:58:03.755461 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:03.755366 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:58:03.756052 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:03.756032 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:58:04.121013 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:04.120981 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:04.121223 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:04.121124 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:04.121223 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:04.121186 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:04.121318 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:04.121286 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:04.255974 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:04.255943 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c25vl" Jul 10 20:58:05.121467 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:05.121198 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:05.122351 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:05.121824 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:05.259076 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:05.259044 2585 generic.go:356] "Generic (PLEG): container finished" podID="526d28e7-0053-4420-a596-cf8ae88873d0" containerID="b7152b4849794c8c84201ed23a57ac5ca3146b145e0bf85bb8312e2737b4cd99" exitCode=0 Jul 10 20:58:05.259264 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:05.259128 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerDied","Data":"b7152b4849794c8c84201ed23a57ac5ca3146b145e0bf85bb8312e2737b4cd99"} Jul 10 20:58:05.262535 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:05.262515 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 20:58:05.262987 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:05.262966 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"814847b0d26cdfa4f8686d615e8d6e18d0e5cddc02bcd823b612d83451f19dfb"} Jul 10 20:58:05.263437 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:05.263408 2585 scope.go:117] "RemoveContainer" containerID="d8a4c197282c5d36a457f82e8793e7eed47b3bd9c0bd4685c0bee3337bcad8be" Jul 10 20:58:06.120647 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.120609 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:06.120914 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:06.120714 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:06.120914 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.120771 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:06.120914 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:06.120893 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:06.268872 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.268847 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 20:58:06.269324 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.269297 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" event={"ID":"db753256-3709-478f-9611-0649fe0b3fed","Type":"ContainerStarted","Data":"d98a38882b3a31b837a0b46b5794b88822f5d67628f66f30f6ad9ac546bc41c2"} Jul 10 20:58:06.269405 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.269314 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 20:58:06.269405 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.269391 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:58:06.269662 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.269578 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:58:06.284216 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.284193 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:58:06.284537 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.284523 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:58:06.304685 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.304635 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" podStartSLOduration=10.076411086 podStartE2EDuration="29.304622319s" totalImagesPullingTime="19.228211233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:06.304583107 +0000 UTC m=+29.741552359" watchObservedRunningTime="2026-07-10 20:58:06.304622319 +0000 UTC m=+29.741591547" Jul 10 20:58:06.702461 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.702354 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmwmh"] Jul 10 20:58:06.702658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.702509 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:06.702658 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:06.702596 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:06.707172 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.707149 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pfqh2"] Jul 10 20:58:06.707287 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.707241 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:06.707335 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:06.707316 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:06.722461 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.722410 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r85lp"] Jul 10 20:58:06.722591 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:06.722547 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:06.722662 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:06.722643 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:07.272903 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:07.272872 2585 generic.go:356] "Generic (PLEG): container finished" podID="526d28e7-0053-4420-a596-cf8ae88873d0" containerID="d2f12d51964518d149b8f09fae7521862b84f32900f4e7b4d562c59d1def6b07" exitCode=0 Jul 10 20:58:07.273270 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:07.272960 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerDied","Data":"d2f12d51964518d149b8f09fae7521862b84f32900f4e7b4d562c59d1def6b07"} Jul 10 20:58:07.273270 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:07.273010 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 20:58:08.120882 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:08.120710 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:08.121039 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:08.120713 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:08.121039 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:08.120955 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:08.121039 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:08.121011 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:08.272697 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:08.272625 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:58:09.123873 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:09.123843 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:09.124523 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:09.123962 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:09.281672 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:09.281637 2585 generic.go:356] "Generic (PLEG): container finished" podID="526d28e7-0053-4420-a596-cf8ae88873d0" containerID="54c651503f0c5a565e3e3111decbf2c6372916da10ddeb3c2a9497daa0705570" exitCode=0 Jul 10 20:58:09.281828 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:09.281706 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerDied","Data":"54c651503f0c5a565e3e3111decbf2c6372916da10ddeb3c2a9497daa0705570"} Jul 10 20:58:09.299591 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:09.299550 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" podUID="db753256-3709-478f-9611-0649fe0b3fed" containerName="ovnkube-controller" probeResult="failure" output="" Jul 10 20:58:10.121323 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:10.121291 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:10.121527 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.121432 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfqh2" podUID="fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6" Jul 10 20:58:10.121527 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:10.121453 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:10.121628 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.121569 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r85lp" podUID="b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1" Jul 10 20:58:10.760803 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:10.760709 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:10.760803 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:10.760761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:10.761273 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.760859 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:58:10.761273 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.760904 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:58:10.761273 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.760929 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs podName:db26601d-93b4-4a24-b54c-49ba2d7ea316 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:42.760910217 +0000 UTC m=+66.197879448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs") pod "network-metrics-daemon-hmwmh" (UID: "db26601d-93b4-4a24-b54c-49ba2d7ea316") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:58:10.761273 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.760948 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret podName:b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:42.760938898 +0000 UTC m=+66.197908108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret") pod "global-pull-secret-syncer-r85lp" (UID: "b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:58:10.861607 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:10.861576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:10.861785 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.861764 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:58:10.861856 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.861791 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:58:10.861856 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.861806 2585 projected.go:196] Error preparing data for projected volume kube-api-access-kjnlv for pod openshift-network-diagnostics/network-check-target-pfqh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:58:10.861920 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:10.861877 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv podName:fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:42.861857648 +0000 UTC m=+66.298826894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnlv" (UniqueName: "kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv") pod "network-check-target-pfqh2" (UID: "fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:58:11.121042 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.121007 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:11.121210 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:11.121155 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmwmh" podUID="db26601d-93b4-4a24-b54c-49ba2d7ea316" Jul 10 20:58:11.852156 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.852127 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeReady" Jul 10 20:58:11.852717 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.852281 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 20:58:11.910542 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.910510 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qxdt9"] Jul 10 20:58:11.932084 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.932054 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j9drs"] Jul 10 20:58:11.932284 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.932191 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:11.936595 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.936568 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 20:58:11.936762 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.936744 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8hlxh\"" Jul 10 20:58:11.936965 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.936934 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 20:58:11.943956 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.943932 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qxdt9"] Jul 10 20:58:11.944070 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.944004 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j9drs"] Jul 10 20:58:11.944117 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.944087 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:11.946699 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.946651 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tq7hl\"" Jul 10 20:58:11.947047 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.947028 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 20:58:11.947321 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.947301 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 20:58:11.947435 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:11.947370 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 20:58:12.069985 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.069952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d22c8ed7-0925-4736-a9bf-9beb23714312-config-volume\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.070174 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.069991 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c8ed7-0925-4736-a9bf-9beb23714312-tmp-dir\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.070174 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.070073 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c43b12f4-650a-4b57-91d4-ba437b4588bf-cert\") pod \"ingress-canary-j9drs\" (UID: \"c43b12f4-650a-4b57-91d4-ba437b4588bf\") " pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.070174 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.070095 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnkj\" (UniqueName: \"kubernetes.io/projected/c43b12f4-650a-4b57-91d4-ba437b4588bf-kube-api-access-ttnkj\") pod \"ingress-canary-j9drs\" (UID: \"c43b12f4-650a-4b57-91d4-ba437b4588bf\") " pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.070174 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.070130 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wnd8\" (UniqueName: \"kubernetes.io/projected/d22c8ed7-0925-4736-a9bf-9beb23714312-kube-api-access-8wnd8\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.070174 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.070157 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.121263 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.121217 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:12.121455 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.121230 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:12.124658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.124632 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 20:58:12.124821 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.124730 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 20:58:12.124821 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.124746 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 20:58:12.125090 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.125069 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4fk7p\"" Jul 10 20:58:12.170616 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.170584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d22c8ed7-0925-4736-a9bf-9beb23714312-config-volume\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.170616 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.170619 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c8ed7-0925-4736-a9bf-9beb23714312-tmp-dir\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.170820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.170759 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c43b12f4-650a-4b57-91d4-ba437b4588bf-cert\") pod \"ingress-canary-j9drs\" (UID: \"c43b12f4-650a-4b57-91d4-ba437b4588bf\") " pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.170820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.170789 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnkj\" (UniqueName: \"kubernetes.io/projected/c43b12f4-650a-4b57-91d4-ba437b4588bf-kube-api-access-ttnkj\") pod \"ingress-canary-j9drs\" (UID: \"c43b12f4-650a-4b57-91d4-ba437b4588bf\") " pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.170924 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.170819 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wnd8\" (UniqueName: \"kubernetes.io/projected/d22c8ed7-0925-4736-a9bf-9beb23714312-kube-api-access-8wnd8\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.171052 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.171028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c8ed7-0925-4736-a9bf-9beb23714312-tmp-dir\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.171143 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.171035 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.171143 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:12.171134 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:58:12.171251 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:12.171207 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls podName:d22c8ed7-0925-4736-a9bf-9beb23714312 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:12.671181945 +0000 UTC m=+36.108151165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls") pod "dns-default-qxdt9" (UID: "d22c8ed7-0925-4736-a9bf-9beb23714312") : secret "dns-default-metrics-tls" not found Jul 10 20:58:12.171315 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.171274 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d22c8ed7-0925-4736-a9bf-9beb23714312-config-volume\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.175348 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.175326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c43b12f4-650a-4b57-91d4-ba437b4588bf-cert\") pod \"ingress-canary-j9drs\" (UID: \"c43b12f4-650a-4b57-91d4-ba437b4588bf\") " pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.181732 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.181710 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wnd8\" (UniqueName: \"kubernetes.io/projected/d22c8ed7-0925-4736-a9bf-9beb23714312-kube-api-access-8wnd8\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.182064 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.182043 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnkj\" (UniqueName: \"kubernetes.io/projected/c43b12f4-650a-4b57-91d4-ba437b4588bf-kube-api-access-ttnkj\") pod \"ingress-canary-j9drs\" (UID: \"c43b12f4-650a-4b57-91d4-ba437b4588bf\") " pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.254059 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.253986 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9drs" Jul 10 20:58:12.675018 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:12.674984 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:12.675191 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:12.675108 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:58:12.675191 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:12.675175 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls podName:d22c8ed7-0925-4736-a9bf-9beb23714312 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:13.675155477 +0000 UTC m=+37.112124685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls") pod "dns-default-qxdt9" (UID: "d22c8ed7-0925-4736-a9bf-9beb23714312") : secret "dns-default-metrics-tls" not found Jul 10 20:58:13.121100 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.121066 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:13.124379 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.124197 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 20:58:13.124379 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.124207 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8kn2h\"" Jul 10 20:58:13.494201 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.494020 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j9drs"] Jul 10 20:58:13.510829 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.510805 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64d699b98d-bsw2d"] Jul 10 20:58:13.522428 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.522393 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8dbbdd55b-fhkls"] Jul 10 20:58:13.522532 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.522513 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.526281 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.526264 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 20:58:13.526396 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.526287 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 20:58:13.526461 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.526410 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxc65\"" Jul 10 20:58:13.526562 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.526546 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 20:58:13.534389 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.533445 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d699b98d-bsw2d"] Jul 10 20:58:13.534389 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.533560 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.543499 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543296 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 20:58:13.543499 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543322 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8dbbdd55b-fhkls"] Jul 10 20:58:13.543499 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543345 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4t5jr\"" Jul 10 20:58:13.543499 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543345 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 20:58:13.543499 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543406 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 20:58:13.543805 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543438 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 20:58:13.543805 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543303 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 20:58:13.543805 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.543503 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 20:58:13.544107 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.544088 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 20:58:13.569560 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:13.569538 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43b12f4_650a_4b57_91d4_ba437b4588bf.slice/crio-3c832a4c90948cedf38f3c424c78a2f29c7d12f16ba61dc5746205cb4bf8a31c WatchSource:0}: Error finding container 3c832a4c90948cedf38f3c424c78a2f29c7d12f16ba61dc5746205cb4bf8a31c: Status 404 returned error can't find the container with id 3c832a4c90948cedf38f3c424c78a2f29c7d12f16ba61dc5746205cb4bf8a31c Jul 10 20:58:13.618516 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.618200 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj"] Jul 10 20:58:13.626642 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.626611 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-2v9tq"] Jul 10 20:58:13.627029 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.627009 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.630372 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.630324 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 20:58:13.630722 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.630700 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fxq7d\"" Jul 10 20:58:13.630863 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.630842 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 20:58:13.631016 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.630715 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 20:58:13.631234 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.631215 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:58:13.632514 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.632495 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.634911 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.634894 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 20:58:13.635002 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.634895 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-drnk6\"" Jul 10 20:58:13.635338 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.635321 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 20:58:13.635428 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.635352 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 20:58:13.636307 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.635733 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 20:58:13.638777 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.638755 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj"] Jul 10 20:58:13.641125 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.641108 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 20:58:13.642349 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.642328 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-2v9tq"] Jul 10 20:58:13.683976 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.683952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-trusted-ca\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684098 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.683980 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-bound-sa-token\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684098 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684000 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-stats-auth\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.684098 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684017 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fslmh\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-kube-api-access-fslmh\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684098 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.684098 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684086 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-installation-pull-secrets\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684249 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8t8s\" (UniqueName: \"kubernetes.io/projected/01446074-b907-45b7-a35e-4320ff9d1f4d-kube-api-access-j8t8s\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.684249 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684152 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72757d76-20e8-4868-a42c-97a6f5de04fb-ca-trust-extracted\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684249 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684177 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-default-certificate\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.684249 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684208 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.684249 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684239 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-image-registry-private-configuration\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684395 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684269 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:13.684395 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684305 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-certificates\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684395 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.684339 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.684497 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.684399 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:58:13.684497 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.684464 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls podName:d22c8ed7-0925-4736-a9bf-9beb23714312 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:15.684449774 +0000 UTC m=+39.121418985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls") pod "dns-default-qxdt9" (UID: "d22c8ed7-0925-4736-a9bf-9beb23714312") : secret "dns-default-metrics-tls" not found Jul 10 20:58:13.721185 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.721157 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l"] Jul 10 20:58:13.736742 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.736709 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:13.737068 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.736884 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l"] Jul 10 20:58:13.740121 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.740100 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 20:58:13.740274 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.740257 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 20:58:13.740534 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.740515 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hw5ps\"" Jul 10 20:58:13.740709 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.740692 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:58:13.785456 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785431 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6m8s\" (UniqueName: \"kubernetes.io/projected/833fe8f0-3548-43fc-bf69-13d264c4bfbf-kube-api-access-z6m8s\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.785539 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785493 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-trusted-ca\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.785539 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785525 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-stats-auth\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.785633 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785553 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/833fe8f0-3548-43fc-bf69-13d264c4bfbf-config\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.785633 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-installation-pull-secrets\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.785722 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785652 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8t8s\" (UniqueName: \"kubernetes.io/projected/01446074-b907-45b7-a35e-4320ff9d1f4d-kube-api-access-j8t8s\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.785809 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785794 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dz8z\" (UniqueName: \"kubernetes.io/projected/3a29b994-1466-4b6a-ab7a-b62990316c79-kube-api-access-7dz8z\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.785862 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785832 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.785915 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-image-registry-private-configuration\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.785950 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786012 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786048 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-bound-sa-token\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.786075 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:14.286054972 +0000 UTC m=+37.723024207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : configmap references non-existent config key: service-ca.crt Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/833fe8f0-3548-43fc-bf69-13d264c4bfbf-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.786134 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786145 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a29b994-1466-4b6a-ab7a-b62990316c79-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.786150 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d699b98d-bsw2d: secret "image-registry-tls" not found Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786195 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.786247 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls podName:72757d76-20e8-4868-a42c-97a6f5de04fb nodeName:}" failed. No retries permitted until 2026-07-10 20:58:14.286231075 +0000 UTC m=+37.723200299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls") pod "image-registry-64d699b98d-bsw2d" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb") : secret "image-registry-tls" not found Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786271 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a29b994-1466-4b6a-ab7a-b62990316c79-serving-cert\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.786311 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.786349 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:14.286339467 +0000 UTC m=+37.723308694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : secret "router-metrics-certs-default" not found Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786381 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72757d76-20e8-4868-a42c-97a6f5de04fb-ca-trust-extracted\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.786608 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786407 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98k4m\" (UniqueName: \"kubernetes.io/projected/198a058a-e685-4dab-ae34-c3afb56606a6-kube-api-access-98k4m\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786453 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fslmh\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-kube-api-access-fslmh\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786477 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-default-certificate\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-certificates\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786530 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29b994-1466-4b6a-ab7a-b62990316c79-tmp\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786553 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a29b994-1466-4b6a-ab7a-b62990316c79-snapshots\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786573 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a29b994-1466-4b6a-ab7a-b62990316c79-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786704 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-trusted-ca\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.786727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72757d76-20e8-4868-a42c-97a6f5de04fb-ca-trust-extracted\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.787381 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.787253 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-certificates\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.789630 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.789596 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-image-registry-private-configuration\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.789630 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.789623 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-stats-auth\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.789793 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.789601 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-installation-pull-secrets\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.789793 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.789628 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-default-certificate\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.802188 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.802162 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8t8s\" (UniqueName: \"kubernetes.io/projected/01446074-b907-45b7-a35e-4320ff9d1f4d-kube-api-access-j8t8s\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:13.803155 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.803135 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fslmh\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-kube-api-access-fslmh\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.805891 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.805872 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-bound-sa-token\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:13.887591 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887555 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6m8s\" (UniqueName: \"kubernetes.io/projected/833fe8f0-3548-43fc-bf69-13d264c4bfbf-kube-api-access-z6m8s\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.887685 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887599 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/833fe8f0-3548-43fc-bf69-13d264c4bfbf-config\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.887685 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887620 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dz8z\" (UniqueName: \"kubernetes.io/projected/3a29b994-1466-4b6a-ab7a-b62990316c79-kube-api-access-7dz8z\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.887685 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887677 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:13.887827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/833fe8f0-3548-43fc-bf69-13d264c4bfbf-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.887827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887715 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a29b994-1466-4b6a-ab7a-b62990316c79-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.887827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887745 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a29b994-1466-4b6a-ab7a-b62990316c79-serving-cert\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.887827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98k4m\" (UniqueName: \"kubernetes.io/projected/198a058a-e685-4dab-ae34-c3afb56606a6-kube-api-access-98k4m\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:13.887827 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.887792 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:58:13.887827 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887825 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29b994-1466-4b6a-ab7a-b62990316c79-tmp\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.888133 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:13.887860 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls podName:198a058a-e685-4dab-ae34-c3afb56606a6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:14.387841822 +0000 UTC m=+37.824811046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls") pod "cluster-samples-operator-65db858894-2v56l" (UID: "198a058a-e685-4dab-ae34-c3afb56606a6") : secret "samples-operator-tls" not found Jul 10 20:58:13.888133 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887883 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a29b994-1466-4b6a-ab7a-b62990316c79-snapshots\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.888133 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.887915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a29b994-1466-4b6a-ab7a-b62990316c79-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.888699 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.888672 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29b994-1466-4b6a-ab7a-b62990316c79-tmp\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.892159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.888677 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/833fe8f0-3548-43fc-bf69-13d264c4bfbf-config\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.892159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.888889 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a29b994-1466-4b6a-ab7a-b62990316c79-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.892159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.889215 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a29b994-1466-4b6a-ab7a-b62990316c79-snapshots\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.892159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.889314 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a29b994-1466-4b6a-ab7a-b62990316c79-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.892159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.890366 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/833fe8f0-3548-43fc-bf69-13d264c4bfbf-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.892159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.891067 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a29b994-1466-4b6a-ab7a-b62990316c79-serving-cert\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.900683 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.900655 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dz8z\" (UniqueName: \"kubernetes.io/projected/3a29b994-1466-4b6a-ab7a-b62990316c79-kube-api-access-7dz8z\") pod \"insights-operator-68d9dd94cf-2v9tq\" (UID: \"3a29b994-1466-4b6a-ab7a-b62990316c79\") " pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:13.900957 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.900941 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6m8s\" (UniqueName: \"kubernetes.io/projected/833fe8f0-3548-43fc-bf69-13d264c4bfbf-kube-api-access-z6m8s\") pod \"service-ca-operator-7695fc6c8c-jx4sj\" (UID: \"833fe8f0-3548-43fc-bf69-13d264c4bfbf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.901021 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.901005 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98k4m\" (UniqueName: \"kubernetes.io/projected/198a058a-e685-4dab-ae34-c3afb56606a6-kube-api-access-98k4m\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:13.940210 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.940163 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" Jul 10 20:58:13.947322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:13.947306 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" Jul 10 20:58:14.090651 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.090623 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj"] Jul 10 20:58:14.094381 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:14.094356 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833fe8f0_3548_43fc_bf69_13d264c4bfbf.slice/crio-a2649e78f4d24f7d2130253caa58ec3fbdca8fff4ad15744398eeaa42c87edd5 WatchSource:0}: Error finding container a2649e78f4d24f7d2130253caa58ec3fbdca8fff4ad15744398eeaa42c87edd5: Status 404 returned error can't find the container with id a2649e78f4d24f7d2130253caa58ec3fbdca8fff4ad15744398eeaa42c87edd5 Jul 10 20:58:14.111503 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.111473 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-2v9tq"] Jul 10 20:58:14.114582 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:14.114557 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a29b994_1466_4b6a_ab7a_b62990316c79.slice/crio-6d7ed8dd0b818f6a64b1dd44147860b2f681afc975d3525ad2a0135ef47ce534 WatchSource:0}: Error finding container 6d7ed8dd0b818f6a64b1dd44147860b2f681afc975d3525ad2a0135ef47ce534: Status 404 returned error can't find the container with id 6d7ed8dd0b818f6a64b1dd44147860b2f681afc975d3525ad2a0135ef47ce534 Jul 10 20:58:14.290340 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.290259 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:14.290340 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.290308 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.290351 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.290463 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:15.290443181 +0000 UTC m=+38.727412390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : configmap references non-existent config key: service-ca.crt Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.290487 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.290465 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.290503 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d699b98d-bsw2d: secret "image-registry-tls" not found Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.290580 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:15.290559533 +0000 UTC m=+38.727528758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : secret "router-metrics-certs-default" not found Jul 10 20:58:14.290892 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.290623 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls podName:72757d76-20e8-4868-a42c-97a6f5de04fb nodeName:}" failed. No retries permitted until 2026-07-10 20:58:15.290607961 +0000 UTC m=+38.727577185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls") pod "image-registry-64d699b98d-bsw2d" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb") : secret "image-registry-tls" not found Jul 10 20:58:14.297561 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.297531 2585 generic.go:356] "Generic (PLEG): container finished" podID="526d28e7-0053-4420-a596-cf8ae88873d0" containerID="bb8f9bfbcf1268fa01b142cf1a2e6bd81f3d1444d4b959ad008d02066050b1e3" exitCode=0 Jul 10 20:58:14.297683 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.297625 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerDied","Data":"bb8f9bfbcf1268fa01b142cf1a2e6bd81f3d1444d4b959ad008d02066050b1e3"} Jul 10 20:58:14.298907 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.298883 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" event={"ID":"3a29b994-1466-4b6a-ab7a-b62990316c79","Type":"ContainerStarted","Data":"6d7ed8dd0b818f6a64b1dd44147860b2f681afc975d3525ad2a0135ef47ce534"} Jul 10 20:58:14.300135 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.300105 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j9drs" event={"ID":"c43b12f4-650a-4b57-91d4-ba437b4588bf","Type":"ContainerStarted","Data":"3c832a4c90948cedf38f3c424c78a2f29c7d12f16ba61dc5746205cb4bf8a31c"} Jul 10 20:58:14.301612 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.301589 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" event={"ID":"833fe8f0-3548-43fc-bf69-13d264c4bfbf","Type":"ContainerStarted","Data":"a2649e78f4d24f7d2130253caa58ec3fbdca8fff4ad15744398eeaa42c87edd5"} Jul 10 20:58:14.391899 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:14.391871 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:14.392096 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.392076 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:58:14.392168 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:14.392143 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls podName:198a058a-e685-4dab-ae34-c3afb56606a6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:15.392124159 +0000 UTC m=+38.829093367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls") pod "cluster-samples-operator-65db858894-2v56l" (UID: "198a058a-e685-4dab-ae34-c3afb56606a6") : secret "samples-operator-tls" not found Jul 10 20:58:15.300712 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.300506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:15.300712 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.300659 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:17.300640487 +0000 UTC m=+40.737609712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : configmap references non-existent config key: service-ca.crt Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.300775 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.300828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.300970 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.300978 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.300992 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d699b98d-bsw2d: secret "image-registry-tls" not found Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.301029 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:17.301013655 +0000 UTC m=+40.737982863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : secret "router-metrics-certs-default" not found Jul 10 20:58:15.301195 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.301044 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls podName:72757d76-20e8-4868-a42c-97a6f5de04fb nodeName:}" failed. No retries permitted until 2026-07-10 20:58:17.301036265 +0000 UTC m=+40.738005474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls") pod "image-registry-64d699b98d-bsw2d" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb") : secret "image-registry-tls" not found Jul 10 20:58:15.308559 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.308529 2585 generic.go:356] "Generic (PLEG): container finished" podID="526d28e7-0053-4420-a596-cf8ae88873d0" containerID="e0adf02ffdf0449f811644396bc7e8c86a73dc5a8131c995df1d88ca5c2ddf08" exitCode=0 Jul 10 20:58:15.308682 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.308604 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerDied","Data":"e0adf02ffdf0449f811644396bc7e8c86a73dc5a8131c995df1d88ca5c2ddf08"} Jul 10 20:58:15.402255 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.402223 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:15.402843 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.402822 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:58:15.402917 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.402884 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls podName:198a058a-e685-4dab-ae34-c3afb56606a6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:17.402864744 +0000 UTC m=+40.839833954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls") pod "cluster-samples-operator-65db858894-2v56l" (UID: "198a058a-e685-4dab-ae34-c3afb56606a6") : secret "samples-operator-tls" not found Jul 10 20:58:15.705638 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:15.705601 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:15.705838 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.705785 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:58:15.705912 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:15.705865 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls podName:d22c8ed7-0925-4736-a9bf-9beb23714312 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:19.705840913 +0000 UTC m=+43.142810125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls") pod "dns-default-qxdt9" (UID: "d22c8ed7-0925-4736-a9bf-9beb23714312") : secret "dns-default-metrics-tls" not found Jul 10 20:58:16.318594 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:16.318560 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" event={"ID":"526d28e7-0053-4420-a596-cf8ae88873d0","Type":"ContainerStarted","Data":"3969ce781cfdd1080fdc426329e5225be2617aabaeaff83799e04ae6c3b9047d"} Jul 10 20:58:16.348532 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:16.348476 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hzmlm" podStartSLOduration=9.26019099 podStartE2EDuration="39.348454389s" totalImagesPullingTime="30.088263399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:16.346829468 +0000 UTC m=+39.783798736" watchObservedRunningTime="2026-07-10 20:58:16.348454389 +0000 UTC m=+39.785423615" Jul 10 20:58:17.320057 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:17.320024 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:17.320077 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.320163 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.320173 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d699b98d-bsw2d: secret "image-registry-tls" not found Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.320202 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:21.320177658 +0000 UTC m=+44.757146869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : configmap references non-existent config key: service-ca.crt Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:17.320255 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.320278 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls podName:72757d76-20e8-4868-a42c-97a6f5de04fb nodeName:}" failed. No retries permitted until 2026-07-10 20:58:21.320266187 +0000 UTC m=+44.757235396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls") pod "image-registry-64d699b98d-bsw2d" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb") : secret "image-registry-tls" not found Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.320322 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:58:17.320492 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.320362 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:21.320349654 +0000 UTC m=+44.757318865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : secret "router-metrics-certs-default" not found Jul 10 20:58:17.421579 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:17.421539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:17.421768 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.421675 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:58:17.421768 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:17.421729 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls podName:198a058a-e685-4dab-ae34-c3afb56606a6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:21.421715694 +0000 UTC m=+44.858684904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls") pod "cluster-samples-operator-65db858894-2v56l" (UID: "198a058a-e685-4dab-ae34-c3afb56606a6") : secret "samples-operator-tls" not found Jul 10 20:58:18.325490 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:18.325448 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" event={"ID":"3a29b994-1466-4b6a-ab7a-b62990316c79","Type":"ContainerStarted","Data":"4c22f80fc129df3119dc6e74ca42bb1187af91a0b020b5ac9e210a3da1eeff42"} Jul 10 20:58:18.327056 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:18.327029 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j9drs" event={"ID":"c43b12f4-650a-4b57-91d4-ba437b4588bf","Type":"ContainerStarted","Data":"b33974f074bf1af77e77c8d1b7b87968063dbdaa7fd2e839280e236ab02cc709"} Jul 10 20:58:18.328489 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:18.328469 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" event={"ID":"833fe8f0-3548-43fc-bf69-13d264c4bfbf","Type":"ContainerStarted","Data":"34e27eb8872009ef4e9043550ff48a5fde5b54a92959e2382496c7a98c12be47"} Jul 10 20:58:18.350243 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:18.350185 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" podStartSLOduration=1.8032900870000002 podStartE2EDuration="5.350166413s" totalImagesPullingTime="3.546876326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:18.348467301 +0000 UTC m=+41.785436524" watchObservedRunningTime="2026-07-10 20:58:18.350166413 +0000 UTC m=+41.787135645" Jul 10 20:58:18.374231 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:18.374177 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" podStartSLOduration=1.7998188480000001 podStartE2EDuration="5.37415704s" totalImagesPullingTime="3.574338192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:18.373196878 +0000 UTC m=+41.810166109" watchObservedRunningTime="2026-07-10 20:58:18.37415704 +0000 UTC m=+41.811126271" Jul 10 20:58:18.405099 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:18.405054 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j9drs" podStartSLOduration=3.31754986 podStartE2EDuration="7.405040706s" totalImagesPullingTime="4.087490846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:18.402597802 +0000 UTC m=+41.839567033" watchObservedRunningTime="2026-07-10 20:58:18.405040706 +0000 UTC m=+41.842009934" Jul 10 20:58:19.651153 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.651118 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2vd7l"] Jul 10 20:58:19.667780 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.667754 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.670693 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.670669 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 20:58:19.670936 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.670902 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 20:58:19.671775 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.671758 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r272c\"" Jul 10 20:58:19.675838 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.675816 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vd7l"] Jul 10 20:58:19.742244 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.742214 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.742404 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.742313 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:19.742404 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.742338 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17180bfe-fc86-48fd-8e09-e3c3cf233183-data-volume\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.742404 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.742355 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.742586 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:19.742428 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:58:19.742586 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.742434 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17180bfe-fc86-48fd-8e09-e3c3cf233183-crio-socket\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.742586 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:19.742511 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls podName:d22c8ed7-0925-4736-a9bf-9beb23714312 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:27.742489137 +0000 UTC m=+51.179458360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls") pod "dns-default-qxdt9" (UID: "d22c8ed7-0925-4736-a9bf-9beb23714312") : secret "dns-default-metrics-tls" not found Jul 10 20:58:19.742586 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.742564 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbvvb\" (UniqueName: \"kubernetes.io/projected/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-api-access-hbvvb\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843601 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843565 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17180bfe-fc86-48fd-8e09-e3c3cf233183-data-volume\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843769 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843607 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843769 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843660 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17180bfe-fc86-48fd-8e09-e3c3cf233183-crio-socket\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843769 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843695 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbvvb\" (UniqueName: \"kubernetes.io/projected/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-api-access-hbvvb\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843769 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843731 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843965 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:19.843825 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:58:19.843965 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843875 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17180bfe-fc86-48fd-8e09-e3c3cf233183-crio-socket\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843965 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:19.843901 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:20.343881043 +0000 UTC m=+43.780850269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : secret "insights-runtime-extractor-tls" not found Jul 10 20:58:19.843965 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:19.843830 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:58:19.843965 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.843933 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17180bfe-fc86-48fd-8e09-e3c3cf233183-data-volume\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:19.843965 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:19.843964 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:20.343950858 +0000 UTC m=+43.780920069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : configmap "kube-rbac-proxy" not found Jul 10 20:58:19.867019 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:19.866995 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbvvb\" (UniqueName: \"kubernetes.io/projected/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-api-access-hbvvb\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:20.347640 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:20.347608 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:20.347795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:20.347691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:20.347795 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:20.347734 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:58:20.347795 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:20.347793 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:58:20.347916 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:20.347802 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:21.347786163 +0000 UTC m=+44.784755387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : configmap "kube-rbac-proxy" not found Jul 10 20:58:20.347916 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:20.347831 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:21.34781957 +0000 UTC m=+44.784788778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : secret "insights-runtime-extractor-tls" not found Jul 10 20:58:21.347371 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.347334 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kptzq"] Jul 10 20:58:21.356668 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.356640 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:21.356774 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.356689 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:21.356774 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.356707 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:21.356774 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.356735 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.356790 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356805 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356824 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:29.356802028 +0000 UTC m=+52.793771253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : configmap references non-existent config key: service-ca.crt Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356825 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d699b98d-bsw2d: secret "image-registry-tls" not found Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356864 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356874 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls podName:72757d76-20e8-4868-a42c-97a6f5de04fb nodeName:}" failed. No retries permitted until 2026-07-10 20:58:29.356862166 +0000 UTC m=+52.793831374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls") pod "image-registry-64d699b98d-bsw2d" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb") : secret "image-registry-tls" not found Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356883 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:58:21.356908 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356900 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 20:58:21.357297 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356921 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:23.356906499 +0000 UTC m=+46.793875710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : configmap "kube-rbac-proxy" not found Jul 10 20:58:21.357297 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356941 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:23.356930991 +0000 UTC m=+46.793900199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : secret "insights-runtime-extractor-tls" not found Jul 10 20:58:21.357297 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.356954 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs podName:01446074-b907-45b7-a35e-4320ff9d1f4d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:29.356948789 +0000 UTC m=+52.793917997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs") pod "router-default-8dbbdd55b-fhkls" (UID: "01446074-b907-45b7-a35e-4320ff9d1f4d") : secret "router-metrics-certs-default" not found Jul 10 20:58:21.376965 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.376942 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kptzq"] Jul 10 20:58:21.377094 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.377031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.379628 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.379603 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 20:58:21.379753 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.379658 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 20:58:21.379834 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.379668 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 20:58:21.379834 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.379701 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 20:58:21.380835 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.380817 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xqk9p\"" Jul 10 20:58:21.457938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.457908 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm85d\" (UniqueName: \"kubernetes.io/projected/6013abae-2de6-4453-816b-2c876df679c6-kube-api-access-xm85d\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.458066 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.457952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6013abae-2de6-4453-816b-2c876df679c6-signing-cabundle\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.458066 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.458060 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:21.458143 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.458108 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6013abae-2de6-4453-816b-2c876df679c6-signing-key\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.458206 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.458194 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:58:21.458257 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:21.458248 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls podName:198a058a-e685-4dab-ae34-c3afb56606a6 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:29.458233674 +0000 UTC m=+52.895202882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls") pod "cluster-samples-operator-65db858894-2v56l" (UID: "198a058a-e685-4dab-ae34-c3afb56606a6") : secret "samples-operator-tls" not found Jul 10 20:58:21.559390 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.559358 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm85d\" (UniqueName: \"kubernetes.io/projected/6013abae-2de6-4453-816b-2c876df679c6-kube-api-access-xm85d\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.559550 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.559409 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6013abae-2de6-4453-816b-2c876df679c6-signing-cabundle\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.559615 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.559598 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6013abae-2de6-4453-816b-2c876df679c6-signing-key\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.560099 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.560072 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6013abae-2de6-4453-816b-2c876df679c6-signing-cabundle\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.561848 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.561832 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6013abae-2de6-4453-816b-2c876df679c6-signing-key\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.572100 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.572070 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm85d\" (UniqueName: \"kubernetes.io/projected/6013abae-2de6-4453-816b-2c876df679c6-kube-api-access-xm85d\") pod \"service-ca-79f68b9f4f-kptzq\" (UID: \"6013abae-2de6-4453-816b-2c876df679c6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.686012 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.685929 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" Jul 10 20:58:21.828277 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:21.828249 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kptzq"] Jul 10 20:58:21.831873 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:21.831844 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6013abae_2de6_4453_816b_2c876df679c6.slice/crio-85c6da2665ecd7a46195a78a687ee63851fbb782dd4a020b81988c719d98b12d WatchSource:0}: Error finding container 85c6da2665ecd7a46195a78a687ee63851fbb782dd4a020b81988c719d98b12d: Status 404 returned error can't find the container with id 85c6da2665ecd7a46195a78a687ee63851fbb782dd4a020b81988c719d98b12d Jul 10 20:58:22.019179 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:22.019112 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8pnff_c5eb908d-afe1-4855-b566-0b638812f04f/dns-node-resolver/0.log" Jul 10 20:58:22.339987 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:22.339952 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" event={"ID":"6013abae-2de6-4453-816b-2c876df679c6","Type":"ContainerStarted","Data":"59d5d28481b93a17a98ba637905770f07873ed48ba8a1a72c08cf484c0b07d3c"} Jul 10 20:58:22.340184 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:22.340003 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" event={"ID":"6013abae-2de6-4453-816b-2c876df679c6","Type":"ContainerStarted","Data":"85c6da2665ecd7a46195a78a687ee63851fbb782dd4a020b81988c719d98b12d"} Jul 10 20:58:22.359121 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:22.359071 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-kptzq" podStartSLOduration=1.359055305 podStartE2EDuration="1.359055305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:22.358511188 +0000 UTC m=+45.795480454" watchObservedRunningTime="2026-07-10 20:58:22.359055305 +0000 UTC m=+45.796024534" Jul 10 20:58:23.024741 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:23.024712 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pthg9_369a8078-18e9-4a26-9718-5ca221b76763/node-ca/0.log" Jul 10 20:58:23.376180 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:23.376137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:23.376659 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:23.376258 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:23.376659 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:23.376367 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:58:23.376659 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:23.376440 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:27.376406642 +0000 UTC m=+50.813375854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : configmap "kube-rbac-proxy" not found Jul 10 20:58:23.376967 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:23.376949 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:58:23.377441 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:23.377408 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:27.377389571 +0000 UTC m=+50.814358781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : secret "insights-runtime-extractor-tls" not found Jul 10 20:58:23.816656 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:23.816577 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j9drs_c43b12f4-650a-4b57-91d4-ba437b4588bf/serve-healthcheck-canary/0.log" Jul 10 20:58:27.408114 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:27.408076 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:27.408513 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:27.408242 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:27.408513 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:27.408278 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:58:27.408513 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:27.408356 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:58:27.408513 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:27.408362 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:35.408341121 +0000 UTC m=+58.845310336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : secret "insights-runtime-extractor-tls" not found Jul 10 20:58:27.408513 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:27.408426 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm podName:17180bfe-fc86-48fd-8e09-e3c3cf233183 nodeName:}" failed. No retries permitted until 2026-07-10 20:58:35.408400255 +0000 UTC m=+58.845369466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vd7l" (UID: "17180bfe-fc86-48fd-8e09-e3c3cf233183") : configmap "kube-rbac-proxy" not found Jul 10 20:58:27.810899 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:27.810827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:27.813194 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:27.813170 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d22c8ed7-0925-4736-a9bf-9beb23714312-metrics-tls\") pod \"dns-default-qxdt9\" (UID: \"d22c8ed7-0925-4736-a9bf-9beb23714312\") " pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:27.843222 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:27.843181 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:27.983609 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:27.983581 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qxdt9"] Jul 10 20:58:27.986304 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:27.986274 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22c8ed7_0925_4736_a9bf_9beb23714312.slice/crio-26536ca6be700891c6d765a49a8c04365057478fe714cb30029a617f8ba0beab WatchSource:0}: Error finding container 26536ca6be700891c6d765a49a8c04365057478fe714cb30029a617f8ba0beab: Status 404 returned error can't find the container with id 26536ca6be700891c6d765a49a8c04365057478fe714cb30029a617f8ba0beab Jul 10 20:58:28.356211 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:28.356173 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxdt9" event={"ID":"d22c8ed7-0925-4736-a9bf-9beb23714312","Type":"ContainerStarted","Data":"26536ca6be700891c6d765a49a8c04365057478fe714cb30029a617f8ba0beab"} Jul 10 20:58:29.425665 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.425627 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:29.426169 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.425690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:29.426169 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.425743 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:29.426463 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.426388 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01446074-b907-45b7-a35e-4320ff9d1f4d-service-ca-bundle\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:29.428583 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.428529 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01446074-b907-45b7-a35e-4320ff9d1f4d-metrics-certs\") pod \"router-default-8dbbdd55b-fhkls\" (UID: \"01446074-b907-45b7-a35e-4320ff9d1f4d\") " pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:29.428717 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.428671 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"image-registry-64d699b98d-bsw2d\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:29.435395 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.435363 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:29.449494 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.449467 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:29.526820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.526792 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:29.529664 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.529630 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198a058a-e685-4dab-ae34-c3afb56606a6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2v56l\" (UID: \"198a058a-e685-4dab-ae34-c3afb56606a6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:29.646775 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.646729 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" Jul 10 20:58:29.936071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:29.936044 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8dbbdd55b-fhkls"] Jul 10 20:58:29.938052 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:29.938019 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01446074_b907_45b7_a35e_4320ff9d1f4d.slice/crio-8493e9c327bae0c84edf8a15072a6fe2ab212b730c15aaca3ae6b9cc2aab9012 WatchSource:0}: Error finding container 8493e9c327bae0c84edf8a15072a6fe2ab212b730c15aaca3ae6b9cc2aab9012: Status 404 returned error can't find the container with id 8493e9c327bae0c84edf8a15072a6fe2ab212b730c15aaca3ae6b9cc2aab9012 Jul 10 20:58:30.159929 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.159907 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l"] Jul 10 20:58:30.163231 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.163204 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d699b98d-bsw2d"] Jul 10 20:58:30.167088 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:30.167057 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72757d76_20e8_4868_a42c_97a6f5de04fb.slice/crio-38cc8b3d72e2c2e5508b31e7804c984528daeec6450c4b27e9ebe84aba80cf79 WatchSource:0}: Error finding container 38cc8b3d72e2c2e5508b31e7804c984528daeec6450c4b27e9ebe84aba80cf79: Status 404 returned error can't find the container with id 38cc8b3d72e2c2e5508b31e7804c984528daeec6450c4b27e9ebe84aba80cf79 Jul 10 20:58:30.367235 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.367192 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" event={"ID":"01446074-b907-45b7-a35e-4320ff9d1f4d","Type":"ContainerStarted","Data":"4ebed75e66db968e30e90a5b2af49ea9c3161755630cc156a7de19def88beafe"} Jul 10 20:58:30.367460 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.367261 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" event={"ID":"01446074-b907-45b7-a35e-4320ff9d1f4d","Type":"ContainerStarted","Data":"8493e9c327bae0c84edf8a15072a6fe2ab212b730c15aaca3ae6b9cc2aab9012"} Jul 10 20:58:30.368830 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.368803 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" event={"ID":"72757d76-20e8-4868-a42c-97a6f5de04fb","Type":"ContainerStarted","Data":"b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601"} Jul 10 20:58:30.368930 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.368850 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" event={"ID":"72757d76-20e8-4868-a42c-97a6f5de04fb","Type":"ContainerStarted","Data":"38cc8b3d72e2c2e5508b31e7804c984528daeec6450c4b27e9ebe84aba80cf79"} Jul 10 20:58:30.368930 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.368896 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:30.370620 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.370597 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxdt9" event={"ID":"d22c8ed7-0925-4736-a9bf-9beb23714312","Type":"ContainerStarted","Data":"42a528c8b987398e137e8048aa4e108c7af0ca8a9e984c5a34a11e882e6d0b25"} Jul 10 20:58:30.370718 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.370649 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:30.370718 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.370674 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxdt9" event={"ID":"d22c8ed7-0925-4736-a9bf-9beb23714312","Type":"ContainerStarted","Data":"5e424c323a4488c7d4d43278527ef49b9dcbfbc6873b91b85b3eb4961a47d276"} Jul 10 20:58:30.371821 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.371802 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" event={"ID":"198a058a-e685-4dab-ae34-c3afb56606a6","Type":"ContainerStarted","Data":"c96535c9719b03639b7b3df6384dccb8eefd33c29e3383cf84d9948cfe7f688e"} Jul 10 20:58:30.425437 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.425332 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" podStartSLOduration=17.425316645 podStartE2EDuration="17.425316645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:30.425129028 +0000 UTC m=+53.862098277" watchObservedRunningTime="2026-07-10 20:58:30.425316645 +0000 UTC m=+53.862285876" Jul 10 20:58:30.442980 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.442931 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qxdt9" podStartSLOduration=17.284248624 podStartE2EDuration="19.442912818s" totalImagesPullingTime="2.158664194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:30.442906957 +0000 UTC m=+53.879876208" watchObservedRunningTime="2026-07-10 20:58:30.442912818 +0000 UTC m=+53.879882026" Jul 10 20:58:30.450243 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.450219 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:30.452922 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.452899 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:30.461565 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:30.461512 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" podStartSLOduration=17.461493668 podStartE2EDuration="17.461493668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:30.460371483 +0000 UTC m=+53.897340713" watchObservedRunningTime="2026-07-10 20:58:30.461493668 +0000 UTC m=+53.898462899" Jul 10 20:58:31.375622 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:31.375594 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:31.376684 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:31.376660 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8dbbdd55b-fhkls" Jul 10 20:58:32.379848 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:32.379815 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" event={"ID":"198a058a-e685-4dab-ae34-c3afb56606a6","Type":"ContainerStarted","Data":"c55b12445a12b1c971148f0733932b11a2544fc6e86a60c46fedee7b79e7410a"} Jul 10 20:58:32.380212 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:32.379876 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" event={"ID":"198a058a-e685-4dab-ae34-c3afb56606a6","Type":"ContainerStarted","Data":"5ca990c6d0ac95e5f2163ec3d3fbce6ad9bd50bc4299384ea8d2bcdd5ca5b9de"} Jul 10 20:58:32.397354 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:32.397307 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2v56l" podStartSLOduration=17.578609132 podStartE2EDuration="19.397290219s" totalImagesPullingTime="1.818681087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:32.396500768 +0000 UTC m=+55.833469998" watchObservedRunningTime="2026-07-10 20:58:32.397290219 +0000 UTC m=+55.834259451" Jul 10 20:58:35.479432 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:35.479370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:35.479918 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:35.479458 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:35.479960 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:35.479914 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17180bfe-fc86-48fd-8e09-e3c3cf233183-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:35.481738 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:35.481714 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17180bfe-fc86-48fd-8e09-e3c3cf233183-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vd7l\" (UID: \"17180bfe-fc86-48fd-8e09-e3c3cf233183\") " pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:35.578064 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:35.578030 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vd7l" Jul 10 20:58:35.708368 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:35.708340 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vd7l"] Jul 10 20:58:35.711178 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:35.711152 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17180bfe_fc86_48fd_8e09_e3c3cf233183.slice/crio-0b1fb31dae4694a1e9f7844d4066597e1e7284e5b6f7297c1bb92f7976780bdc WatchSource:0}: Error finding container 0b1fb31dae4694a1e9f7844d4066597e1e7284e5b6f7297c1bb92f7976780bdc: Status 404 returned error can't find the container with id 0b1fb31dae4694a1e9f7844d4066597e1e7284e5b6f7297c1bb92f7976780bdc Jul 10 20:58:36.400945 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:36.400896 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vd7l" event={"ID":"17180bfe-fc86-48fd-8e09-e3c3cf233183","Type":"ContainerStarted","Data":"0b1fb31dae4694a1e9f7844d4066597e1e7284e5b6f7297c1bb92f7976780bdc"} Jul 10 20:58:39.292465 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:39.292433 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nlxcl" Jul 10 20:58:40.377571 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:40.377548 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qxdt9" Jul 10 20:58:40.416159 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:40.416123 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vd7l" event={"ID":"17180bfe-fc86-48fd-8e09-e3c3cf233183","Type":"ContainerStarted","Data":"1ec421ca7854246108335941748276d76ab928e8b3423cf4ebc613e3cff1877b"} Jul 10 20:58:40.416260 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:40.416174 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vd7l" event={"ID":"17180bfe-fc86-48fd-8e09-e3c3cf233183","Type":"ContainerStarted","Data":"3d17f65e4cf83ee2e0c95cc0272626761fb5492f3551f02d8c16a19f78cc40e8"} Jul 10 20:58:42.842637 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.842601 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:42.843066 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.842644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:42.845635 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.845609 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 20:58:42.846628 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.846611 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 20:58:42.855875 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.855852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db26601d-93b4-4a24-b54c-49ba2d7ea316-metrics-certs\") pod \"network-metrics-daemon-hmwmh\" (UID: \"db26601d-93b4-4a24-b54c-49ba2d7ea316\") " pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:42.855994 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.855951 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1-original-pull-secret\") pod \"global-pull-secret-syncer-r85lp\" (UID: \"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1\") " pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:42.943501 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.943463 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:42.946483 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.946465 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 20:58:42.957204 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.957186 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 20:58:42.966968 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:42.966941 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnlv\" (UniqueName: \"kubernetes.io/projected/fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6-kube-api-access-kjnlv\") pod \"network-check-target-pfqh2\" (UID: \"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6\") " pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:43.035510 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.035476 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4fk7p\"" Jul 10 20:58:43.039583 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.039563 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r85lp" Jul 10 20:58:43.042680 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.042662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:43.136461 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.136393 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8kn2h\"" Jul 10 20:58:43.141904 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.141883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmwmh" Jul 10 20:58:43.384383 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.384360 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmwmh"] Jul 10 20:58:43.387174 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:43.387108 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb26601d_93b4_4a24_b54c_49ba2d7ea316.slice/crio-3e61fc36a94ccafbd1e8267e01eb9f9f08ee815ec314dc9d47439c8ebfdc430b WatchSource:0}: Error finding container 3e61fc36a94ccafbd1e8267e01eb9f9f08ee815ec314dc9d47439c8ebfdc430b: Status 404 returned error can't find the container with id 3e61fc36a94ccafbd1e8267e01eb9f9f08ee815ec314dc9d47439c8ebfdc430b Jul 10 20:58:43.413429 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.413392 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pfqh2"] Jul 10 20:58:43.415853 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:43.415834 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc41b8e4_240d_4546_9c7f_e25d0dd7d4d6.slice/crio-bf68e09cfe527bed715f1507c19d79314a641ea4dff0565443b6d24f2f450761 WatchSource:0}: Error finding container bf68e09cfe527bed715f1507c19d79314a641ea4dff0565443b6d24f2f450761: Status 404 returned error can't find the container with id bf68e09cfe527bed715f1507c19d79314a641ea4dff0565443b6d24f2f450761 Jul 10 20:58:43.426817 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.426793 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pfqh2" event={"ID":"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6","Type":"ContainerStarted","Data":"bf68e09cfe527bed715f1507c19d79314a641ea4dff0565443b6d24f2f450761"} Jul 10 20:58:43.427849 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.427827 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmwmh" event={"ID":"db26601d-93b4-4a24-b54c-49ba2d7ea316","Type":"ContainerStarted","Data":"3e61fc36a94ccafbd1e8267e01eb9f9f08ee815ec314dc9d47439c8ebfdc430b"} Jul 10 20:58:43.429639 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.429621 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vd7l" event={"ID":"17180bfe-fc86-48fd-8e09-e3c3cf233183","Type":"ContainerStarted","Data":"8ba58af7520f2aba3f1ecac4eb879f6aacd7e17d3fbaa1b0c8b39a6e44d783f5"} Jul 10 20:58:43.440754 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:43.440734 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r85lp"] Jul 10 20:58:43.443125 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:43.443105 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c2e0e6_6b42_463f_a1db_56bfcff0aeb1.slice/crio-9de421fd2a7b57a15bb156af833e09c39680d99679d96a25052d031b53b7f94e WatchSource:0}: Error finding container 9de421fd2a7b57a15bb156af833e09c39680d99679d96a25052d031b53b7f94e: Status 404 returned error can't find the container with id 9de421fd2a7b57a15bb156af833e09c39680d99679d96a25052d031b53b7f94e Jul 10 20:58:44.436870 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:44.436793 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r85lp" event={"ID":"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1","Type":"ContainerStarted","Data":"9de421fd2a7b57a15bb156af833e09c39680d99679d96a25052d031b53b7f94e"} Jul 10 20:58:44.996010 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:44.995863 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2vd7l" podStartSLOduration=18.594679693 podStartE2EDuration="25.995841744s" totalImagesPullingTime="7.401162051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:58:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:43.47072036 +0000 UTC m=+66.907689591" watchObservedRunningTime="2026-07-10 20:58:44.995841744 +0000 UTC m=+68.432810975" Jul 10 20:58:44.996200 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:44.996182 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d699b98d-bsw2d"] Jul 10 20:58:45.113670 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.113637 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59494475f9-2r8gs"] Jul 10 20:58:45.116317 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.116295 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.181703 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.181632 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59494475f9-2r8gs"] Jul 10 20:58:45.263450 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263347 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-trusted-ca\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263450 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263395 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-image-registry-private-configuration\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263450 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263444 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-installation-pull-secrets\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263733 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263480 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-registry-certificates\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263733 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263519 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-registry-tls\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263733 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263566 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-bound-sa-token\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263733 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263590 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-ca-trust-extracted\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.263733 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.263620 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql76x\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-kube-api-access-ql76x\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364756 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364724 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-bound-sa-token\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364765 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-ca-trust-extracted\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364797 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql76x\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-kube-api-access-ql76x\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364837 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-trusted-ca\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364864 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-image-registry-private-configuration\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364891 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-installation-pull-secrets\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.364938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364918 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-registry-certificates\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.365183 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.364954 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-registry-tls\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.365262 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.365235 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-ca-trust-extracted\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.365980 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.365952 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-trusted-ca\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.366089 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.366055 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-registry-certificates\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.367756 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.367730 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-installation-pull-secrets\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.367871 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.367791 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-registry-tls\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.368219 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.368194 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-image-registry-private-configuration\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.386554 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.386531 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-bound-sa-token\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.388779 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.388756 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql76x\" (UniqueName: \"kubernetes.io/projected/b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f-kube-api-access-ql76x\") pod \"image-registry-59494475f9-2r8gs\" (UID: \"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f\") " pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.428945 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.428913 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:45.442590 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.442553 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmwmh" event={"ID":"db26601d-93b4-4a24-b54c-49ba2d7ea316","Type":"ContainerStarted","Data":"b61d2ee1b011e9217964e50b98347e83f6f6e90eca16ce3814d6cfa40e5e0530"} Jul 10 20:58:45.442962 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.442625 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmwmh" event={"ID":"db26601d-93b4-4a24-b54c-49ba2d7ea316","Type":"ContainerStarted","Data":"b2a11f1684a220199f542963696c1c103baac6e638ec1c4f592d2033fdd669df"} Jul 10 20:58:45.484669 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:45.484610 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hmwmh" podStartSLOduration=67.298852704 podStartE2EDuration="1m8.484593949s" totalImagesPullingTime="1.185741245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:45.48423638 +0000 UTC m=+68.921205623" watchObservedRunningTime="2026-07-10 20:58:45.484593949 +0000 UTC m=+68.921563222" Jul 10 20:58:48.030366 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:48.030321 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e6d6d0_9e27_49ca_bcf4_1e93f3f01d8f.slice/crio-2fe9726d02b9e9c580be4dffa545922163a6092663925b8b7163ae6820f3f66b WatchSource:0}: Error finding container 2fe9726d02b9e9c580be4dffa545922163a6092663925b8b7163ae6820f3f66b: Status 404 returned error can't find the container with id 2fe9726d02b9e9c580be4dffa545922163a6092663925b8b7163ae6820f3f66b Jul 10 20:58:48.030806 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.030659 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59494475f9-2r8gs"] Jul 10 20:58:48.456655 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.456616 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r85lp" event={"ID":"b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1","Type":"ContainerStarted","Data":"e92c48642388bbca7e8c36c3038f0b86d8a74beff8d7b062d3f9589e32006941"} Jul 10 20:58:48.458030 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.457997 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" event={"ID":"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f","Type":"ContainerStarted","Data":"df7f20157f3be3143e577859221c027a068f09f8e9419ec60760e4ba9dc11349"} Jul 10 20:58:48.458166 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.458040 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" event={"ID":"b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f","Type":"ContainerStarted","Data":"2fe9726d02b9e9c580be4dffa545922163a6092663925b8b7163ae6820f3f66b"} Jul 10 20:58:48.458166 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.458063 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:58:48.459367 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.459331 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pfqh2" event={"ID":"fc41b8e4-240d-4546-9c7f-e25d0dd7d4d6","Type":"ContainerStarted","Data":"76e26b3e6649f73837f57bfb1051d203990532e68d2d3550c9cc41e985b7722d"} Jul 10 20:58:48.459480 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.459466 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:58:48.510478 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.510406 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r85lp" podStartSLOduration=67.094876588 podStartE2EDuration="1m11.510391152s" totalImagesPullingTime="4.415514564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:48.480714197 +0000 UTC m=+71.917683428" watchObservedRunningTime="2026-07-10 20:58:48.510391152 +0000 UTC m=+71.947360381" Jul 10 20:58:48.511287 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.511255 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pfqh2" podStartSLOduration=67.073550133 podStartE2EDuration="1m11.511246281s" totalImagesPullingTime="4.437696148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:48.510304187 +0000 UTC m=+71.947273418" watchObservedRunningTime="2026-07-10 20:58:48.511246281 +0000 UTC m=+71.948215575" Jul 10 20:58:48.543898 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:48.543851 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" podStartSLOduration=3.543835966 podStartE2EDuration="3.543835966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:48.543363254 +0000 UTC m=+71.980332483" watchObservedRunningTime="2026-07-10 20:58:48.543835966 +0000 UTC m=+71.980805198" Jul 10 20:58:50.272661 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.272630 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf"] Jul 10 20:58:50.300045 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.300019 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf"] Jul 10 20:58:50.300198 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.300123 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:50.304989 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.304957 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kpwhw\"" Jul 10 20:58:50.305122 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.305079 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 20:58:50.405997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.405953 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd1599ed-58c9-4cc7-8151-4abd7ea90b3c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-js9kf\" (UID: \"bd1599ed-58c9-4cc7-8151-4abd7ea90b3c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:50.507244 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:50.507213 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd1599ed-58c9-4cc7-8151-4abd7ea90b3c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-js9kf\" (UID: \"bd1599ed-58c9-4cc7-8151-4abd7ea90b3c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:50.507448 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:50.507335 2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 10 20:58:50.507448 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:50.507401 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1599ed-58c9-4cc7-8151-4abd7ea90b3c-tls-certificates podName:bd1599ed-58c9-4cc7-8151-4abd7ea90b3c nodeName:}" failed. No retries permitted until 2026-07-10 20:58:51.007385142 +0000 UTC m=+74.444354350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/bd1599ed-58c9-4cc7-8151-4abd7ea90b3c-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-js9kf" (UID: "bd1599ed-58c9-4cc7-8151-4abd7ea90b3c") : secret "prometheus-operator-admission-webhook-tls" not found Jul 10 20:58:51.012003 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:51.011966 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd1599ed-58c9-4cc7-8151-4abd7ea90b3c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-js9kf\" (UID: \"bd1599ed-58c9-4cc7-8151-4abd7ea90b3c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:51.014447 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:51.014396 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd1599ed-58c9-4cc7-8151-4abd7ea90b3c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-js9kf\" (UID: \"bd1599ed-58c9-4cc7-8151-4abd7ea90b3c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:51.209557 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:51.209518 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:51.349464 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:51.349434 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf"] Jul 10 20:58:51.353751 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:51.353721 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1599ed_58c9_4cc7_8151_4abd7ea90b3c.slice/crio-7685d5ff99e1e1c08ed63b93650aef309b106fb0cf67b960fcc4a3d700e52862 WatchSource:0}: Error finding container 7685d5ff99e1e1c08ed63b93650aef309b106fb0cf67b960fcc4a3d700e52862: Status 404 returned error can't find the container with id 7685d5ff99e1e1c08ed63b93650aef309b106fb0cf67b960fcc4a3d700e52862 Jul 10 20:58:51.472689 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:51.472649 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" event={"ID":"bd1599ed-58c9-4cc7-8151-4abd7ea90b3c","Type":"ContainerStarted","Data":"7685d5ff99e1e1c08ed63b93650aef309b106fb0cf67b960fcc4a3d700e52862"} Jul 10 20:58:52.478066 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:52.478033 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" event={"ID":"bd1599ed-58c9-4cc7-8151-4abd7ea90b3c","Type":"ContainerStarted","Data":"45a9cddcf8fd2c828c6951b2d71da1b022f842bb6c9875de361b37f45b888228"} Jul 10 20:58:52.478445 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:52.478171 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:52.482771 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:52.482749 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" Jul 10 20:58:52.505369 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:52.505323 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-js9kf" podStartSLOduration=1.475755567 podStartE2EDuration="2.505308444s" totalImagesPullingTime="1.029552877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:52.504551815 +0000 UTC m=+75.941521045" watchObservedRunningTime="2026-07-10 20:58:52.505308444 +0000 UTC m=+75.942277701" Jul 10 20:58:55.002595 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:55.002560 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:58:57.734842 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.734809 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6"] Jul 10 20:58:57.737375 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.737358 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.740871 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.740838 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 20:58:57.741000 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.740865 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 20:58:57.741070 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.740869 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t8tz7\"" Jul 10 20:58:57.741070 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.740873 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 20:58:57.741184 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.740912 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 20:58:57.741184 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.740917 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 20:58:57.747244 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.747221 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6"] Jul 10 20:58:57.767003 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.766977 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.767113 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.767023 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qzsd\" (UniqueName: \"kubernetes.io/projected/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-kube-api-access-4qzsd\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.767113 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.767076 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.767192 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.767112 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.787501 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.787479 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lszws"] Jul 10 20:58:57.789628 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.789613 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.792995 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.792974 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 20:58:57.793251 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.793236 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jrfw6\"" Jul 10 20:58:57.794568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.794553 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 20:58:57.794856 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.794840 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 20:58:57.867818 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867783 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-wtmp\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.867997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867821 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47193-fafb-4b68-ac47-7259d7a8873d-metrics-client-ca\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.867997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867844 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.867997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qzsd\" (UniqueName: \"kubernetes.io/projected/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-kube-api-access-4qzsd\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.867997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867910 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.867997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867925 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-tls\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.867997 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.867956 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.868296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868054 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-sys\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.868296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868076 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.868296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868099 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gbk2\" (UniqueName: \"kubernetes.io/projected/ccc47193-fafb-4b68-ac47-7259d7a8873d-kube-api-access-7gbk2\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.868296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-root\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.868296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868181 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.868296 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868212 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-textfile\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.868707 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.868678 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.870391 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.870368 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.870391 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.870379 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.876656 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.876632 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qzsd\" (UniqueName: \"kubernetes.io/projected/f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe-kube-api-access-4qzsd\") pod \"openshift-state-metrics-84bd68b896-4nkb6\" (UID: \"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:57.968693 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968660 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-wtmp\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968693 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968697 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47193-fafb-4b68-ac47-7259d7a8873d-metrics-client-ca\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968714 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-tls\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968776 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-sys\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968793 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968820 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gbk2\" (UniqueName: \"kubernetes.io/projected/ccc47193-fafb-4b68-ac47-7259d7a8873d-kube-api-access-7gbk2\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968827 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-wtmp\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.968883 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-root\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.969217 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968903 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-sys\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.969217 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-textfile\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.969217 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.968950 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccc47193-fafb-4b68-ac47-7259d7a8873d-root\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.969217 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:57.969007 2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 20:58:57.969217 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:58:57.969070 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-tls podName:ccc47193-fafb-4b68-ac47-7259d7a8873d nodeName:}" failed. No retries permitted until 2026-07-10 20:58:58.469052487 +0000 UTC m=+81.906021702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-tls") pod "node-exporter-lszws" (UID: "ccc47193-fafb-4b68-ac47-7259d7a8873d") : secret "node-exporter-tls" not found Jul 10 20:58:57.969501 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.969237 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-textfile\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.969501 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.969442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47193-fafb-4b68-ac47-7259d7a8873d-metrics-client-ca\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.969501 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.969447 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.971033 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.971011 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:57.976901 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:57.976870 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gbk2\" (UniqueName: \"kubernetes.io/projected/ccc47193-fafb-4b68-ac47-7259d7a8873d-kube-api-access-7gbk2\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:58.046773 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.046692 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" Jul 10 20:58:58.172873 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.172844 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6"] Jul 10 20:58:58.176610 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:58.176581 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bbe2d6_8d71_45d6_8d2b_1a72948eaebe.slice/crio-500f5a7145b3b104bdb693f3337a3f01e960753846c9eed69346595a5ec7f729 WatchSource:0}: Error finding container 500f5a7145b3b104bdb693f3337a3f01e960753846c9eed69346595a5ec7f729: Status 404 returned error can't find the container with id 500f5a7145b3b104bdb693f3337a3f01e960753846c9eed69346595a5ec7f729 Jul 10 20:58:58.472195 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.472165 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-tls\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:58.474444 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.474403 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccc47193-fafb-4b68-ac47-7259d7a8873d-node-exporter-tls\") pod \"node-exporter-lszws\" (UID: \"ccc47193-fafb-4b68-ac47-7259d7a8873d\") " pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:58.499888 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.499856 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" event={"ID":"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe","Type":"ContainerStarted","Data":"6a02fe38bfa0a3af8c9119bf99d505e4f816c65bf54a864fd639869934da3045"} Jul 10 20:58:58.500028 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.499921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" event={"ID":"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe","Type":"ContainerStarted","Data":"3d76ffd7dd726ee738d933178b3b05d3ca027fbf712923c4e4861398763ce604"} Jul 10 20:58:58.500028 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.499949 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" event={"ID":"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe","Type":"ContainerStarted","Data":"500f5a7145b3b104bdb693f3337a3f01e960753846c9eed69346595a5ec7f729"} Jul 10 20:58:58.699322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:58.699286 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lszws" Jul 10 20:58:58.709498 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:58:58.709471 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc47193_fafb_4b68_ac47_7259d7a8873d.slice/crio-4cb9a72baba53567b943402f80cddecf59c72eddd9270550a8d3be86951ebeb9 WatchSource:0}: Error finding container 4cb9a72baba53567b943402f80cddecf59c72eddd9270550a8d3be86951ebeb9: Status 404 returned error can't find the container with id 4cb9a72baba53567b943402f80cddecf59c72eddd9270550a8d3be86951ebeb9 Jul 10 20:58:59.506209 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:59.506174 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" event={"ID":"f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe","Type":"ContainerStarted","Data":"eba5381495a75a649ef2baf48a9bd1772129943791cc60626ee17a647884b171"} Jul 10 20:58:59.507821 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:59.507795 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lszws" event={"ID":"ccc47193-fafb-4b68-ac47-7259d7a8873d","Type":"ContainerStarted","Data":"4cb9a72baba53567b943402f80cddecf59c72eddd9270550a8d3be86951ebeb9"} Jul 10 20:58:59.529233 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:58:59.529176 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4nkb6" podStartSLOduration=1.391101894 podStartE2EDuration="2.52915569s" totalImagesPullingTime="1.138053796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:58:59.528099473 +0000 UTC m=+82.965068727" watchObservedRunningTime="2026-07-10 20:58:59.52915569 +0000 UTC m=+82.966124922" Jul 10 20:59:00.513754 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.513721 2585 generic.go:356] "Generic (PLEG): container finished" podID="ccc47193-fafb-4b68-ac47-7259d7a8873d" containerID="282bcd50c16a4719b4ad8d95997b8c730a8c8f47aa09fc5c587f89380af709a4" exitCode=0 Jul 10 20:59:00.514131 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.513803 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lszws" event={"ID":"ccc47193-fafb-4b68-ac47-7259d7a8873d","Type":"ContainerDied","Data":"282bcd50c16a4719b4ad8d95997b8c730a8c8f47aa09fc5c587f89380af709a4"} Jul 10 20:59:00.933676 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.933639 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75c8f96d58-68cs9"] Jul 10 20:59:00.941590 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.941558 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.944124 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.944100 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 20:59:00.944247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.944106 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 20:59:00.944247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.944140 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 20:59:00.944685 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.944652 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6i121io2vdm2i\"" Jul 10 20:59:00.945647 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.945228 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 20:59:00.945647 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.945445 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2p6lv\"" Jul 10 20:59:00.945826 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.945762 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 20:59:00.947580 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.947552 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75c8f96d58-68cs9"] Jul 10 20:59:00.991507 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991479 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991515 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991562 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991600 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991658 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991650 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8862f6f-0854-4d04-960b-60926b732d5a-metrics-client-ca\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991825 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991675 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-grpc-tls\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991825 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-tls\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:00.991825 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:00.991706 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxjbs\" (UniqueName: \"kubernetes.io/projected/c8862f6f-0854-4d04-960b-60926b732d5a-kube-api-access-wxjbs\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092283 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092247 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8862f6f-0854-4d04-960b-60926b732d5a-metrics-client-ca\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092459 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092298 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-grpc-tls\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092459 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-tls\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092459 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092355 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxjbs\" (UniqueName: \"kubernetes.io/projected/c8862f6f-0854-4d04-960b-60926b732d5a-kube-api-access-wxjbs\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092459 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092388 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092459 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092454 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092706 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092514 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.092706 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.092544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.093058 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.093024 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8862f6f-0854-4d04-960b-60926b732d5a-metrics-client-ca\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.095689 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.095628 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.095689 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.095653 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-tls\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.095838 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.095795 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.095895 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.095866 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.097208 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.097179 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-grpc-tls\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.097299 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.097245 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8862f6f-0854-4d04-960b-60926b732d5a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.101820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.101793 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxjbs\" (UniqueName: \"kubernetes.io/projected/c8862f6f-0854-4d04-960b-60926b732d5a-kube-api-access-wxjbs\") pod \"thanos-querier-75c8f96d58-68cs9\" (UID: \"c8862f6f-0854-4d04-960b-60926b732d5a\") " pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.252996 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.252922 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:01.385579 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.385546 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75c8f96d58-68cs9"] Jul 10 20:59:01.388953 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:59:01.388927 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8862f6f_0854_4d04_960b_60926b732d5a.slice/crio-bb1f4d120c03c769c0389e6ea2c37f2841ac61e38e0fbc6dee1cec24b698252e WatchSource:0}: Error finding container bb1f4d120c03c769c0389e6ea2c37f2841ac61e38e0fbc6dee1cec24b698252e: Status 404 returned error can't find the container with id bb1f4d120c03c769c0389e6ea2c37f2841ac61e38e0fbc6dee1cec24b698252e Jul 10 20:59:01.518938 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.518845 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"bb1f4d120c03c769c0389e6ea2c37f2841ac61e38e0fbc6dee1cec24b698252e"} Jul 10 20:59:01.520957 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.520928 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lszws" event={"ID":"ccc47193-fafb-4b68-ac47-7259d7a8873d","Type":"ContainerStarted","Data":"58f14ea38ee92737dd6d4fa61f4e210e3c19e33a59f72d4a384c1d55a2c1e50a"} Jul 10 20:59:01.521080 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.520971 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lszws" event={"ID":"ccc47193-fafb-4b68-ac47-7259d7a8873d","Type":"ContainerStarted","Data":"caeec0b73ff1ac1dbb4aaaf66ae0b2c1e7b1f94cebdbc25f237193716cce2b8a"} Jul 10 20:59:01.546747 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:01.546699 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lszws" podStartSLOduration=3.513185005 podStartE2EDuration="4.546682326s" totalImagesPullingTime="968.247019ms" totalInitContainerRuntime="65.250302ms" isStatefulPod=true podCreationTimestamp="2026-07-10 20:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:59:01.544989288 +0000 UTC m=+84.981958518" watchObservedRunningTime="2026-07-10 20:59:01.546682326 +0000 UTC m=+84.983651555" Jul 10 20:59:02.326877 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.326839 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-598cf84648-t4mn2"] Jul 10 20:59:02.331425 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.331392 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.335141 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.335116 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 20:59:02.335267 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.335163 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 20:59:02.335343 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.335278 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ms74h\"" Jul 10 20:59:02.335343 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.335280 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 20:59:02.335472 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.335297 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 20:59:02.335472 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.335377 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bkqj83hto3pa5\"" Jul 10 20:59:02.339266 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.339226 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-598cf84648-t4mn2"] Jul 10 20:59:02.403902 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.403865 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-secret-metrics-server-tls\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.404101 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.403930 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6m5\" (UniqueName: \"kubernetes.io/projected/2dec3450-2406-4515-8e8b-7c6291a57003-kube-api-access-tr6m5\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.404101 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.404025 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2dec3450-2406-4515-8e8b-7c6291a57003-audit-log\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.404101 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.404071 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-client-ca-bundle\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.404226 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.404131 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-secret-metrics-server-client-certs\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.404226 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.404169 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dec3450-2406-4515-8e8b-7c6291a57003-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.404226 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.404210 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2dec3450-2406-4515-8e8b-7c6291a57003-metrics-server-audit-profiles\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.504653 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504618 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6m5\" (UniqueName: \"kubernetes.io/projected/2dec3450-2406-4515-8e8b-7c6291a57003-kube-api-access-tr6m5\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.504820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504670 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2dec3450-2406-4515-8e8b-7c6291a57003-audit-log\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.504820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504715 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-client-ca-bundle\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.504820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504747 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-secret-metrics-server-client-certs\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.504820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dec3450-2406-4515-8e8b-7c6291a57003-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.504820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504815 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2dec3450-2406-4515-8e8b-7c6291a57003-metrics-server-audit-profiles\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.505066 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.504867 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-secret-metrics-server-tls\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.505347 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.505323 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2dec3450-2406-4515-8e8b-7c6291a57003-audit-log\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.505684 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.505658 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dec3450-2406-4515-8e8b-7c6291a57003-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.505943 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.505923 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2dec3450-2406-4515-8e8b-7c6291a57003-metrics-server-audit-profiles\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.507712 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.507685 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-client-ca-bundle\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.507811 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.507775 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-secret-metrics-server-client-certs\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.507907 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.507891 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2dec3450-2406-4515-8e8b-7c6291a57003-secret-metrics-server-tls\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.514773 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.514749 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6m5\" (UniqueName: \"kubernetes.io/projected/2dec3450-2406-4515-8e8b-7c6291a57003-kube-api-access-tr6m5\") pod \"metrics-server-598cf84648-t4mn2\" (UID: \"2dec3450-2406-4515-8e8b-7c6291a57003\") " pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.527693 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.527660 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg"] Jul 10 20:59:02.534087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.534069 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:02.536568 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.536548 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 20:59:02.536660 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.536609 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ggt65\"" Jul 10 20:59:02.539396 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.539376 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg"] Jul 10 20:59:02.606527 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.606402 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:02.606527 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.606482 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8gxz\" (UniqueName: \"kubernetes.io/projected/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-kube-api-access-r8gxz\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:02.643503 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.643471 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:02.708131 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.707653 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:02.708131 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.707711 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8gxz\" (UniqueName: \"kubernetes.io/projected/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-kube-api-access-r8gxz\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:02.708131 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:59:02.707844 2585 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 10 20:59:02.708131 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:59:02.707926 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-monitoring-plugin-cert podName:36436f9b-993b-4c84-8a7d-4cb4d9df2b88 nodeName:}" failed. No retries permitted until 2026-07-10 20:59:03.207903152 +0000 UTC m=+86.644872377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-4zkcg" (UID: "36436f9b-993b-4c84-8a7d-4cb4d9df2b88") : secret "monitoring-plugin-cert" not found Jul 10 20:59:02.719982 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.719953 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8gxz\" (UniqueName: \"kubernetes.io/projected/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-kube-api-access-r8gxz\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:02.809733 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:02.809700 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-598cf84648-t4mn2"] Jul 10 20:59:02.811685 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:59:02.811650 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dec3450_2406_4515_8e8b_7c6291a57003.slice/crio-fc8e646e078aeaa3bcd0e3ab86bd20939c64e685ffe59580441e3f66748885d4 WatchSource:0}: Error finding container fc8e646e078aeaa3bcd0e3ab86bd20939c64e685ffe59580441e3f66748885d4: Status 404 returned error can't find the container with id fc8e646e078aeaa3bcd0e3ab86bd20939c64e685ffe59580441e3f66748885d4 Jul 10 20:59:03.212624 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:03.212589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:03.215374 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:03.215343 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36436f9b-993b-4c84-8a7d-4cb4d9df2b88-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4zkcg\" (UID: \"36436f9b-993b-4c84-8a7d-4cb4d9df2b88\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:03.447689 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:03.447647 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:03.530833 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:03.530801 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" event={"ID":"2dec3450-2406-4515-8e8b-7c6291a57003","Type":"ContainerStarted","Data":"fc8e646e078aeaa3bcd0e3ab86bd20939c64e685ffe59580441e3f66748885d4"} Jul 10 20:59:03.599640 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:03.599614 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg"] Jul 10 20:59:03.602458 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:59:03.602432 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36436f9b_993b_4c84_8a7d_4cb4d9df2b88.slice/crio-49f7ea3eb80fb37e95ff022e244b48b3896783861f712f7ad892cd7c60dd2803 WatchSource:0}: Error finding container 49f7ea3eb80fb37e95ff022e244b48b3896783861f712f7ad892cd7c60dd2803: Status 404 returned error can't find the container with id 49f7ea3eb80fb37e95ff022e244b48b3896783861f712f7ad892cd7c60dd2803 Jul 10 20:59:04.211820 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.211786 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:59:04.216687 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.216662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.221171 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.221150 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 20:59:04.221518 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.221495 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 20:59:04.221637 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.221547 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j7wxt\"" Jul 10 20:59:04.221637 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.221595 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 20:59:04.221925 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.221902 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 20:59:04.222033 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.222018 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 20:59:04.222566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.222260 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 20:59:04.222566 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.222354 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 20:59:04.222725 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.222587 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8bdqq4jk3h3o6\"" Jul 10 20:59:04.222725 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.222682 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 20:59:04.222839 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.222791 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 20:59:04.223348 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.223145 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 20:59:04.223348 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.223207 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 20:59:04.223348 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.223329 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 20:59:04.226126 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.226105 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 20:59:04.232681 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.232660 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 20:59:04.248319 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.248297 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:59:04.321584 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321541 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.321584 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321585 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qkkg\" (UniqueName: \"kubernetes.io/projected/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-kube-api-access-6qkkg\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.321840 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321622 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-config-out\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.321840 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.321840 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321712 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.321840 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321780 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.321840 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321825 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321899 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321945 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.321973 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-web-config\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322012 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322071 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322039 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322088 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322124 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-config\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322161 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322180 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322202 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.322322 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.322240 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.423666 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.423619 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.423666 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.423657 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qkkg\" (UniqueName: \"kubernetes.io/projected/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-kube-api-access-6qkkg\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.423957 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.423685 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-config-out\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.423957 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.423873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.423957 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.423932 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424140 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.423959 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424140 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424003 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424140 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424035 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424140 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424059 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424140 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424102 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424140 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424133 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-web-config\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424173 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424202 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424247 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424286 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-config\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424309 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424339 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424369 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424394 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424469 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424438 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.424901 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.424874 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.425060 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.425019 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.427175 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.426586 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.427175 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.426879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.428275 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.428246 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.428906 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.428858 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.428906 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.428890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.429479 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.429454 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.429578 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.429549 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-web-config\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.429690 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.429665 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-config\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.430219 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.430201 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.430292 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.430265 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.430638 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.430612 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.430888 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.430829 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.430888 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.430854 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.430888 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.430858 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.431118 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.431075 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-config-out\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.432173 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.432149 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.432506 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.432486 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.440204 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.440168 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qkkg\" (UniqueName: \"kubernetes.io/projected/70b40f01-4f79-4dc8-9e93-5db6ccf7c196-kube-api-access-6qkkg\") pod \"prometheus-k8s-0\" (UID: \"70b40f01-4f79-4dc8-9e93-5db6ccf7c196\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.529091 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.529006 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:04.538908 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.538839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" event={"ID":"36436f9b-993b-4c84-8a7d-4cb4d9df2b88","Type":"ContainerStarted","Data":"49f7ea3eb80fb37e95ff022e244b48b3896783861f712f7ad892cd7c60dd2803"} Jul 10 20:59:04.541569 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.541544 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"8914570966c220118df0cae9b8772d42492ed17bf3bd98485a448c773bba95f1"} Jul 10 20:59:04.541640 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.541620 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"6f028d20229ff448e8c508c970771cf23e7651772ee28b576e9731b3a5423047"} Jul 10 20:59:04.541696 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.541664 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"c83f6329ea02f6c8d465917b996da58e7f2eb9d208bdac0d84360cba619443e2"} Jul 10 20:59:04.706634 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:04.706608 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 20:59:04.932603 ip-10-0-137-232 kubenswrapper[2585]: W0710 20:59:04.932572 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b40f01_4f79_4dc8_9e93_5db6ccf7c196.slice/crio-61d4bfe1a61a51f019a551d425e954faeb90afcba3519f25afc65daec9cdebc3 WatchSource:0}: Error finding container 61d4bfe1a61a51f019a551d425e954faeb90afcba3519f25afc65daec9cdebc3: Status 404 returned error can't find the container with id 61d4bfe1a61a51f019a551d425e954faeb90afcba3519f25afc65daec9cdebc3 Jul 10 20:59:05.548792 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.548712 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"203c07221cd64039612f5dc9164b6748633538c7be705e050d8de6f18bf3a2ec"} Jul 10 20:59:05.549207 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.548797 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"b206ea96e08c79a2367ef712b8356ff6256ab27150f036b5f2d037f0db2d9c4e"} Jul 10 20:59:05.549207 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.548839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" event={"ID":"c8862f6f-0854-4d04-960b-60926b732d5a","Type":"ContainerStarted","Data":"41dca37d62082927dc561cc8b739ae779dd9a40101fbcc0ab9601530cda1bd34"} Jul 10 20:59:05.549207 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.548980 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:05.550355 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.550324 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" event={"ID":"2dec3450-2406-4515-8e8b-7c6291a57003","Type":"ContainerStarted","Data":"20a8da60b0d8565fe4ab1af3027ad2bfd5c51d66b408b702f03c3439af865c94"} Jul 10 20:59:05.552033 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.551982 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" event={"ID":"36436f9b-993b-4c84-8a7d-4cb4d9df2b88","Type":"ContainerStarted","Data":"0ba76de66110e076f2099cc36787146532aa2148a1e1287d038af1b9e0fffa43"} Jul 10 20:59:05.552169 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.552157 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:05.553786 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.553764 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"61d4bfe1a61a51f019a551d425e954faeb90afcba3519f25afc65daec9cdebc3"} Jul 10 20:59:05.557795 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.557774 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" Jul 10 20:59:05.579857 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.579812 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" podStartSLOduration=2.02944388 podStartE2EDuration="5.579796669s" totalImagesPullingTime="3.550352789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:59:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:59:05.578883353 +0000 UTC m=+89.015852605" watchObservedRunningTime="2026-07-10 20:59:05.579796669 +0000 UTC m=+89.016765898" Jul 10 20:59:05.603941 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.603867 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4zkcg" podStartSLOduration=2.095179506 podStartE2EDuration="3.603845997s" totalImagesPullingTime="1.508666491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:59:05.602384278 +0000 UTC m=+89.039353509" watchObservedRunningTime="2026-07-10 20:59:05.603845997 +0000 UTC m=+89.040815229" Jul 10 20:59:05.630780 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:05.630720 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" podStartSLOduration=1.50627888 podStartE2EDuration="3.63069751s" totalImagesPullingTime="2.12441863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:59:05.628986249 +0000 UTC m=+89.065955480" watchObservedRunningTime="2026-07-10 20:59:05.63069751 +0000 UTC m=+89.067666741" Jul 10 20:59:06.558815 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:06.558784 2585 generic.go:356] "Generic (PLEG): container finished" podID="70b40f01-4f79-4dc8-9e93-5db6ccf7c196" containerID="89d30a7958a967e91b1bd4586bf0a4a3cd59fe3890c8397f5bd7afc085604eae" exitCode=0 Jul 10 20:59:06.559258 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:06.558911 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerDied","Data":"89d30a7958a967e91b1bd4586bf0a4a3cd59fe3890c8397f5bd7afc085604eae"} Jul 10 20:59:09.469053 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:09.469024 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59494475f9-2r8gs" Jul 10 20:59:10.023615 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.023553 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" podUID="72757d76-20e8-4868-a42c-97a6f5de04fb" containerName="registry" containerID="cri-o://b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601" gracePeriod=30 Jul 10 20:59:10.271192 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.271169 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:59:10.377868 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377630 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fslmh\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-kube-api-access-fslmh\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.377868 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377689 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72757d76-20e8-4868-a42c-97a6f5de04fb-ca-trust-extracted\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.377868 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377783 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-image-registry-private-configuration\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.377868 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377822 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-trusted-ca\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.378167 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377880 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-installation-pull-secrets\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.378167 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377935 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-bound-sa-token\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.378167 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.377990 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.378167 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.378022 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-certificates\") pod \"72757d76-20e8-4868-a42c-97a6f5de04fb\" (UID: \"72757d76-20e8-4868-a42c-97a6f5de04fb\") " Jul 10 20:59:10.379182 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.378468 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:59:10.379182 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.378954 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:59:10.380978 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.380752 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-kube-api-access-fslmh" (OuterVolumeSpecName: "kube-api-access-fslmh") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "kube-api-access-fslmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:59:10.381095 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.381007 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:59:10.381787 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.381738 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:59:10.382267 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.382227 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:59:10.384331 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.384299 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:59:10.390302 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.390257 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72757d76-20e8-4868-a42c-97a6f5de04fb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "72757d76-20e8-4868-a42c-97a6f5de04fb" (UID: "72757d76-20e8-4868-a42c-97a6f5de04fb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:59:10.479813 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479779 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-certificates\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479820 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fslmh\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-kube-api-access-fslmh\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479835 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72757d76-20e8-4868-a42c-97a6f5de04fb-ca-trust-extracted\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479852 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-image-registry-private-configuration\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479894 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72757d76-20e8-4868-a42c-97a6f5de04fb-trusted-ca\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479910 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72757d76-20e8-4868-a42c-97a6f5de04fb-installation-pull-secrets\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479925 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-bound-sa-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.480087 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.479939 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72757d76-20e8-4868-a42c-97a6f5de04fb-registry-tls\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 20:59:10.583059 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.583018 2585 generic.go:356] "Generic (PLEG): container finished" podID="72757d76-20e8-4868-a42c-97a6f5de04fb" containerID="b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601" exitCode=0 Jul 10 20:59:10.583059 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.583064 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" Jul 10 20:59:10.583247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.583110 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" event={"ID":"72757d76-20e8-4868-a42c-97a6f5de04fb","Type":"ContainerDied","Data":"b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601"} Jul 10 20:59:10.583247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.583204 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d699b98d-bsw2d" event={"ID":"72757d76-20e8-4868-a42c-97a6f5de04fb","Type":"ContainerDied","Data":"38cc8b3d72e2c2e5508b31e7804c984528daeec6450c4b27e9ebe84aba80cf79"} Jul 10 20:59:10.583247 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.583235 2585 scope.go:117] "RemoveContainer" containerID="b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601" Jul 10 20:59:10.587179 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.587143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"5a36d7d699896f338a8a0f1c266a4bcb2ccdfba07b688416b7902d3c6da9c656"} Jul 10 20:59:10.587300 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.587218 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"a536d3eef3f5910d920b283e040ac1d37f88f6babd86516e91485eb73485dc78"} Jul 10 20:59:10.587300 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.587277 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"b820ae56b900ac919e1068bc0b8d5259f753fd2a57cc1b01d2f66ab87fb141f8"} Jul 10 20:59:10.587441 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.587322 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"03bb9511748e034ad085109251d32eeea97d885c5f399808c1a90d0420c0f822"} Jul 10 20:59:10.587441 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.587362 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"5e6f409bfea7ac6b5f8341bb67a54cc3ba41813df63a5937f69ae03652684d97"} Jul 10 20:59:10.587441 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.587404 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70b40f01-4f79-4dc8-9e93-5db6ccf7c196","Type":"ContainerStarted","Data":"304ee092560884d4d3f0ec46de76d5f3883357a9472ecbf541d45a0c55057a00"} Jul 10 20:59:10.592562 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.592544 2585 scope.go:117] "RemoveContainer" containerID="b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601" Jul 10 20:59:10.592838 ip-10-0-137-232 kubenswrapper[2585]: E0710 20:59:10.592816 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601\": container with ID starting with b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601 not found: ID does not exist" containerID="b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601" Jul 10 20:59:10.592923 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.592845 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601"} err="failed to get container status \"b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601\": rpc error: code = NotFound desc = could not find container \"b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601\": container with ID starting with b621fd62d3874c58598de8b22bf51b409ab68c96047716c5db82b64f90436601 not found: ID does not exist" Jul 10 20:59:10.639624 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.639538 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.147701141 podStartE2EDuration="6.639518491s" totalImagesPullingTime="4.47349021s" totalInitContainerRuntime="18.32714ms" isStatefulPod=false podCreationTimestamp="2026-07-10 20:59:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:59:10.639353323 +0000 UTC m=+94.076322555" watchObservedRunningTime="2026-07-10 20:59:10.639518491 +0000 UTC m=+94.076487723" Jul 10 20:59:10.667702 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.667663 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d699b98d-bsw2d"] Jul 10 20:59:10.675302 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:10.675277 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64d699b98d-bsw2d"] Jul 10 20:59:11.127757 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:11.127726 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72757d76-20e8-4868-a42c-97a6f5de04fb" path="/var/lib/kubelet/pods/72757d76-20e8-4868-a42c-97a6f5de04fb/volumes" Jul 10 20:59:11.565112 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:11.565079 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75c8f96d58-68cs9" Jul 10 20:59:14.529924 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:14.529890 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 20:59:19.466598 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:19.466557 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pfqh2" Jul 10 20:59:22.644231 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:22.644197 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:22.644748 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:22.644262 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:33.676701 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:33.676609 2585 generic.go:356] "Generic (PLEG): container finished" podID="833fe8f0-3548-43fc-bf69-13d264c4bfbf" containerID="34e27eb8872009ef4e9043550ff48a5fde5b54a92959e2382496c7a98c12be47" exitCode=0 Jul 10 20:59:33.677139 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:33.676688 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" event={"ID":"833fe8f0-3548-43fc-bf69-13d264c4bfbf","Type":"ContainerDied","Data":"34e27eb8872009ef4e9043550ff48a5fde5b54a92959e2382496c7a98c12be47"} Jul 10 20:59:33.677139 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:33.677119 2585 scope.go:117] "RemoveContainer" containerID="34e27eb8872009ef4e9043550ff48a5fde5b54a92959e2382496c7a98c12be47" Jul 10 20:59:34.682616 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:34.682580 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jx4sj" event={"ID":"833fe8f0-3548-43fc-bf69-13d264c4bfbf","Type":"ContainerStarted","Data":"685819efc3b5729e22041b07962550dc25b8ee798d00fa87bc4f2468a9a01b06"} Jul 10 20:59:42.649128 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:42.649098 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:42.652806 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:42.652784 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-598cf84648-t4mn2" Jul 10 20:59:44.721596 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:44.721559 2585 generic.go:356] "Generic (PLEG): container finished" podID="3a29b994-1466-4b6a-ab7a-b62990316c79" containerID="4c22f80fc129df3119dc6e74ca42bb1187af91a0b020b5ac9e210a3da1eeff42" exitCode=0 Jul 10 20:59:44.721950 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:44.721634 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" event={"ID":"3a29b994-1466-4b6a-ab7a-b62990316c79","Type":"ContainerDied","Data":"4c22f80fc129df3119dc6e74ca42bb1187af91a0b020b5ac9e210a3da1eeff42"} Jul 10 20:59:44.722024 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:44.722009 2585 scope.go:117] "RemoveContainer" containerID="4c22f80fc129df3119dc6e74ca42bb1187af91a0b020b5ac9e210a3da1eeff42" Jul 10 20:59:45.321430 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:45.321396 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8dbbdd55b-fhkls_01446074-b907-45b7-a35e-4320ff9d1f4d/router/0.log" Jul 10 20:59:45.345474 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:45.345442 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j9drs_c43b12f4-650a-4b57-91d4-ba437b4588bf/serve-healthcheck-canary/0.log" Jul 10 20:59:45.727701 ip-10-0-137-232 kubenswrapper[2585]: I0710 20:59:45.727669 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2v9tq" event={"ID":"3a29b994-1466-4b6a-ab7a-b62990316c79","Type":"ContainerStarted","Data":"14fb600ca5767bed6ffda0020ad3effc7092a511d83c31fe57e530f5c545e67a"} Jul 10 21:00:04.529888 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:00:04.529855 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:00:04.545501 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:00:04.545467 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:00:04.818962 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:00:04.818879 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:02:33.981591 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.981558 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs"] Jul 10 21:02:33.982018 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.981866 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72757d76-20e8-4868-a42c-97a6f5de04fb" containerName="registry" Jul 10 21:02:33.982018 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.981877 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="72757d76-20e8-4868-a42c-97a6f5de04fb" containerName="registry" Jul 10 21:02:33.982018 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.981934 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="72757d76-20e8-4868-a42c-97a6f5de04fb" containerName="registry" Jul 10 21:02:33.984742 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.984727 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:33.987449 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.987397 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 21:02:33.987617 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.987448 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 21:02:33.987724 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.987699 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 21:02:33.987790 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.987748 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 21:02:33.987964 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:33.987949 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-574bc\"" Jul 10 21:02:34.008067 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.008041 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs"] Jul 10 21:02:34.023545 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.023520 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29ceae5e-b131-4f1d-a27d-691bf9196830-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.023655 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.023549 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9zmv\" (UniqueName: \"kubernetes.io/projected/29ceae5e-b131-4f1d-a27d-691bf9196830-kube-api-access-v9zmv\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.023655 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.023575 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29ceae5e-b131-4f1d-a27d-691bf9196830-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.023727 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.023686 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29ceae5e-b131-4f1d-a27d-691bf9196830-manifests\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.023727 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.023720 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29ceae5e-b131-4f1d-a27d-691bf9196830-tmp\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.124291 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.124257 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29ceae5e-b131-4f1d-a27d-691bf9196830-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.124291 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.124293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9zmv\" (UniqueName: \"kubernetes.io/projected/29ceae5e-b131-4f1d-a27d-691bf9196830-kube-api-access-v9zmv\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.124536 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.124315 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29ceae5e-b131-4f1d-a27d-691bf9196830-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.124536 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.124368 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29ceae5e-b131-4f1d-a27d-691bf9196830-manifests\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.124536 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.124396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29ceae5e-b131-4f1d-a27d-691bf9196830-tmp\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.124906 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.124883 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29ceae5e-b131-4f1d-a27d-691bf9196830-manifests\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.126656 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.126639 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29ceae5e-b131-4f1d-a27d-691bf9196830-tmp\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.126898 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.126878 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29ceae5e-b131-4f1d-a27d-691bf9196830-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.126934 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.126914 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29ceae5e-b131-4f1d-a27d-691bf9196830-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.132252 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.132226 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9zmv\" (UniqueName: \"kubernetes.io/projected/29ceae5e-b131-4f1d-a27d-691bf9196830-kube-api-access-v9zmv\") pod \"opendatahub-operator-controller-manager-58b8cc5f97-7t6fs\" (UID: \"29ceae5e-b131-4f1d-a27d-691bf9196830\") " pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.294682 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.294605 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:34.431027 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:34.431002 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs"] Jul 10 21:02:34.433749 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:02:34.433716 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ceae5e_b131_4f1d_a27d_691bf9196830.slice/crio-d6a57ce5c47b311259a83da9eefabe392baafa5e1c349a8475eb6efcc2924f86 WatchSource:0}: Error finding container d6a57ce5c47b311259a83da9eefabe392baafa5e1c349a8475eb6efcc2924f86: Status 404 returned error can't find the container with id d6a57ce5c47b311259a83da9eefabe392baafa5e1c349a8475eb6efcc2924f86 Jul 10 21:02:35.376739 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:35.376701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" event={"ID":"29ceae5e-b131-4f1d-a27d-691bf9196830","Type":"ContainerStarted","Data":"d6a57ce5c47b311259a83da9eefabe392baafa5e1c349a8475eb6efcc2924f86"} Jul 10 21:02:37.462289 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:37.462259 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:02:37.464552 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:37.462259 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:02:37.468488 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:37.468468 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 21:02:38.391377 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:38.391344 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" event={"ID":"29ceae5e-b131-4f1d-a27d-691bf9196830","Type":"ContainerStarted","Data":"82305dd82fe742c4002b377b984cdb238d0259b6d38a33e6ea468cd38c7cba03"} Jul 10 21:02:39.397043 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:39.397009 2585 generic.go:356] "Generic (PLEG): container finished" podID="29ceae5e-b131-4f1d-a27d-691bf9196830" containerID="82305dd82fe742c4002b377b984cdb238d0259b6d38a33e6ea468cd38c7cba03" exitCode=0 Jul 10 21:02:39.397432 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:39.397096 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" event={"ID":"29ceae5e-b131-4f1d-a27d-691bf9196830","Type":"ContainerDied","Data":"82305dd82fe742c4002b377b984cdb238d0259b6d38a33e6ea468cd38c7cba03"} Jul 10 21:02:39.397562 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:39.397547 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 21:02:40.403166 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:40.403127 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" event={"ID":"29ceae5e-b131-4f1d-a27d-691bf9196830","Type":"ContainerStarted","Data":"1ffb741db9f860416c954388ee7f6dd125decd1631ae62489297b08ce8ef5d62"} Jul 10 21:02:40.403641 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:40.403203 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:40.425396 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:40.425350 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" podStartSLOduration=2.986866366 podStartE2EDuration="7.425335397s" totalImagesPullingTime="3.364605097s" totalInitContainerRuntime="1.073863934s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:02:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:02:40.424254322 +0000 UTC m=+303.861223552" watchObservedRunningTime="2026-07-10 21:02:40.425335397 +0000 UTC m=+303.862304627" Jul 10 21:02:51.410271 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:51.410239 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58b8cc5f97-7t6fs" Jul 10 21:02:53.321980 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.321946 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-588cc756f9-jftql"] Jul 10 21:02:53.332015 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.331993 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.335066 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.335042 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 21:02:53.336080 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.336065 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 21:02:53.336150 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.336095 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 21:02:53.336207 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.336160 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 21:02:53.336338 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.336317 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 21:02:53.336404 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.336391 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w94qq\"" Jul 10 21:02:53.340605 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.340584 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588cc756f9-jftql"] Jul 10 21:02:53.495304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.495266 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98260cad-fdde-445e-9b19-eb8df3ce14c1-manager-config\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.495304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.495302 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh28h\" (UniqueName: \"kubernetes.io/projected/98260cad-fdde-445e-9b19-eb8df3ce14c1-kube-api-access-fh28h\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.495599 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.495332 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98260cad-fdde-445e-9b19-eb8df3ce14c1-cert\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.495599 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.495456 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98260cad-fdde-445e-9b19-eb8df3ce14c1-metrics-cert\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.596630 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.596594 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98260cad-fdde-445e-9b19-eb8df3ce14c1-manager-config\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.596813 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.596637 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh28h\" (UniqueName: \"kubernetes.io/projected/98260cad-fdde-445e-9b19-eb8df3ce14c1-kube-api-access-fh28h\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.596813 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.596675 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98260cad-fdde-445e-9b19-eb8df3ce14c1-cert\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.596813 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.596704 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98260cad-fdde-445e-9b19-eb8df3ce14c1-metrics-cert\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.597313 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.597290 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98260cad-fdde-445e-9b19-eb8df3ce14c1-manager-config\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.599067 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.599044 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98260cad-fdde-445e-9b19-eb8df3ce14c1-metrics-cert\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.599187 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.599158 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98260cad-fdde-445e-9b19-eb8df3ce14c1-cert\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.609980 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.609959 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh28h\" (UniqueName: \"kubernetes.io/projected/98260cad-fdde-445e-9b19-eb8df3ce14c1-kube-api-access-fh28h\") pod \"lws-controller-manager-588cc756f9-jftql\" (UID: \"98260cad-fdde-445e-9b19-eb8df3ce14c1\") " pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.642012 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.641987 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:53.799767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:53.799740 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588cc756f9-jftql"] Jul 10 21:02:53.801679 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:02:53.801638 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98260cad_fdde_445e_9b19_eb8df3ce14c1.slice/crio-691b28f8fb0eb0e6d626fff1209d5b98dcb92dc4f000b3743030f061e53bf33a WatchSource:0}: Error finding container 691b28f8fb0eb0e6d626fff1209d5b98dcb92dc4f000b3743030f061e53bf33a: Status 404 returned error can't find the container with id 691b28f8fb0eb0e6d626fff1209d5b98dcb92dc4f000b3743030f061e53bf33a Jul 10 21:02:54.459449 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:54.459396 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" event={"ID":"98260cad-fdde-445e-9b19-eb8df3ce14c1","Type":"ContainerStarted","Data":"691b28f8fb0eb0e6d626fff1209d5b98dcb92dc4f000b3743030f061e53bf33a"} Jul 10 21:02:56.471153 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:56.471118 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" event={"ID":"98260cad-fdde-445e-9b19-eb8df3ce14c1","Type":"ContainerStarted","Data":"01e85f30db4b4ae8ae4f03c055df90a8bea7407f76ffcad8a99dbfaa5adf2df4"} Jul 10 21:02:56.471592 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:56.471240 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:02:56.488997 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:02:56.488948 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" podStartSLOduration=0.974022158 podStartE2EDuration="3.48893316s" totalImagesPullingTime="2.514911002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:02:56.487893562 +0000 UTC m=+319.924862794" watchObservedRunningTime="2026-07-10 21:02:56.48893316 +0000 UTC m=+319.925902391" Jul 10 21:03:02.199684 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.199639 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk"] Jul 10 21:03:02.202968 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.202950 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.207596 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.207574 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 21:03:02.207730 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.207600 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d56kl\"" Jul 10 21:03:02.218906 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.218874 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk"] Jul 10 21:03:02.374333 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374295 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374538 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374344 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374538 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374374 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374538 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374457 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a672e29-92b2-4730-8e62-720e630d6223-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374538 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374492 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r888b\" (UniqueName: \"kubernetes.io/projected/0a672e29-92b2-4730-8e62-720e630d6223-kube-api-access-r888b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374538 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374533 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374797 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374560 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374797 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374684 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a672e29-92b2-4730-8e62-720e630d6223-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.374797 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.374737 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a672e29-92b2-4730-8e62-720e630d6223-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476186 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476088 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a672e29-92b2-4730-8e62-720e630d6223-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476186 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476136 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a672e29-92b2-4730-8e62-720e630d6223-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476186 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476160 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476271 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476316 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a672e29-92b2-4730-8e62-720e630d6223-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r888b\" (UniqueName: \"kubernetes.io/projected/0a672e29-92b2-4730-8e62-720e630d6223-kube-api-access-r888b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476451 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476497 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476803 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476723 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.476883 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.477041 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.477017 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.477200 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.476912 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.477384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.477365 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a672e29-92b2-4730-8e62-720e630d6223-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.479559 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.479534 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a672e29-92b2-4730-8e62-720e630d6223-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.479777 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.479758 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a672e29-92b2-4730-8e62-720e630d6223-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.487055 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.487030 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a672e29-92b2-4730-8e62-720e630d6223-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.487254 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.487229 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r888b\" (UniqueName: \"kubernetes.io/projected/0a672e29-92b2-4730-8e62-720e630d6223-kube-api-access-r888b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ph2rk\" (UID: \"0a672e29-92b2-4730-8e62-720e630d6223\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.513176 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.513129 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:02.664111 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.664073 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk"] Jul 10 21:03:02.667283 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:03:02.667257 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a672e29_92b2_4730_8e62_720e630d6223.slice/crio-08a1054855fc265f271e0beb37efc755a7569cc7df8af9cdb87548e0752b8428 WatchSource:0}: Error finding container 08a1054855fc265f271e0beb37efc755a7569cc7df8af9cdb87548e0752b8428: Status 404 returned error can't find the container with id 08a1054855fc265f271e0beb37efc755a7569cc7df8af9cdb87548e0752b8428 Jul 10 21:03:02.707049 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.707016 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5"] Jul 10 21:03:02.711466 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.711446 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.716865 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.716842 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 21:03:02.717057 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.717031 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 21:03:02.717307 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.717291 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fp5ct\"" Jul 10 21:03:02.718265 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.718249 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 21:03:02.724823 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.724802 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5"] Jul 10 21:03:02.879851 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.879813 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.879851 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.879853 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa37d2ce-08c1-48ed-8534-f5584cab04c9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.880070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.879878 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvltj\" (UniqueName: \"kubernetes.io/projected/aa37d2ce-08c1-48ed-8534-f5584cab04c9-kube-api-access-pvltj\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.880070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.879968 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.880070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.880002 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.880070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.880023 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.880070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.880056 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981281 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981238 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981281 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981575 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981575 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981311 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981575 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981384 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981575 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa37d2ce-08c1-48ed-8534-f5584cab04c9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.981575 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.981476 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvltj\" (UniqueName: \"kubernetes.io/projected/aa37d2ce-08c1-48ed-8534-f5584cab04c9-kube-api-access-pvltj\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.982208 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.982170 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.983859 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.983828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.983859 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.983849 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa37d2ce-08c1-48ed-8534-f5584cab04c9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.983991 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.983863 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.983991 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.983900 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.989458 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.989435 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa37d2ce-08c1-48ed-8534-f5584cab04c9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:02.989647 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:02.989630 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvltj\" (UniqueName: \"kubernetes.io/projected/aa37d2ce-08c1-48ed-8534-f5584cab04c9-kube-api-access-pvltj\") pod \"istiod-openshift-gateway-94bb8fbfd-pwqs5\" (UID: \"aa37d2ce-08c1-48ed-8534-f5584cab04c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:03.021565 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:03.021532 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:03.184185 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:03.184157 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5"] Jul 10 21:03:03.186724 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:03:03.186695 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa37d2ce_08c1_48ed_8534_f5584cab04c9.slice/crio-6950b56395a76307738ff6a7753c597e330f0bd7389f3052bceecadc45046b44 WatchSource:0}: Error finding container 6950b56395a76307738ff6a7753c597e330f0bd7389f3052bceecadc45046b44: Status 404 returned error can't find the container with id 6950b56395a76307738ff6a7753c597e330f0bd7389f3052bceecadc45046b44 Jul 10 21:03:03.501613 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:03.501527 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" event={"ID":"0a672e29-92b2-4730-8e62-720e630d6223","Type":"ContainerStarted","Data":"08a1054855fc265f271e0beb37efc755a7569cc7df8af9cdb87548e0752b8428"} Jul 10 21:03:03.502666 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:03.502639 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" event={"ID":"aa37d2ce-08c1-48ed-8534-f5584cab04c9","Type":"ContainerStarted","Data":"6950b56395a76307738ff6a7753c597e330f0bd7389f3052bceecadc45046b44"} Jul 10 21:03:07.294376 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.294328 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:03:07.294686 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.294452 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:03:07.298634 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.298604 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:03:07.298738 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.298686 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:03:07.298738 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.298729 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:03:07.478652 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.478621 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-588cc756f9-jftql" Jul 10 21:03:07.527880 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.527840 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" event={"ID":"0a672e29-92b2-4730-8e62-720e630d6223","Type":"ContainerStarted","Data":"5086933253fba32e2565c35ed6339c0d5700173462313c338acd07da63cd862f"} Jul 10 21:03:07.532068 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.529934 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" event={"ID":"aa37d2ce-08c1-48ed-8534-f5584cab04c9","Type":"ContainerStarted","Data":"785e9e9a8d124debbe25274ce3172efd1a6c478240fc9af06c95c0aefa8e2cf3"} Jul 10 21:03:07.532068 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.530475 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:03:07.630103 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.630047 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" podStartSLOduration=1.524762066 podStartE2EDuration="5.630031136s" totalImagesPullingTime="4.10526907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:03:07.627662542 +0000 UTC m=+331.064631792" watchObservedRunningTime="2026-07-10 21:03:07.630031136 +0000 UTC m=+331.067000365" Jul 10 21:03:07.631320 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:07.631287 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" podStartSLOduration=1.002055435 podStartE2EDuration="5.631270677s" totalImagesPullingTime="4.629215242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:03:07.580732147 +0000 UTC m=+331.017701397" watchObservedRunningTime="2026-07-10 21:03:07.631270677 +0000 UTC m=+331.068239906" Jul 10 21:03:08.514376 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:08.514334 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:08.518852 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:08.518825 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:08.534499 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:08.534468 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:08.535246 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:08.535225 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ph2rk" Jul 10 21:03:08.536165 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:03:08.536144 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pwqs5" Jul 10 21:05:27.318523 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.318486 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb"] Jul 10 21:05:27.322135 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.322111 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.325519 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.325501 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6xfwh\"" Jul 10 21:05:27.339581 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.339549 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb"] Jul 10 21:05:27.358674 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358645 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358775 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358674 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358775 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358736 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358775 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358765 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358890 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358783 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358890 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358872 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358967 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358917 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.358967 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358936 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.359059 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.358963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb8m4\" (UniqueName: \"kubernetes.io/projected/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-kube-api-access-pb8m4\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460135 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460101 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460293 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460147 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460293 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460162 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460293 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460293 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460244 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460502 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460358 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460502 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460399 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb8m4\" (UniqueName: \"kubernetes.io/projected/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-kube-api-access-pb8m4\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460597 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460547 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460597 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460576 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460701 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460658 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460701 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460687 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.460809 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460661 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.461006 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.460986 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.461168 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.461147 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.462596 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.462578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.462770 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.462747 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.468926 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.468905 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.469008 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.468906 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb8m4\" (UniqueName: \"kubernetes.io/projected/b009b84c-bbbc-4f66-a6ed-615ccc6043b7-kube-api-access-pb8m4\") pod \"maas-default-gateway-openshift-default-56654dcf7-6z4sb\" (UID: \"b009b84c-bbbc-4f66-a6ed-615ccc6043b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.632629 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.632596 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:27.777438 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.777396 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb"] Jul 10 21:05:27.779254 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:05:27.779224 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb009b84c_bbbc_4f66_a6ed_615ccc6043b7.slice/crio-aa7041ec8c09b7664aceef842c733c8180fbef854496df8009f73abcdc517f55 WatchSource:0}: Error finding container aa7041ec8c09b7664aceef842c733c8180fbef854496df8009f73abcdc517f55: Status 404 returned error can't find the container with id aa7041ec8c09b7664aceef842c733c8180fbef854496df8009f73abcdc517f55 Jul 10 21:05:27.781353 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.781312 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:05:27.781437 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.781399 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:05:27.781474 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:27.781459 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:05:28.148468 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:28.148406 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" event={"ID":"b009b84c-bbbc-4f66-a6ed-615ccc6043b7","Type":"ContainerStarted","Data":"c4db96ca45995bb07687196e0c433d35b4f3eb43e27a0efa2f4193f3fc31146d"} Jul 10 21:05:28.148628 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:28.148482 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" event={"ID":"b009b84c-bbbc-4f66-a6ed-615ccc6043b7","Type":"ContainerStarted","Data":"aa7041ec8c09b7664aceef842c733c8180fbef854496df8009f73abcdc517f55"} Jul 10 21:05:28.171495 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:28.171446 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" podStartSLOduration=1.171408125 podStartE2EDuration="1.171408125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:05:28.169937105 +0000 UTC m=+471.606906360" watchObservedRunningTime="2026-07-10 21:05:28.171408125 +0000 UTC m=+471.608377355" Jul 10 21:05:28.632954 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:28.632923 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:28.637714 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:28.637690 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:29.152217 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:29.152189 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:05:29.153304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:05:29.153285 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:07:04.571006 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:04.570965 2585 generic.go:356] "Generic (PLEG): container finished" podID="b009b84c-bbbc-4f66-a6ed-615ccc6043b7" containerID="c4db96ca45995bb07687196e0c433d35b4f3eb43e27a0efa2f4193f3fc31146d" exitCode=0 Jul 10 21:07:04.571445 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:04.571039 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" event={"ID":"b009b84c-bbbc-4f66-a6ed-615ccc6043b7","Type":"ContainerDied","Data":"c4db96ca45995bb07687196e0c433d35b4f3eb43e27a0efa2f4193f3fc31146d"} Jul 10 21:07:04.571445 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:04.571395 2585 scope.go:117] "RemoveContainer" containerID="c4db96ca45995bb07687196e0c433d35b4f3eb43e27a0efa2f4193f3fc31146d" Jul 10 21:07:04.572329 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:04.572303 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:07:04.572444 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:04.572367 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:07:04.572444 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:04.572399 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:07:05.577768 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:05.577734 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" event={"ID":"b009b84c-bbbc-4f66-a6ed-615ccc6043b7","Type":"ContainerStarted","Data":"de87b28f887579b93010c02494732adad62f7230bcc24ce14601d601d482abb5"} Jul 10 21:07:05.633627 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:05.632859 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:07:05.633627 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:05.633313 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6z4sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 10 21:07:05.633627 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:05.633360 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" podUID="b009b84c-bbbc-4f66-a6ed-615ccc6043b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 10 21:07:06.634119 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:06.634073 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6z4sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 10 21:07:06.634647 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:06.634161 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" podUID="b009b84c-bbbc-4f66-a6ed-615ccc6043b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 10 21:07:07.633229 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:07.633188 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6z4sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 10 21:07:07.633557 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:07.633524 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" podUID="b009b84c-bbbc-4f66-a6ed-615ccc6043b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 10 21:07:08.633369 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:08.633328 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6z4sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 10 21:07:08.633892 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:08.633455 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" podUID="b009b84c-bbbc-4f66-a6ed-615ccc6043b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 10 21:07:09.637708 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:09.637679 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:07:09.638170 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:09.638066 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:07:09.638818 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:09.638797 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6z4sb" Jul 10 21:07:17.858555 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.858515 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt"] Jul 10 21:07:17.861298 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.861277 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:17.863910 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.863883 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 21:07:17.865142 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.865119 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-phvp8\"" Jul 10 21:07:17.865244 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.865209 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 21:07:17.865303 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.865288 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 21:07:17.873603 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.873580 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt"] Jul 10 21:07:17.974766 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.974733 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:17.974931 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.974778 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:17.974931 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.974873 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts56z\" (UniqueName: \"kubernetes.io/projected/639d5cbe-777c-4f05-b0db-bf8cab277ba6-kube-api-access-ts56z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:17.974931 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.974917 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/639d5cbe-777c-4f05-b0db-bf8cab277ba6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:17.975033 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.974996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:17.975033 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:17.975020 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076335 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076335 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076333 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076611 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076357 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076611 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076384 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076611 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076452 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts56z\" (UniqueName: \"kubernetes.io/projected/639d5cbe-777c-4f05-b0db-bf8cab277ba6-kube-api-access-ts56z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076611 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076496 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/639d5cbe-777c-4f05-b0db-bf8cab277ba6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076868 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076844 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076868 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.076950 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.076913 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.078647 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.078626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/639d5cbe-777c-4f05-b0db-bf8cab277ba6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.078809 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.078794 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/639d5cbe-777c-4f05-b0db-bf8cab277ba6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.084305 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.084283 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts56z\" (UniqueName: \"kubernetes.io/projected/639d5cbe-777c-4f05-b0db-bf8cab277ba6-kube-api-access-ts56z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt\" (UID: \"639d5cbe-777c-4f05-b0db-bf8cab277ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.171583 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.171485 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:18.305907 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.305885 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt"] Jul 10 21:07:18.308140 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:07:18.308110 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639d5cbe_777c_4f05_b0db_bf8cab277ba6.slice/crio-61522a3a6e026552ef030f8d86c2305d5cb7ea64fc52c9421917e6d99493a61f WatchSource:0}: Error finding container 61522a3a6e026552ef030f8d86c2305d5cb7ea64fc52c9421917e6d99493a61f: Status 404 returned error can't find the container with id 61522a3a6e026552ef030f8d86c2305d5cb7ea64fc52c9421917e6d99493a61f Jul 10 21:07:18.642357 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:18.642319 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" event={"ID":"639d5cbe-777c-4f05-b0db-bf8cab277ba6","Type":"ContainerStarted","Data":"61522a3a6e026552ef030f8d86c2305d5cb7ea64fc52c9421917e6d99493a61f"} Jul 10 21:07:19.648210 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:19.648173 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" event={"ID":"639d5cbe-777c-4f05-b0db-bf8cab277ba6","Type":"ContainerStarted","Data":"274c6872c2a30d737d4cea2b1029c61284088a041ca89f5de7a279a248fc015c"} Jul 10 21:07:19.666823 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:19.666749 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" podStartSLOduration=1.466963286 podStartE2EDuration="2.666724568s" totalImagesPullingTime="1.199761282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:07:19.665497846 +0000 UTC m=+583.102467102" watchObservedRunningTime="2026-07-10 21:07:19.666724568 +0000 UTC m=+583.103693798" Jul 10 21:07:28.172113 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:28.172082 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:28.172518 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:28.172136 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:28.184442 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:28.184399 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:28.703285 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:28.703251 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt" Jul 10 21:07:37.490640 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:37.490612 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:07:37.491205 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:37.490713 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:07:38.771302 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.771270 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t"] Jul 10 21:07:38.773764 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.773744 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.776428 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.776394 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 21:07:38.784372 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.784346 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t"] Jul 10 21:07:38.863610 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.863581 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.863610 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.863614 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.863795 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.863643 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063e899d-3dab-44ff-86b7-37787005d099-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.863795 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.863729 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.863795 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.863757 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qgzm\" (UniqueName: \"kubernetes.io/projected/063e899d-3dab-44ff-86b7-37787005d099-kube-api-access-8qgzm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.863795 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.863793 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964456 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964406 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964596 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964468 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063e899d-3dab-44ff-86b7-37787005d099-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964596 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964596 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qgzm\" (UniqueName: \"kubernetes.io/projected/063e899d-3dab-44ff-86b7-37787005d099-kube-api-access-8qgzm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964596 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964569 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964810 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964641 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964872 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964814 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964926 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964884 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.964963 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.964941 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.966757 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.966738 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063e899d-3dab-44ff-86b7-37787005d099-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.967032 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.967011 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063e899d-3dab-44ff-86b7-37787005d099-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:38.972632 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:38.972615 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qgzm\" (UniqueName: \"kubernetes.io/projected/063e899d-3dab-44ff-86b7-37787005d099-kube-api-access-8qgzm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rq58t\" (UID: \"063e899d-3dab-44ff-86b7-37787005d099\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:39.083739 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:39.083712 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:39.212557 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:39.212531 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t"] Jul 10 21:07:39.214465 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:07:39.214435 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063e899d_3dab_44ff_86b7_37787005d099.slice/crio-aba86d20ed6e0dec6eb7417a10aabeb2585d86e6f5059558727a97cfefe506eb WatchSource:0}: Error finding container aba86d20ed6e0dec6eb7417a10aabeb2585d86e6f5059558727a97cfefe506eb: Status 404 returned error can't find the container with id aba86d20ed6e0dec6eb7417a10aabeb2585d86e6f5059558727a97cfefe506eb Jul 10 21:07:39.742528 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:39.742447 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" event={"ID":"063e899d-3dab-44ff-86b7-37787005d099","Type":"ContainerStarted","Data":"ad19bbc966ac922ffe506aa884e102c95efeaf1df22f8030ead7ce76437958bf"} Jul 10 21:07:39.742528 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:39.742498 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" event={"ID":"063e899d-3dab-44ff-86b7-37787005d099","Type":"ContainerStarted","Data":"aba86d20ed6e0dec6eb7417a10aabeb2585d86e6f5059558727a97cfefe506eb"} Jul 10 21:07:39.760642 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:39.760596 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" podStartSLOduration=1.536163677 podStartE2EDuration="1.760578346s" totalImagesPullingTime="224.414669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:07:39.75836249 +0000 UTC m=+603.195331721" watchObservedRunningTime="2026-07-10 21:07:39.760578346 +0000 UTC m=+603.197547576" Jul 10 21:07:49.084477 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:49.084443 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:49.084931 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:49.084507 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:49.096813 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:49.096791 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:07:49.800740 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:07:49.800706 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rq58t" Jul 10 21:12:37.519256 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:12:37.519222 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:12:37.519807 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:12:37.519745 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:15:00.167384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.167340 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx"] Jul 10 21:15:00.170670 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.170646 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" Jul 10 21:15:00.173915 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.173893 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xcjvq\"" Jul 10 21:15:00.180233 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.180218 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" Jul 10 21:15:00.189106 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.189083 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx"] Jul 10 21:15:00.321189 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.321164 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx"] Jul 10 21:15:00.322830 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:15:00.322798 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9136139_c7c3_4b0a_ad04_5327d0774208.slice/crio-854d5df5a170f9c39d3918780082d54cc6e1e5d21fd6cb7a0af07befbbf29c92 WatchSource:0}: Error finding container 854d5df5a170f9c39d3918780082d54cc6e1e5d21fd6cb7a0af07befbbf29c92: Status 404 returned error can't find the container with id 854d5df5a170f9c39d3918780082d54cc6e1e5d21fd6cb7a0af07befbbf29c92 Jul 10 21:15:00.324629 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.324611 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 21:15:00.736277 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:00.736241 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" event={"ID":"a9136139-c7c3-4b0a-ad04-5327d0774208","Type":"ContainerStarted","Data":"854d5df5a170f9c39d3918780082d54cc6e1e5d21fd6cb7a0af07befbbf29c92"} Jul 10 21:15:03.753530 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:03.753491 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" event={"ID":"a9136139-c7c3-4b0a-ad04-5327d0774208","Type":"ContainerStarted","Data":"b288cb93dec81b6a50cd8b9b643b832aeeaa1e80efc80af0b06700a55d5c48ab"} Jul 10 21:15:03.774137 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:15:03.774083 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" podStartSLOduration=1.594277803 podStartE2EDuration="3.77406443s" totalImagesPullingTime="2.179786627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:15:03.772395283 +0000 UTC m=+1047.209364532" watchObservedRunningTime="2026-07-10 21:15:03.77406443 +0000 UTC m=+1047.211033664" Jul 10 21:16:00.028677 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:00.028644 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx"] Jul 10 21:16:00.029223 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:00.028839 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" podUID="a9136139-c7c3-4b0a-ad04-5327d0774208" containerName="cleanup" containerID="cri-o://b288cb93dec81b6a50cd8b9b643b832aeeaa1e80efc80af0b06700a55d5c48ab" gracePeriod=30 Jul 10 21:16:30.143220 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:30.143187 2585 generic.go:356] "Generic (PLEG): container finished" podID="a9136139-c7c3-4b0a-ad04-5327d0774208" containerID="b288cb93dec81b6a50cd8b9b643b832aeeaa1e80efc80af0b06700a55d5c48ab" exitCode=137 Jul 10 21:16:30.143719 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:30.143227 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" event={"ID":"a9136139-c7c3-4b0a-ad04-5327d0774208","Type":"ContainerDied","Data":"b288cb93dec81b6a50cd8b9b643b832aeeaa1e80efc80af0b06700a55d5c48ab"} Jul 10 21:16:30.213659 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:30.213635 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" Jul 10 21:16:31.148727 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:31.148704 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" Jul 10 21:16:31.149088 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:31.148725 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx" event={"ID":"a9136139-c7c3-4b0a-ad04-5327d0774208","Type":"ContainerDied","Data":"854d5df5a170f9c39d3918780082d54cc6e1e5d21fd6cb7a0af07befbbf29c92"} Jul 10 21:16:31.149088 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:31.148779 2585 scope.go:117] "RemoveContainer" containerID="b288cb93dec81b6a50cd8b9b643b832aeeaa1e80efc80af0b06700a55d5c48ab" Jul 10 21:16:31.168579 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:31.168549 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx"] Jul 10 21:16:31.171844 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:31.171824 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728635-hq7gx"] Jul 10 21:16:33.127269 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:16:33.127228 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9136139-c7c3-4b0a-ad04-5327d0774208" path="/var/lib/kubelet/pods/a9136139-c7c3-4b0a-ad04-5327d0774208/volumes" Jul 10 21:17:37.547070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:17:37.547038 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:17:37.548947 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:17:37.548923 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:22:37.574198 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:22:37.574084 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:22:37.578032 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:22:37.576355 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:27:37.601307 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:27:37.601281 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:27:37.604608 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:27:37.604583 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:29:06.921710 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.921680 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl"] Jul 10 21:29:06.922161 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.922072 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9136139-c7c3-4b0a-ad04-5327d0774208" containerName="cleanup" Jul 10 21:29:06.922161 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.922085 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9136139-c7c3-4b0a-ad04-5327d0774208" containerName="cleanup" Jul 10 21:29:06.922161 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.922159 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9136139-c7c3-4b0a-ad04-5327d0774208" containerName="cleanup" Jul 10 21:29:06.925181 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.925162 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.930345 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.930314 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-637ce6f1-openshift-default-dockercfg-2bl2n\"" Jul 10 21:29:06.953328 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.953303 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl"] Jul 10 21:29:06.983817 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.983786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-socket\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.983952 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.983825 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-certs\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.983952 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.983844 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-token\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.983952 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.983895 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-credential-socket\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.984063 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.983963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istiod-ca-cert\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.984063 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.983994 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-envoy\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.984063 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.984022 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-data\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.984181 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.984084 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-podinfo\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:06.984181 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:06.984109 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qppcx\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-kube-api-access-qppcx\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085008 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.084971 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-socket\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085197 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-certs\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085197 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-token\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085197 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085155 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-credential-socket\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085197 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085195 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istiod-ca-cert\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085447 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-envoy\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085447 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-data\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085447 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085333 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-podinfo\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085447 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085364 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qppcx\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-kube-api-access-qppcx\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085447 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085370 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-socket\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085653 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085517 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-certs\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085653 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085544 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-credential-socket\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085752 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085666 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-data\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.085933 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.085909 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istiod-ca-cert\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.087643 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.087613 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-envoy\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.087823 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.087803 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-podinfo\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.094152 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.094129 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qppcx\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-kube-api-access-qppcx\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.094225 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.094161 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-token\") pod \"e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.236881 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.236803 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:07.370369 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.370339 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl"] Jul 10 21:29:07.372389 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:29:07.372363 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cdf01a_b880_463a_a13b_ef9ef712c4ce.slice/crio-a802730f88315301cd3ca1e087708c56706af1c3ed57f2c21c21d4590a84d85a WatchSource:0}: Error finding container a802730f88315301cd3ca1e087708c56706af1c3ed57f2c21c21d4590a84d85a: Status 404 returned error can't find the container with id a802730f88315301cd3ca1e087708c56706af1c3ed57f2c21c21d4590a84d85a Jul 10 21:29:07.374642 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.374609 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:07.374736 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.374677 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:07.374736 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.374706 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:07.599939 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.599903 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" event={"ID":"57cdf01a-b880-463a-a13b-ef9ef712c4ce","Type":"ContainerStarted","Data":"28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4"} Jul 10 21:29:07.600139 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.599969 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" event={"ID":"57cdf01a-b880-463a-a13b-ef9ef712c4ce","Type":"ContainerStarted","Data":"a802730f88315301cd3ca1e087708c56706af1c3ed57f2c21c21d4590a84d85a"} Jul 10 21:29:07.620256 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:07.620186 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" podStartSLOduration=1.62016522 podStartE2EDuration="1.62016522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:29:07.619711774 +0000 UTC m=+1891.056681030" watchObservedRunningTime="2026-07-10 21:29:07.62016522 +0000 UTC m=+1891.057134452" Jul 10 21:29:08.237993 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:08.237963 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:08.242772 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:08.242746 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:08.605222 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:08.605197 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:08.606224 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:08.606206 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:13.299054 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:13.299016 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl"] Jul 10 21:29:13.299490 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:13.299223 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" podUID="57cdf01a-b880-463a-a13b-ef9ef712c4ce" containerName="istio-proxy" containerID="cri-o://28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4" gracePeriod=30 Jul 10 21:29:18.540235 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.540210 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:18.594593 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594563 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-data\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594766 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594608 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-credential-socket\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594766 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594641 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-certs\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594766 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594681 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qppcx\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-kube-api-access-qppcx\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594766 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594752 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-socket\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594984 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594783 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-envoy\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594984 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594854 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:18.594984 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594870 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-token\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.594984 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594880 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:18.594984 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594903 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istiod-ca-cert\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.595215 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594988 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:18.595215 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.594996 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-podinfo\") pod \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\" (UID: \"57cdf01a-b880-463a-a13b-ef9ef712c4ce\") " Jul 10 21:29:18.595215 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595117 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:18.595339 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595234 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:29:18.595447 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595431 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-data\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.595485 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595453 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-credential-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.595485 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595469 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.595591 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595483 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-workload-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.595591 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.595495 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istiod-ca-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.597184 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.597161 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:29:18.597184 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.597164 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-kube-api-access-qppcx" (OuterVolumeSpecName: "kube-api-access-qppcx") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "kube-api-access-qppcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:18.597365 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.597350 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:18.597452 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.597410 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57cdf01a-b880-463a-a13b-ef9ef712c4ce" (UID: "57cdf01a-b880-463a-a13b-ef9ef712c4ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:18.651160 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.651121 2585 generic.go:356] "Generic (PLEG): container finished" podID="57cdf01a-b880-463a-a13b-ef9ef712c4ce" containerID="28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4" exitCode=0 Jul 10 21:29:18.651160 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.651164 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" Jul 10 21:29:18.651392 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.651203 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" event={"ID":"57cdf01a-b880-463a-a13b-ef9ef712c4ce","Type":"ContainerDied","Data":"28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4"} Jul 10 21:29:18.651392 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.651259 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl" event={"ID":"57cdf01a-b880-463a-a13b-ef9ef712c4ce","Type":"ContainerDied","Data":"a802730f88315301cd3ca1e087708c56706af1c3ed57f2c21c21d4590a84d85a"} Jul 10 21:29:18.651392 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.651281 2585 scope.go:117] "RemoveContainer" containerID="28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4" Jul 10 21:29:18.660132 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.660113 2585 scope.go:117] "RemoveContainer" containerID="28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4" Jul 10 21:29:18.660376 ip-10-0-137-232 kubenswrapper[2585]: E0710 21:29:18.660359 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4\": container with ID starting with 28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4 not found: ID does not exist" containerID="28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4" Jul 10 21:29:18.660470 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.660385 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4"} err="failed to get container status \"28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4\": rpc error: code = NotFound desc = could not find container \"28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4\": container with ID starting with 28913221a0751c1524060bcbacf698f3ee1f506b7ce64e8aae4e697f7f4addd4 not found: ID does not exist" Jul 10 21:29:18.671910 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.671886 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl"] Jul 10 21:29:18.677545 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.677524 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-637ce6f1-openshift-default-b45b48d65-bgcnl"] Jul 10 21:29:18.696329 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.696300 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qppcx\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-kube-api-access-qppcx\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.696329 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.696326 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-envoy\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.696499 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.696339 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:18.696499 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:18.696349 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57cdf01a-b880-463a-a13b-ef9ef712c4ce-istio-podinfo\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:19.126400 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.126366 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57cdf01a-b880-463a-a13b-ef9ef712c4ce" path="/var/lib/kubelet/pods/57cdf01a-b880-463a-a13b-ef9ef712c4ce/volumes" Jul 10 21:29:19.331359 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.331325 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl"] Jul 10 21:29:19.331756 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.331739 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57cdf01a-b880-463a-a13b-ef9ef712c4ce" containerName="istio-proxy" Jul 10 21:29:19.331801 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.331759 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="57cdf01a-b880-463a-a13b-ef9ef712c4ce" containerName="istio-proxy" Jul 10 21:29:19.331869 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.331841 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="57cdf01a-b880-463a-a13b-ef9ef712c4ce" containerName="istio-proxy" Jul 10 21:29:19.336501 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.336476 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.339298 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.339276 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ad1d1c21-openshift-default-dockercfg-5xvb2\"" Jul 10 21:29:19.352787 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.352766 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl"] Jul 10 21:29:19.402633 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402550 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-token\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.402633 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402596 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-envoy\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.402633 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402619 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bflbz\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-kube-api-access-bflbz\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.402870 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402649 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istiod-ca-cert\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.402870 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402678 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-certs\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.402870 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402793 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-socket\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.402870 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402851 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-credential-socket\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.403008 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402881 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-data\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.403008 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.402913 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-podinfo\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504110 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504074 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-token\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504119 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-envoy\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504136 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bflbz\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-kube-api-access-bflbz\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504155 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istiod-ca-cert\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504191 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-certs\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504304 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504235 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-socket\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504613 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504344 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-credential-socket\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504613 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504387 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-data\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504613 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504441 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-podinfo\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504652 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-socket\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504667 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-certs\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504875 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504786 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-credential-socket\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.504875 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.504828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-data\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.505113 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.505088 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istiod-ca-cert\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.506477 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.506459 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-envoy\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.506826 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.506806 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-podinfo\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.519690 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.519664 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bflbz\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-kube-api-access-bflbz\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.523201 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.523183 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-token\") pod \"e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.648590 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.648551 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:19.783348 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.783310 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl"] Jul 10 21:29:19.785595 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:29:19.785566 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503eef4b_57e0_4eb3_bcac_8f1a5bb901ea.slice/crio-ab44944be3488ef1a22f9a3bc5646451bc53e90b8a1230f4b3d3d2bdfb98707b WatchSource:0}: Error finding container ab44944be3488ef1a22f9a3bc5646451bc53e90b8a1230f4b3d3d2bdfb98707b: Status 404 returned error can't find the container with id ab44944be3488ef1a22f9a3bc5646451bc53e90b8a1230f4b3d3d2bdfb98707b Jul 10 21:29:19.787834 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.787797 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:19.787915 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.787867 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:19.787915 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:19.787894 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:20.663700 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:20.663660 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" event={"ID":"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea","Type":"ContainerStarted","Data":"ac0724f280a8b0555782f619ee8a09e426b40ab83f81230137358dc77528b1a5"} Jul 10 21:29:20.664148 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:20.663724 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" event={"ID":"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea","Type":"ContainerStarted","Data":"ab44944be3488ef1a22f9a3bc5646451bc53e90b8a1230f4b3d3d2bdfb98707b"} Jul 10 21:29:20.693834 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:20.693783 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" podStartSLOduration=1.69376435 podStartE2EDuration="1.69376435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:29:20.69250961 +0000 UTC m=+1904.129478831" watchObservedRunningTime="2026-07-10 21:29:20.69376435 +0000 UTC m=+1904.130733580" Jul 10 21:29:21.649511 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:21.649472 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:21.654393 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:21.654368 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:21.668292 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:21.668270 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:21.669169 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:21.669147 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:26.570509 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:26.570470 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl"] Jul 10 21:29:26.570886 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:26.570634 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" podUID="503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" containerName="istio-proxy" containerID="cri-o://ac0724f280a8b0555782f619ee8a09e426b40ab83f81230137358dc77528b1a5" gracePeriod=30 Jul 10 21:29:31.721104 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.721071 2585 generic.go:356] "Generic (PLEG): container finished" podID="503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" containerID="ac0724f280a8b0555782f619ee8a09e426b40ab83f81230137358dc77528b1a5" exitCode=0 Jul 10 21:29:31.721488 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.721126 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" event={"ID":"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea","Type":"ContainerDied","Data":"ac0724f280a8b0555782f619ee8a09e426b40ab83f81230137358dc77528b1a5"} Jul 10 21:29:31.822009 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.821982 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:31.923669 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923631 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-podinfo\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.923834 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923684 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-certs\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.923834 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923713 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-token\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.923974 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923830 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-data\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.923974 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923881 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-envoy\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.923974 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923917 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bflbz\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-kube-api-access-bflbz\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.924117 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.923974 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-credential-socket\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.924117 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924040 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istiod-ca-cert\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.924117 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924044 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:31.924117 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924061 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:31.924117 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924091 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-socket\") pod \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\" (UID: \"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea\") " Jul 10 21:29:31.924335 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924274 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:31.924568 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924510 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:31.924568 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924519 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:31.924568 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924532 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-data\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:31.924568 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924531 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:29:31.924568 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.924545 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-credential-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:31.926379 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.926348 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:29:31.926477 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.926369 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:31.926477 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.926380 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:31.926477 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:31.926393 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-kube-api-access-bflbz" (OuterVolumeSpecName: "kube-api-access-bflbz") pod "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" (UID: "503eef4b-57e0-4eb3-bcac-8f1a5bb901ea"). InnerVolumeSpecName "kube-api-access-bflbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:32.025556 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.025520 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:32.025556 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.025552 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-envoy\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:32.025556 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.025565 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bflbz\" (UniqueName: \"kubernetes.io/projected/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-kube-api-access-bflbz\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:32.025840 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.025578 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istiod-ca-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:32.025840 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.025589 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-workload-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:32.025840 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.025601 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea-istio-podinfo\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:32.636838 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.636801 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp"] Jul 10 21:29:32.637386 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.637357 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" containerName="istio-proxy" Jul 10 21:29:32.637386 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.637382 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" containerName="istio-proxy" Jul 10 21:29:32.637588 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.637496 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" containerName="istio-proxy" Jul 10 21:29:32.641229 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.641207 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.645461 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.645437 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-78079c65-openshift-default-dockercfg-9bmt2\"" Jul 10 21:29:32.654547 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.654525 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp"] Jul 10 21:29:32.727177 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.727144 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" event={"ID":"503eef4b-57e0-4eb3-bcac-8f1a5bb901ea","Type":"ContainerDied","Data":"ab44944be3488ef1a22f9a3bc5646451bc53e90b8a1230f4b3d3d2bdfb98707b"} Jul 10 21:29:32.727652 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.727212 2585 scope.go:117] "RemoveContainer" containerID="ac0724f280a8b0555782f619ee8a09e426b40ab83f81230137358dc77528b1a5" Jul 10 21:29:32.727652 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.727161 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl" Jul 10 21:29:32.732733 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.732709 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a975d2b-dd62-4a78-82fb-222cc79c5334-istiod-ca-cert\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.732839 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.732805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-credential-socket\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.732839 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.732829 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sd9r\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-kube-api-access-7sd9r\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.732925 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.732862 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-token\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.732964 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.732926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-envoy\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.732996 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.732973 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-socket\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.733049 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.733034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-podinfo\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.733086 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.733075 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-certs\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.733140 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.733124 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-data\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.749945 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.749918 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl"] Jul 10 21:29:32.752740 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.752715 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ad1d1c21-openshift-default-648659f87c-76hxl"] Jul 10 21:29:32.833916 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.833883 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-credential-socket\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.833916 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.833918 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sd9r\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-kube-api-access-7sd9r\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834174 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.833941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-token\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834174 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.833961 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-envoy\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834174 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.833990 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-socket\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834174 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-podinfo\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834174 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834064 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-certs\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834455 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834199 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-data\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834455 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834254 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a975d2b-dd62-4a78-82fb-222cc79c5334-istiod-ca-cert\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834455 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834376 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-credential-socket\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834566 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-socket\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834566 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834535 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-certs\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834635 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834595 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-data\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.834920 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.834898 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a975d2b-dd62-4a78-82fb-222cc79c5334-istiod-ca-cert\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.836869 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.836845 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-envoy\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.837100 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.837079 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-podinfo\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.842942 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.842920 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-token\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.843155 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.843136 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sd9r\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-kube-api-access-7sd9r\") pod \"e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:32.955069 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:32.954969 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:33.091050 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.091021 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp"] Jul 10 21:29:33.092917 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:29:33.092887 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a975d2b_dd62_4a78_82fb_222cc79c5334.slice/crio-ae87682ff6d049d7239b273573fe32d159234d90c131a98e78cf3559ed74db0d WatchSource:0}: Error finding container ae87682ff6d049d7239b273573fe32d159234d90c131a98e78cf3559ed74db0d: Status 404 returned error can't find the container with id ae87682ff6d049d7239b273573fe32d159234d90c131a98e78cf3559ed74db0d Jul 10 21:29:33.095001 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.094972 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:33.095070 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.095035 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:33.095103 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.095067 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:29:33.126832 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.126803 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="503eef4b-57e0-4eb3-bcac-8f1a5bb901ea" path="/var/lib/kubelet/pods/503eef4b-57e0-4eb3-bcac-8f1a5bb901ea/volumes" Jul 10 21:29:33.733732 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.733696 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" event={"ID":"6a975d2b-dd62-4a78-82fb-222cc79c5334","Type":"ContainerStarted","Data":"d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d"} Jul 10 21:29:33.734174 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.733758 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" event={"ID":"6a975d2b-dd62-4a78-82fb-222cc79c5334","Type":"ContainerStarted","Data":"ae87682ff6d049d7239b273573fe32d159234d90c131a98e78cf3559ed74db0d"} Jul 10 21:29:33.774140 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.774083 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" podStartSLOduration=1.774067057 podStartE2EDuration="1.774067057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:29:33.771070108 +0000 UTC m=+1917.208039356" watchObservedRunningTime="2026-07-10 21:29:33.774067057 +0000 UTC m=+1917.211036287" Jul 10 21:29:33.955488 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:33.955454 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:34.960820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:34.960792 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:35.748866 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:35.748831 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:35.750015 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:35.749992 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:38.428409 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:38.428367 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp"] Jul 10 21:29:38.762606 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:38.762503 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" podUID="6a975d2b-dd62-4a78-82fb-222cc79c5334" containerName="istio-proxy" containerID="cri-o://d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d" gracePeriod=30 Jul 10 21:29:45.211212 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.211183 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:45.257901 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.257829 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-socket\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.257901 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.257862 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-podinfo\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258107 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.257904 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-token\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258107 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.257929 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-data\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258212 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258110 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:45.258212 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258129 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-certs\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258317 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258212 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a975d2b-dd62-4a78-82fb-222cc79c5334-istiod-ca-cert\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258317 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258240 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-envoy\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258317 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258269 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-credential-socket\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258317 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258305 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sd9r\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-kube-api-access-7sd9r\") pod \"6a975d2b-dd62-4a78-82fb-222cc79c5334\" (UID: \"6a975d2b-dd62-4a78-82fb-222cc79c5334\") " Jul 10 21:29:45.258742 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258304 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:45.258742 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258700 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.258742 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258716 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-workload-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.258944 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258810 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:45.258987 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.258951 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:45.259131 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.259110 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a975d2b-dd62-4a78-82fb-222cc79c5334-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:29:45.260357 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.260323 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:45.260499 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.260388 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:29:45.260567 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.260533 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:29:45.260836 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.260817 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-kube-api-access-7sd9r" (OuterVolumeSpecName: "kube-api-access-7sd9r") pod "6a975d2b-dd62-4a78-82fb-222cc79c5334" (UID: "6a975d2b-dd62-4a78-82fb-222cc79c5334"). InnerVolumeSpecName "kube-api-access-7sd9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:45.359528 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359491 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a975d2b-dd62-4a78-82fb-222cc79c5334-istiod-ca-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.359528 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359522 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-envoy\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.359528 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359530 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-credential-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.359767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359549 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sd9r\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-kube-api-access-7sd9r\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.359767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359558 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-podinfo\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.359767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359566 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.359767 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.359574 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a975d2b-dd62-4a78-82fb-222cc79c5334-istio-data\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.795166 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.795127 2585 generic.go:356] "Generic (PLEG): container finished" podID="6a975d2b-dd62-4a78-82fb-222cc79c5334" containerID="d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d" exitCode=0 Jul 10 21:29:45.795346 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.795178 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" Jul 10 21:29:45.795346 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.795208 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" event={"ID":"6a975d2b-dd62-4a78-82fb-222cc79c5334","Type":"ContainerDied","Data":"d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d"} Jul 10 21:29:45.795346 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.795265 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp" event={"ID":"6a975d2b-dd62-4a78-82fb-222cc79c5334","Type":"ContainerDied","Data":"ae87682ff6d049d7239b273573fe32d159234d90c131a98e78cf3559ed74db0d"} Jul 10 21:29:45.795346 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.795288 2585 scope.go:117] "RemoveContainer" containerID="d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d" Jul 10 21:29:45.804432 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.804401 2585 scope.go:117] "RemoveContainer" containerID="d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d" Jul 10 21:29:45.804673 ip-10-0-137-232 kubenswrapper[2585]: E0710 21:29:45.804654 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d\": container with ID starting with d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d not found: ID does not exist" containerID="d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d" Jul 10 21:29:45.804726 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.804681 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d"} err="failed to get container status \"d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d\": rpc error: code = NotFound desc = could not find container \"d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d\": container with ID starting with d275d1c493312dc4308204f67073d457b4fcca3f6cd6d12cf825b7cd9aef951d not found: ID does not exist" Jul 10 21:29:45.818586 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.818564 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp"] Jul 10 21:29:45.825044 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:45.825023 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-78079c65-openshift-default-6f49fd9b95-9c4hp"] Jul 10 21:29:47.127563 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:29:47.127523 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a975d2b-dd62-4a78-82fb-222cc79c5334" path="/var/lib/kubelet/pods/6a975d2b-dd62-4a78-82fb-222cc79c5334/volumes" Jul 10 21:30:00.128839 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.128801 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v"] Jul 10 21:30:00.129327 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.129308 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a975d2b-dd62-4a78-82fb-222cc79c5334" containerName="istio-proxy" Jul 10 21:30:00.129408 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.129331 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a975d2b-dd62-4a78-82fb-222cc79c5334" containerName="istio-proxy" Jul 10 21:30:00.129503 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.129450 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a975d2b-dd62-4a78-82fb-222cc79c5334" containerName="istio-proxy" Jul 10 21:30:00.132400 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.132378 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" Jul 10 21:30:00.135234 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.135210 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xcjvq\"" Jul 10 21:30:00.136932 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.136899 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v"] Jul 10 21:30:00.148434 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.148379 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" Jul 10 21:30:00.282368 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.282340 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v"] Jul 10 21:30:00.284620 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:30:00.284586 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae248c91_2f65_4dc7_9617_50de5b4c81c8.slice/crio-6f42c69af106bc289b365fc9e87c2b35a2ace299cca0f873b6c64b493d90b344 WatchSource:0}: Error finding container 6f42c69af106bc289b365fc9e87c2b35a2ace299cca0f873b6c64b493d90b344: Status 404 returned error can't find the container with id 6f42c69af106bc289b365fc9e87c2b35a2ace299cca0f873b6c64b493d90b344 Jul 10 21:30:00.865136 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.865095 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" event={"ID":"ae248c91-2f65-4dc7-9617-50de5b4c81c8","Type":"ContainerStarted","Data":"6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a"} Jul 10 21:30:00.865309 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.865160 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" event={"ID":"ae248c91-2f65-4dc7-9617-50de5b4c81c8","Type":"ContainerStarted","Data":"6f42c69af106bc289b365fc9e87c2b35a2ace299cca0f873b6c64b493d90b344"} Jul 10 21:30:00.881238 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:30:00.881187 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" podStartSLOduration=0.881168691 podStartE2EDuration="881.168691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:30:00.880448386 +0000 UTC m=+1944.317417639" watchObservedRunningTime="2026-07-10 21:30:00.881168691 +0000 UTC m=+1944.318137920" Jul 10 21:31:00.010874 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:00.010834 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v"] Jul 10 21:31:00.011442 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:00.011071 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" podUID="ae248c91-2f65-4dc7-9617-50de5b4c81c8" containerName="cleanup" containerID="cri-o://6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a" gracePeriod=30 Jul 10 21:31:20.518073 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.518033 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g"] Jul 10 21:31:20.523011 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.522980 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.526293 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.526271 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-59a51ffd-openshift-default-dockercfg-rfxj5\"" Jul 10 21:31:20.536670 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.536646 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g"] Jul 10 21:31:20.660639 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660601 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-data\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.660822 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660704 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-socket\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.660822 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660734 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-token\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.660822 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660757 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-podinfo\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.660822 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660773 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps867\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-kube-api-access-ps867\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.660822 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istiod-ca-cert\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.661025 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-certs\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.661025 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660938 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-envoy\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.661025 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.660975 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-credential-socket\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761823 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-data\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761988 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-socket\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761988 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761883 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-token\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761988 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-podinfo\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761988 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps867\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-kube-api-access-ps867\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761988 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761950 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istiod-ca-cert\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.761988 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.761975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-certs\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762277 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-envoy\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762277 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762178 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-credential-socket\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762277 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762249 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-data\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762454 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762282 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-socket\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762454 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762339 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-certs\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762598 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762570 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-credential-socket\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.762736 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.762702 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istiod-ca-cert\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.764295 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.764271 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-envoy\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.764486 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.764471 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-podinfo\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.776823 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.776768 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-token\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.778516 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.778495 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps867\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-kube-api-access-ps867\") pod \"e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.833017 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.832977 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:20.983864 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.983840 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g"] Jul 10 21:31:20.985587 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:31:20.985562 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228db88a_3ee1_4883_93ef_b3858c7d6eb8.slice/crio-074a7514ea6d0f86f6a88afb2b9474a0d97e211b0168eff600c060a1d32fc8fa WatchSource:0}: Error finding container 074a7514ea6d0f86f6a88afb2b9474a0d97e211b0168eff600c060a1d32fc8fa: Status 404 returned error can't find the container with id 074a7514ea6d0f86f6a88afb2b9474a0d97e211b0168eff600c060a1d32fc8fa Jul 10 21:31:20.987680 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.987647 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:31:20.987742 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.987712 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:31:20.987784 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:20.987740 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:31:21.243439 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:21.243380 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" event={"ID":"228db88a-3ee1-4883-93ef-b3858c7d6eb8","Type":"ContainerStarted","Data":"67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57"} Jul 10 21:31:21.243622 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:21.243464 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" event={"ID":"228db88a-3ee1-4883-93ef-b3858c7d6eb8","Type":"ContainerStarted","Data":"074a7514ea6d0f86f6a88afb2b9474a0d97e211b0168eff600c060a1d32fc8fa"} Jul 10 21:31:21.278474 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:21.278401 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" podStartSLOduration=1.2783865699999999 podStartE2EDuration="1.27838657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:31:21.272665379 +0000 UTC m=+2024.709634609" watchObservedRunningTime="2026-07-10 21:31:21.27838657 +0000 UTC m=+2024.715355800" Jul 10 21:31:21.833668 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:21.833635 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:22.839288 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:22.839259 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:23.253450 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:23.253350 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:23.254457 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:23.254434 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:31:30.197591 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.197566 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" Jul 10 21:31:30.288455 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.288355 2585 generic.go:356] "Generic (PLEG): container finished" podID="ae248c91-2f65-4dc7-9617-50de5b4c81c8" containerID="6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a" exitCode=137 Jul 10 21:31:30.288455 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.288398 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" Jul 10 21:31:30.288455 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.288441 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" event={"ID":"ae248c91-2f65-4dc7-9617-50de5b4c81c8","Type":"ContainerDied","Data":"6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a"} Jul 10 21:31:30.288666 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.288491 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v" event={"ID":"ae248c91-2f65-4dc7-9617-50de5b4c81c8","Type":"ContainerDied","Data":"6f42c69af106bc289b365fc9e87c2b35a2ace299cca0f873b6c64b493d90b344"} Jul 10 21:31:30.288666 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.288522 2585 scope.go:117] "RemoveContainer" containerID="6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a" Jul 10 21:31:30.297063 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.297045 2585 scope.go:117] "RemoveContainer" containerID="6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a" Jul 10 21:31:30.297352 ip-10-0-137-232 kubenswrapper[2585]: E0710 21:31:30.297332 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a\": container with ID starting with 6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a not found: ID does not exist" containerID="6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a" Jul 10 21:31:30.297402 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.297363 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a"} err="failed to get container status \"6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a\": rpc error: code = NotFound desc = could not find container \"6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a\": container with ID starting with 6eb612795e21dcd7a90fd3a66f06ad0878908a271c9c8d9d0b97f5251a6d373a not found: ID does not exist" Jul 10 21:31:30.311638 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.311611 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v"] Jul 10 21:31:30.313424 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:30.313391 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728650-v7w4v"] Jul 10 21:31:31.126697 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:31:31.126661 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae248c91-2f65-4dc7-9617-50de5b4c81c8" path="/var/lib/kubelet/pods/ae248c91-2f65-4dc7-9617-50de5b4c81c8/volumes" Jul 10 21:32:37.629187 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:32:37.629156 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:32:37.634157 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:32:37.634135 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:34:39.313519 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:39.313485 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g"] Jul 10 21:34:39.314106 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:39.313719 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" podUID="228db88a-3ee1-4883-93ef-b3858c7d6eb8" containerName="istio-proxy" containerID="cri-o://67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57" gracePeriod=30 Jul 10 21:34:44.565372 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.565341 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:34:44.695630 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695599 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-data\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.695829 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695653 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istiod-ca-cert\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.695829 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695685 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-certs\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.695829 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695705 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-credential-socket\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.695829 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695730 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-token\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.695829 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695768 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-podinfo\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.696099 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695894 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps867\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-kube-api-access-ps867\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.696099 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695925 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:34:44.696099 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695940 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-socket\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.696099 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695946 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:34:44.696099 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.695984 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-envoy\") pod \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\" (UID: \"228db88a-3ee1-4883-93ef-b3858c7d6eb8\") " Jul 10 21:34:44.696336 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696205 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:34:44.696336 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696211 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:34:44.696472 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696366 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:34:44.696593 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696554 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.696593 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696579 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-data\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.696690 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696594 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istiod-ca-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.696690 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696606 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-workload-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.696690 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.696619 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-credential-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.698082 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.698049 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:34:44.698183 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.698092 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-kube-api-access-ps867" (OuterVolumeSpecName: "kube-api-access-ps867") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "kube-api-access-ps867". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:34:44.698316 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.698299 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:34:44.698356 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.698299 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "228db88a-3ee1-4883-93ef-b3858c7d6eb8" (UID: "228db88a-3ee1-4883-93ef-b3858c7d6eb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:34:44.797153 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.797121 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.797153 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.797148 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-podinfo\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.797153 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.797157 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps867\" (UniqueName: \"kubernetes.io/projected/228db88a-3ee1-4883-93ef-b3858c7d6eb8-kube-api-access-ps867\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:44.797377 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:44.797167 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228db88a-3ee1-4883-93ef-b3858c7d6eb8-istio-envoy\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:34:45.188771 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.188732 2585 generic.go:356] "Generic (PLEG): container finished" podID="228db88a-3ee1-4883-93ef-b3858c7d6eb8" containerID="67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57" exitCode=0 Jul 10 21:34:45.188771 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.188772 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" Jul 10 21:34:45.189018 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.188845 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" event={"ID":"228db88a-3ee1-4883-93ef-b3858c7d6eb8","Type":"ContainerDied","Data":"67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57"} Jul 10 21:34:45.189018 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.188892 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g" event={"ID":"228db88a-3ee1-4883-93ef-b3858c7d6eb8","Type":"ContainerDied","Data":"074a7514ea6d0f86f6a88afb2b9474a0d97e211b0168eff600c060a1d32fc8fa"} Jul 10 21:34:45.189018 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.188923 2585 scope.go:117] "RemoveContainer" containerID="67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57" Jul 10 21:34:45.197746 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.197732 2585 scope.go:117] "RemoveContainer" containerID="67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57" Jul 10 21:34:45.197985 ip-10-0-137-232 kubenswrapper[2585]: E0710 21:34:45.197968 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57\": container with ID starting with 67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57 not found: ID does not exist" containerID="67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57" Jul 10 21:34:45.198039 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.197994 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57"} err="failed to get container status \"67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57\": rpc error: code = NotFound desc = could not find container \"67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57\": container with ID starting with 67b9e2eaef5e932fcb29ddec0ee9e4c8f8fd24f02cb635865cd8e55afcc9be57 not found: ID does not exist" Jul 10 21:34:45.206607 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.206581 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g"] Jul 10 21:34:45.210719 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:45.210694 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-59a51ffd-openshift-default-67f8f5655-ssl8g"] Jul 10 21:34:47.126553 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:47.126521 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="228db88a-3ee1-4883-93ef-b3858c7d6eb8" path="/var/lib/kubelet/pods/228db88a-3ee1-4883-93ef-b3858c7d6eb8/volumes" Jul 10 21:34:58.774547 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774474 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5"] Jul 10 21:34:58.774905 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774879 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae248c91-2f65-4dc7-9617-50de5b4c81c8" containerName="cleanup" Jul 10 21:34:58.774905 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774893 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae248c91-2f65-4dc7-9617-50de5b4c81c8" containerName="cleanup" Jul 10 21:34:58.774974 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774914 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228db88a-3ee1-4883-93ef-b3858c7d6eb8" containerName="istio-proxy" Jul 10 21:34:58.774974 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774920 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="228db88a-3ee1-4883-93ef-b3858c7d6eb8" containerName="istio-proxy" Jul 10 21:34:58.775034 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774982 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="228db88a-3ee1-4883-93ef-b3858c7d6eb8" containerName="istio-proxy" Jul 10 21:34:58.775034 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.774992 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae248c91-2f65-4dc7-9617-50de5b4c81c8" containerName="cleanup" Jul 10 21:34:58.778949 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.778930 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.782612 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.782588 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9dc46fc9-openshift-default-dockercfg-7vdg6\"" Jul 10 21:34:58.804908 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.804877 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5"] Jul 10 21:34:58.829409 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829376 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-envoy\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829560 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829434 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-token\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829560 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829502 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6ea938-6d35-4e24-8611-c93a878e5e72-istiod-ca-cert\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829560 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829554 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-certs\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829739 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829576 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-socket\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829739 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-credential-socket\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829739 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829650 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h28f5\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-kube-api-access-h28f5\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829921 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829762 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-podinfo\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.829921 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.829843 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-data\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.930648 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.930615 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-token\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.930648 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.930654 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6ea938-6d35-4e24-8611-c93a878e5e72-istiod-ca-cert\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.930897 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.930687 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-certs\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.930897 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.930705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-socket\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.930897 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.930820 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-credential-socket\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.930897 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.930869 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h28f5\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-kube-api-access-h28f5\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931090 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931002 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-podinfo\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931090 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931069 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-socket\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931193 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931098 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-data\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931193 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931145 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-envoy\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931296 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-credential-socket\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931369 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931348 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-certs\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931450 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931406 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-data\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.931551 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.931526 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6ea938-6d35-4e24-8611-c93a878e5e72-istiod-ca-cert\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.933373 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.933342 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-envoy\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.933592 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.933568 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-podinfo\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.939457 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.939410 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-token\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:58.939598 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:58.939579 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h28f5\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-kube-api-access-h28f5\") pod \"e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:59.090107 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:59.090074 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:34:59.229912 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:59.229870 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5"] Jul 10 21:34:59.232547 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:34:59.232521 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6ea938_6d35_4e24_8611_c93a878e5e72.slice/crio-c2e00cbfe2df8a8002bd58de57e9872fb6b84010d613a1ad4d797cc6f9e55d2c WatchSource:0}: Error finding container c2e00cbfe2df8a8002bd58de57e9872fb6b84010d613a1ad4d797cc6f9e55d2c: Status 404 returned error can't find the container with id c2e00cbfe2df8a8002bd58de57e9872fb6b84010d613a1ad4d797cc6f9e55d2c Jul 10 21:34:59.234943 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:59.234910 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:34:59.235019 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:59.234974 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:34:59.235019 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:59.235003 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:34:59.257789 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:34:59.257765 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" event={"ID":"4b6ea938-6d35-4e24-8611-c93a878e5e72","Type":"ContainerStarted","Data":"c2e00cbfe2df8a8002bd58de57e9872fb6b84010d613a1ad4d797cc6f9e55d2c"} Jul 10 21:35:00.263509 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:35:00.263475 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" event={"ID":"4b6ea938-6d35-4e24-8611-c93a878e5e72","Type":"ContainerStarted","Data":"94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966"} Jul 10 21:35:00.286100 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:35:00.286046 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" podStartSLOduration=2.286030311 podStartE2EDuration="2.286030311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:35:00.28424736 +0000 UTC m=+2243.721216592" watchObservedRunningTime="2026-07-10 21:35:00.286030311 +0000 UTC m=+2243.722999540" Jul 10 21:35:01.090556 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:35:01.090518 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:35:01.095667 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:35:01.095641 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:35:01.268101 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:35:01.268074 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:35:01.269098 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:35:01.269078 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:37:37.656872 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:37:37.656842 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:37:37.661788 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:37:37.661769 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:38:17.913610 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:17.913531 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5"] Jul 10 21:38:17.914100 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:17.913785 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" podUID="4b6ea938-6d35-4e24-8611-c93a878e5e72" containerName="istio-proxy" containerID="cri-o://94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966" gracePeriod=30 Jul 10 21:38:23.173088 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.173061 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:38:23.182295 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.182232 2585 generic.go:356] "Generic (PLEG): container finished" podID="4b6ea938-6d35-4e24-8611-c93a878e5e72" containerID="94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966" exitCode=0 Jul 10 21:38:23.182295 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.182272 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" Jul 10 21:38:23.182295 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.182284 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" event={"ID":"4b6ea938-6d35-4e24-8611-c93a878e5e72","Type":"ContainerDied","Data":"94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966"} Jul 10 21:38:23.182562 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.182335 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5" event={"ID":"4b6ea938-6d35-4e24-8611-c93a878e5e72","Type":"ContainerDied","Data":"c2e00cbfe2df8a8002bd58de57e9872fb6b84010d613a1ad4d797cc6f9e55d2c"} Jul 10 21:38:23.182562 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.182365 2585 scope.go:117] "RemoveContainer" containerID="94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966" Jul 10 21:38:23.190869 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.190850 2585 scope.go:117] "RemoveContainer" containerID="94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966" Jul 10 21:38:23.191130 ip-10-0-137-232 kubenswrapper[2585]: E0710 21:38:23.191105 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966\": container with ID starting with 94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966 not found: ID does not exist" containerID="94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966" Jul 10 21:38:23.191225 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.191135 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966"} err="failed to get container status \"94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966\": rpc error: code = NotFound desc = could not find container \"94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966\": container with ID starting with 94c35226d98bcfb746a161c19a9b043368428a13efe6e2ffcf77f7d1629a6966 not found: ID does not exist" Jul 10 21:38:23.292097 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292060 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-credential-socket\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292289 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292135 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-certs\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292289 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292194 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-envoy\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292289 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292240 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-token\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292289 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292271 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-socket\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292543 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292297 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-data\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292543 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292324 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-podinfo\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292543 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292378 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6ea938-6d35-4e24-8611-c93a878e5e72-istiod-ca-cert\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292543 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292452 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h28f5\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-kube-api-access-h28f5\") pod \"4b6ea938-6d35-4e24-8611-c93a878e5e72\" (UID: \"4b6ea938-6d35-4e24-8611-c93a878e5e72\") " Jul 10 21:38:23.292543 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292457 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:38:23.292791 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292558 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:38:23.292791 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292591 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:38:23.292791 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292385 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:38:23.292791 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292748 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6ea938-6d35-4e24-8611-c93a878e5e72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:38:23.292957 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292873 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.292957 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292892 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-data\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.292957 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292908 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6ea938-6d35-4e24-8611-c93a878e5e72-istiod-ca-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.292957 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292919 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-credential-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.292957 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.292932 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-workload-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.294449 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.294402 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:38:23.294584 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.294460 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:38:23.294844 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.294816 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:38:23.294885 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.294837 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-kube-api-access-h28f5" (OuterVolumeSpecName: "kube-api-access-h28f5") pod "4b6ea938-6d35-4e24-8611-c93a878e5e72" (UID: "4b6ea938-6d35-4e24-8611-c93a878e5e72"). InnerVolumeSpecName "kube-api-access-h28f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:38:23.394061 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.394025 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-envoy\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.394061 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.394052 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.394061 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.394063 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6ea938-6d35-4e24-8611-c93a878e5e72-istio-podinfo\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.394284 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.394074 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h28f5\" (UniqueName: \"kubernetes.io/projected/4b6ea938-6d35-4e24-8611-c93a878e5e72-kube-api-access-h28f5\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:38:23.532266 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.532226 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5"] Jul 10 21:38:23.548847 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:23.548817 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9dc46fc9-openshift-default-5b876479f-brst5"] Jul 10 21:38:25.126485 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:38:25.126455 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6ea938-6d35-4e24-8611-c93a878e5e72" path="/var/lib/kubelet/pods/4b6ea938-6d35-4e24-8611-c93a878e5e72/volumes" Jul 10 21:39:13.897221 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.897182 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45"] Jul 10 21:39:13.898725 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.898697 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6ea938-6d35-4e24-8611-c93a878e5e72" containerName="istio-proxy" Jul 10 21:39:13.898875 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.898863 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6ea938-6d35-4e24-8611-c93a878e5e72" containerName="istio-proxy" Jul 10 21:39:13.899132 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.899119 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6ea938-6d35-4e24-8611-c93a878e5e72" containerName="istio-proxy" Jul 10 21:39:13.903280 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.903253 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:13.906225 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.906203 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-66ee6b-openshift-default-dockercfg-f99w4\"" Jul 10 21:39:13.912064 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:13.912035 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45"] Jul 10 21:39:14.064531 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064491 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5347e39-33c5-405c-96fe-7cfb887e0599-istiod-ca-cert\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064728 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-envoy\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064728 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064597 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-socket\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064728 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064632 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-podinfo\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064728 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064692 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgfxh\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-kube-api-access-xgfxh\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064875 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-data\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064875 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064807 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-certs\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064875 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064835 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-token\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.064969 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.064893 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-credential-socket\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.165884 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.165793 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-data\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.165884 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.165840 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-certs\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.165884 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.165880 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-token\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166179 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.165922 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-credential-socket\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166179 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.165980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5347e39-33c5-405c-96fe-7cfb887e0599-istiod-ca-cert\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166179 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166026 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-envoy\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166179 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166056 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-socket\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166179 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166127 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-podinfo\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166179 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgfxh\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-kube-api-access-xgfxh\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166526 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166287 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-data\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166526 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166347 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-certs\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166526 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166517 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-credential-socket\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166699 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166593 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-socket\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.166832 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.166805 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5347e39-33c5-405c-96fe-7cfb887e0599-istiod-ca-cert\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.168485 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.168457 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-envoy\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.168681 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.168662 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-podinfo\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.174838 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.174818 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-token\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.174950 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.174872 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgfxh\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-kube-api-access-xgfxh\") pod \"e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.215754 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.215720 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:14.356650 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.356622 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45"] Jul 10 21:39:14.358666 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:39:14.358637 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5347e39_33c5_405c_96fe_7cfb887e0599.slice/crio-31d6f443bb8f5198ed52df0e66fd30a72215e0f7f42278844b8931931b7d2612 WatchSource:0}: Error finding container 31d6f443bb8f5198ed52df0e66fd30a72215e0f7f42278844b8931931b7d2612: Status 404 returned error can't find the container with id 31d6f443bb8f5198ed52df0e66fd30a72215e0f7f42278844b8931931b7d2612 Jul 10 21:39:14.360805 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.360770 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:39:14.360909 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.360833 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:39:14.360909 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.360861 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 21:39:14.417687 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:14.417660 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" event={"ID":"d5347e39-33c5-405c-96fe-7cfb887e0599","Type":"ContainerStarted","Data":"31d6f443bb8f5198ed52df0e66fd30a72215e0f7f42278844b8931931b7d2612"} Jul 10 21:39:15.423687 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:15.423651 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" event={"ID":"d5347e39-33c5-405c-96fe-7cfb887e0599","Type":"ContainerStarted","Data":"7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c"} Jul 10 21:39:15.447234 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:15.447187 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" podStartSLOduration=2.447169716 podStartE2EDuration="2.447169716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:39:15.446838863 +0000 UTC m=+2498.883808130" watchObservedRunningTime="2026-07-10 21:39:15.447169716 +0000 UTC m=+2498.884138945" Jul 10 21:39:16.216704 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:16.216670 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:16.221972 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:16.221948 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:16.429319 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:16.429288 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:39:16.430327 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:39:16.430307 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:42:33.354297 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:33.354207 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45"] Jul 10 21:42:33.354861 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:33.354461 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" podUID="d5347e39-33c5-405c-96fe-7cfb887e0599" containerName="istio-proxy" containerID="cri-o://7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c" gracePeriod=30 Jul 10 21:42:37.684299 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:37.684271 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:42:37.690987 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:37.690965 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nlxcl_db753256-3709-478f-9611-0649fe0b3fed/ovn-acl-logging/0.log" Jul 10 21:42:38.612525 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.612499 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:42:38.747818 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.747735 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgfxh\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-kube-api-access-xgfxh\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.747818 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.747775 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-token\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.747818 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.747813 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5347e39-33c5-405c-96fe-7cfb887e0599-istiod-ca-cert\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.747871 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-credential-socket\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.747994 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-certs\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748056 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-envoy\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748105 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-podinfo\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748132 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748169 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-socket\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748197 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-data\") pod \"d5347e39-33c5-405c-96fe-7cfb887e0599\" (UID: \"d5347e39-33c5-405c-96fe-7cfb887e0599\") " Jul 10 21:42:38.748384 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748308 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748552 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748568 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748660 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748681 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-data\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748696 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-credential-socket\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748708 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-workload-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.748820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.748766 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5347e39-33c5-405c-96fe-7cfb887e0599-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:42:38.750454 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.750408 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:42:38.750553 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.750527 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 21:42:38.750617 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.750550 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-kube-api-access-xgfxh" (OuterVolumeSpecName: "kube-api-access-xgfxh") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "kube-api-access-xgfxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:42:38.750617 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.750569 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5347e39-33c5-405c-96fe-7cfb887e0599" (UID: "d5347e39-33c5-405c-96fe-7cfb887e0599"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:42:38.850037 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.850007 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-envoy\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.850037 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.850035 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-podinfo\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.850202 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.850044 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgfxh\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-kube-api-access-xgfxh\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.850202 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.850054 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5347e39-33c5-405c-96fe-7cfb887e0599-istio-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:38.850202 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:38.850063 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5347e39-33c5-405c-96fe-7cfb887e0599-istiod-ca-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 10 21:42:39.360900 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.360868 2585 generic.go:356] "Generic (PLEG): container finished" podID="d5347e39-33c5-405c-96fe-7cfb887e0599" containerID="7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c" exitCode=0 Jul 10 21:42:39.360900 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.360905 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" event={"ID":"d5347e39-33c5-405c-96fe-7cfb887e0599","Type":"ContainerDied","Data":"7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c"} Jul 10 21:42:39.361337 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.360913 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" Jul 10 21:42:39.361337 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.360948 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45" event={"ID":"d5347e39-33c5-405c-96fe-7cfb887e0599","Type":"ContainerDied","Data":"31d6f443bb8f5198ed52df0e66fd30a72215e0f7f42278844b8931931b7d2612"} Jul 10 21:42:39.361337 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.360971 2585 scope.go:117] "RemoveContainer" containerID="7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c" Jul 10 21:42:39.369539 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.369522 2585 scope.go:117] "RemoveContainer" containerID="7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c" Jul 10 21:42:39.369782 ip-10-0-137-232 kubenswrapper[2585]: E0710 21:42:39.369763 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c\": container with ID starting with 7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c not found: ID does not exist" containerID="7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c" Jul 10 21:42:39.369845 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.369794 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c"} err="failed to get container status \"7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c\": rpc error: code = NotFound desc = could not find container \"7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c\": container with ID starting with 7c64abf3198135f74b48eaa732b7f6d7f0099c74247a8376aec1acb3601f824c not found: ID does not exist" Jul 10 21:42:39.388651 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.388592 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45"] Jul 10 21:42:39.392876 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:39.392855 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-66ee6b-openshift-default-69999bfb97-btr45"] Jul 10 21:42:40.209900 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:40.209876 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b8cc5f97-7t6fs_29ceae5e-b131-4f1d-a27d-691bf9196830/copy-manifests/0.log" Jul 10 21:42:40.216808 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:40.216772 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b8cc5f97-7t6fs_29ceae5e-b131-4f1d-a27d-691bf9196830/manager/0.log" Jul 10 21:42:41.126902 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:41.126869 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5347e39-33c5-405c-96fe-7cfb887e0599" path="/var/lib/kubelet/pods/d5347e39-33c5-405c-96fe-7cfb887e0599/volumes" Jul 10 21:42:43.482284 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:43.482253 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ph2rk_0a672e29-92b2-4730-8e62-720e630d6223/istio-proxy/0.log" Jul 10 21:42:43.591855 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:43.591829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pwqs5_aa37d2ce-08c1-48ed-8534-f5584cab04c9/discovery/0.log" Jul 10 21:42:43.924484 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:43.924454 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/1.log" Jul 10 21:42:44.266547 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:44.266472 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8dbbdd55b-fhkls_01446074-b907-45b7-a35e-4320ff9d1f4d/router/0.log" Jul 10 21:42:44.622697 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:44.622667 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bfbxt_639d5cbe-777c-4f05-b0db-bf8cab277ba6/main/0.log" Jul 10 21:42:44.850244 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:44.850220 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rq58t_063e899d-3dab-44ff-86b7-37787005d099/main/0.log" Jul 10 21:42:52.427703 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:52.427673 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r85lp_b9c2e0e6-6b42-463f-a1db-56bfcff0aeb1/global-pull-secret-syncer/0.log" Jul 10 21:42:52.512045 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:52.512018 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c25vl_fb066bc5-4c41-4b1d-8835-432965030fa2/konnectivity-agent/0.log" Jul 10 21:42:52.591326 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:52.591302 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-232.ec2.internal_7713125ec15419b626d4a5eab444dc0f/haproxy/0.log" Jul 10 21:42:59.953330 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:59.953296 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-598cf84648-t4mn2_2dec3450-2406-4515-8e8b-7c6291a57003/metrics-server/0.log" Jul 10 21:42:59.982378 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:42:59.982348 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-4zkcg_36436f9b-993b-4c84-8a7d-4cb4d9df2b88/monitoring-plugin/0.log" Jul 10 21:43:00.020878 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.020852 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lszws_ccc47193-fafb-4b68-ac47-7259d7a8873d/node-exporter/0.log" Jul 10 21:43:00.052114 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.052082 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lszws_ccc47193-fafb-4b68-ac47-7259d7a8873d/kube-rbac-proxy/0.log" Jul 10 21:43:00.079007 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.078987 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lszws_ccc47193-fafb-4b68-ac47-7259d7a8873d/init-textfile/0.log" Jul 10 21:43:00.265820 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.265745 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4nkb6_f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe/kube-rbac-proxy-main/0.log" Jul 10 21:43:00.289258 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.289230 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4nkb6_f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe/kube-rbac-proxy-self/0.log" Jul 10 21:43:00.316742 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.316721 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4nkb6_f1bbe2d6-8d71-45d6-8d2b-1a72948eaebe/openshift-state-metrics/0.log" Jul 10 21:43:00.368077 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.368055 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/prometheus/0.log" Jul 10 21:43:00.426158 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.426133 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/config-reloader/0.log" Jul 10 21:43:00.487228 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.487202 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/thanos-sidecar/0.log" Jul 10 21:43:00.516440 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.516354 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/kube-rbac-proxy-web/0.log" Jul 10 21:43:00.543949 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.543925 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/kube-rbac-proxy/0.log" Jul 10 21:43:00.569924 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.569899 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/kube-rbac-proxy-thanos/0.log" Jul 10 21:43:00.609985 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.609963 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70b40f01-4f79-4dc8-9e93-5db6ccf7c196/init-config-reloader/0.log" Jul 10 21:43:00.712054 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.712023 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-js9kf_bd1599ed-58c9-4cc7-8151-4abd7ea90b3c/prometheus-operator-admission-webhook/0.log" Jul 10 21:43:00.867024 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.866995 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c8f96d58-68cs9_c8862f6f-0854-4d04-960b-60926b732d5a/thanos-query/0.log" Jul 10 21:43:00.894338 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.894314 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c8f96d58-68cs9_c8862f6f-0854-4d04-960b-60926b732d5a/kube-rbac-proxy-web/0.log" Jul 10 21:43:00.935512 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.935486 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c8f96d58-68cs9_c8862f6f-0854-4d04-960b-60926b732d5a/kube-rbac-proxy/0.log" Jul 10 21:43:00.966800 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.966775 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c8f96d58-68cs9_c8862f6f-0854-4d04-960b-60926b732d5a/prom-label-proxy/0.log" Jul 10 21:43:00.993133 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:00.993108 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c8f96d58-68cs9_c8862f6f-0854-4d04-960b-60926b732d5a/kube-rbac-proxy-rules/0.log" Jul 10 21:43:01.034835 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:01.034808 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c8f96d58-68cs9_c8862f6f-0854-4d04-960b-60926b732d5a/kube-rbac-proxy-metrics/0.log" Jul 10 21:43:02.031441 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.031380 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws"] Jul 10 21:43:02.031839 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.031777 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5347e39-33c5-405c-96fe-7cfb887e0599" containerName="istio-proxy" Jul 10 21:43:02.031839 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.031789 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5347e39-33c5-405c-96fe-7cfb887e0599" containerName="istio-proxy" Jul 10 21:43:02.031911 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.031844 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5347e39-33c5-405c-96fe-7cfb887e0599" containerName="istio-proxy" Jul 10 21:43:02.034976 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.034952 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.038281 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.038248 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxzgk\"/\"kube-root-ca.crt\"" Jul 10 21:43:02.039186 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.039164 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxzgk\"/\"openshift-service-ca.crt\"" Jul 10 21:43:02.039313 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.039297 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mxzgk\"/\"default-dockercfg-766q9\"" Jul 10 21:43:02.046321 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.046297 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws"] Jul 10 21:43:02.145305 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.145267 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-podres\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.145305 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.145313 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-proc\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.145545 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.145338 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-lib-modules\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.145545 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.145406 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjfh\" (UniqueName: \"kubernetes.io/projected/f00c99e8-8225-4926-a685-cb6585d73576-kube-api-access-gdjfh\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.145545 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.145526 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-sys\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246426 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246390 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-sys\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246590 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246491 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-podres\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246590 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246515 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-sys\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246590 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246522 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-proc\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246590 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246565 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-proc\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246761 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246590 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-lib-modules\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246761 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246646 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjfh\" (UniqueName: \"kubernetes.io/projected/f00c99e8-8225-4926-a685-cb6585d73576-kube-api-access-gdjfh\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246761 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246666 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-podres\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.246761 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.246734 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f00c99e8-8225-4926-a685-cb6585d73576-lib-modules\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.258375 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.258343 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjfh\" (UniqueName: \"kubernetes.io/projected/f00c99e8-8225-4926-a685-cb6585d73576-kube-api-access-gdjfh\") pod \"perf-node-gather-daemonset-v4sws\" (UID: \"f00c99e8-8225-4926-a685-cb6585d73576\") " pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.346047 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.346018 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:02.487486 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:02.487458 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws"] Jul 10 21:43:02.490120 ip-10-0-137-232 kubenswrapper[2585]: W0710 21:43:02.490094 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf00c99e8_8225_4926_a685_cb6585d73576.slice/crio-60fa019998f23025715971b7bb395aefc61b4e77da9bb4964ce0008d54b9bb68 WatchSource:0}: Error finding container 60fa019998f23025715971b7bb395aefc61b4e77da9bb4964ce0008d54b9bb68: Status 404 returned error can't find the container with id 60fa019998f23025715971b7bb395aefc61b4e77da9bb4964ce0008d54b9bb68 Jul 10 21:43:03.480238 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:03.480195 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" event={"ID":"f00c99e8-8225-4926-a685-cb6585d73576","Type":"ContainerStarted","Data":"d6d3d5328408e786c00486649f39b4abd75bb6fb91432b4cf3c2b1b7d1104cc9"} Jul 10 21:43:03.480692 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:03.480259 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" event={"ID":"f00c99e8-8225-4926-a685-cb6585d73576","Type":"ContainerStarted","Data":"60fa019998f23025715971b7bb395aefc61b4e77da9bb4964ce0008d54b9bb68"} Jul 10 21:43:03.480692 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:03.480412 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:03.497631 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:03.497584 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" podStartSLOduration=1.497569556 podStartE2EDuration="1.497569556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:43:03.496743207 +0000 UTC m=+2726.933712451" watchObservedRunningTime="2026-07-10 21:43:03.497569556 +0000 UTC m=+2726.934538787" Jul 10 21:43:05.058172 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:05.058114 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qxdt9_d22c8ed7-0925-4736-a9bf-9beb23714312/dns/0.log" Jul 10 21:43:05.081256 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:05.081224 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qxdt9_d22c8ed7-0925-4736-a9bf-9beb23714312/kube-rbac-proxy/0.log" Jul 10 21:43:05.182366 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:05.182339 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8pnff_c5eb908d-afe1-4855-b566-0b638812f04f/dns-node-resolver/0.log" Jul 10 21:43:05.772189 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:05.772155 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59494475f9-2r8gs_b8e6d6d0-9e27-49ca-bcf4-1e93f3f01d8f/registry/0.log" Jul 10 21:43:05.826412 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:05.826387 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pthg9_369a8078-18e9-4a26-9718-5ca221b76763/node-ca/0.log" Jul 10 21:43:06.802201 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:06.802173 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ph2rk_0a672e29-92b2-4730-8e62-720e630d6223/istio-proxy/0.log" Jul 10 21:43:06.877366 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:06.877332 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pwqs5_aa37d2ce-08c1-48ed-8534-f5584cab04c9/discovery/0.log" Jul 10 21:43:06.960966 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:06.960936 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/0.log" Jul 10 21:43:06.991135 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:06.991112 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/1.log" Jul 10 21:43:07.080571 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:07.080553 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8dbbdd55b-fhkls_01446074-b907-45b7-a35e-4320ff9d1f4d/router/0.log" Jul 10 21:43:07.784212 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:07.784181 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j9drs_c43b12f4-650a-4b57-91d4-ba437b4588bf/serve-healthcheck-canary/0.log" Jul 10 21:43:08.290976 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:08.290947 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-2v9tq_3a29b994-1466-4b6a-ab7a-b62990316c79/insights-operator/0.log" Jul 10 21:43:08.291640 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:08.291622 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-2v9tq_3a29b994-1466-4b6a-ab7a-b62990316c79/insights-operator/1.log" Jul 10 21:43:08.314297 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:08.314279 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vd7l_17180bfe-fc86-48fd-8e09-e3c3cf233183/kube-rbac-proxy/0.log" Jul 10 21:43:08.337584 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:08.337565 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vd7l_17180bfe-fc86-48fd-8e09-e3c3cf233183/exporter/0.log" Jul 10 21:43:08.362054 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:08.362028 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vd7l_17180bfe-fc86-48fd-8e09-e3c3cf233183/extractor/0.log" Jul 10 21:43:09.494410 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:09.494380 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mxzgk/perf-node-gather-daemonset-v4sws" Jul 10 21:43:11.024807 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:11.024783 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b8cc5f97-7t6fs_29ceae5e-b131-4f1d-a27d-691bf9196830/manager/0.log" Jul 10 21:43:11.050799 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:11.050777 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b8cc5f97-7t6fs_29ceae5e-b131-4f1d-a27d-691bf9196830/copy-manifests/0.log" Jul 10 21:43:12.404845 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:12.404816 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ph2rk_0a672e29-92b2-4730-8e62-720e630d6223/istio-proxy/0.log" Jul 10 21:43:12.462475 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:12.462443 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pwqs5_aa37d2ce-08c1-48ed-8534-f5584cab04c9/discovery/0.log" Jul 10 21:43:12.508657 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:12.508629 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/0.log" Jul 10 21:43:12.540815 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:12.540790 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/1.log" Jul 10 21:43:12.571360 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:12.571327 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-588cc756f9-jftql_98260cad-fdde-445e-9b19-eb8df3ce14c1/manager/0.log" Jul 10 21:43:12.592290 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:12.592258 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8dbbdd55b-fhkls_01446074-b907-45b7-a35e-4320ff9d1f4d/router/0.log" Jul 10 21:43:13.793457 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:13.793411 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ph2rk_0a672e29-92b2-4730-8e62-720e630d6223/istio-proxy/0.log" Jul 10 21:43:13.857166 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:13.857137 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pwqs5_aa37d2ce-08c1-48ed-8534-f5584cab04c9/discovery/0.log" Jul 10 21:43:13.909714 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:13.909688 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/0.log" Jul 10 21:43:13.941631 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:13.941600 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6z4sb_b009b84c-bbbc-4f66-a6ed-615ccc6043b7/istio-proxy/1.log" Jul 10 21:43:13.997464 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:13.997375 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8dbbdd55b-fhkls_01446074-b907-45b7-a35e-4320ff9d1f4d/router/0.log" Jul 10 21:43:19.351748 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.351719 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-67m8b_630c28ce-029a-48f4-a419-41779dcf7b6b/kube-multus/0.log" Jul 10 21:43:19.405526 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.405500 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/kube-multus-additional-cni-plugins/0.log" Jul 10 21:43:19.429020 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.428993 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/egress-router-binary-copy/0.log" Jul 10 21:43:19.453777 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.453754 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/cni-plugins/0.log" Jul 10 21:43:19.480292 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.480265 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/bond-cni-plugin/0.log" Jul 10 21:43:19.503771 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.503741 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/routeoverride-cni/0.log" Jul 10 21:43:19.530106 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.530080 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/whereabouts-cni-bincopy/0.log" Jul 10 21:43:19.554717 ip-10-0-137-232 kubenswrapper[2585]: I0710 21:43:19.554690 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hzmlm_526d28e7-0053-4420-a596-cf8ae88873d0/whereabouts-cni/0.log"