Jul 08 17:36:55.234059 ip-10-0-136-203 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 17:36:55.234071 ip-10-0-136-203 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 17:36:55.234078 ip-10-0-136-203 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 17:36:55.234350 ip-10-0-136-203 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 17:37:05.388753 ip-10-0-136-203 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 17:37:05.388771 ip-10-0-136-203 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e60435488fa149238f9f589e6a156963 -- Jul 08 17:38:49.813963 ip-10-0-136-203 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:38:50.222971 ip-10-0-136-203 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:38:50.222971 ip-10-0-136-203 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:38:50.222971 ip-10-0-136-203 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:38:50.222971 ip-10-0-136-203 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:38:50.222971 ip-10-0-136-203 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:38:50.222971 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.220325 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225162 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225181 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225188 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225191 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225195 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225198 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225201 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225204 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225209 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225212 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225215 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225217 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225220 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225223 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225226 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225229 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225232 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225234 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225237 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:38:50.239076 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225240 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225243 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225245 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225248 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225250 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225253 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225256 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225259 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225262 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225265 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225267 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225270 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225274 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225277 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225280 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225282 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225285 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225287 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225290 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:38:50.254194 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225295 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225299 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225302 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225306 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225309 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225312 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225314 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225317 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225320 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225322 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225324 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225327 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225329 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225332 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225334 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225337 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225339 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225342 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225345 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:38:50.406197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225350 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:38:50.298059 ip-10-0-136-203 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225354 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225357 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225360 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225363 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225366 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225368 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225372 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225374 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225377 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225380 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225383 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225385 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225388 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225391 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225394 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225397 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225400 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225402 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225405 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:38:50.416197 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225407 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225410 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225413 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225415 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225420 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225424 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225427 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225430 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225433 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225436 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225440 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225442 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225445 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225448 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225451 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225453 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225456 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225458 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225461 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:38:50.417115 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225463 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225465 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.225468 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227908 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227920 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227924 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227927 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227930 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227940 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227944 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227946 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227949 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227952 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227954 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227960 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227962 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227965 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227967 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227970 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227973 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:38:50.417972 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227976 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227978 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227981 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227984 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227986 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227989 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227991 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227995 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.227997 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228000 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228003 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228005 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228007 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228012 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228014 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228016 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228019 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228021 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228024 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228026 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:38:50.419032 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228029 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228034 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228036 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228039 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228041 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228044 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228049 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228052 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228054 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228056 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228059 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228062 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228065 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228067 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228069 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228072 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228075 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228078 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228080 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228083 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:38:50.420123 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228086 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228088 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228092 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228094 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228097 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228100 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228103 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228107 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228111 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228114 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228116 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228119 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228122 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228124 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228134 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228136 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228139 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228141 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228145 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:38:50.421974 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228147 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228150 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228152 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228157 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228160 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228162 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228165 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228168 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228172 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228176 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228180 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228183 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228186 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228188 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228191 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228193 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228196 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228198 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228202 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:38:50.423458 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228204 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228207 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228209 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228212 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228647 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228653 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228656 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228659 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228664 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228666 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228669 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228673 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228679 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228682 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228685 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228687 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228690 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228693 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228696 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:38:50.434159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228698 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228701 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228703 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228706 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228708 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228711 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228714 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228717 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228719 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228722 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228724 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228727 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228731 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228734 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228738 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228741 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228743 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228746 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228748 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228751 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:38:50.435781 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228753 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228757 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228760 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228762 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228765 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228768 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228771 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228774 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228777 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228779 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228781 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228784 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228786 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228789 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228791 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228794 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228796 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228799 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228802 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228804 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:38:50.437088 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228807 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228811 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228814 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228817 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228821 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228824 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228826 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228829 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228831 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228834 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228836 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228839 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228841 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228843 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228846 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228849 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228851 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228855 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228858 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228860 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:38:50.438026 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228863 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228866 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228868 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228871 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228873 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228876 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228878 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228880 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228884 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228886 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228889 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228891 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228894 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228896 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228899 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228901 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228906 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228909 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228911 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228914 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:38:50.438638 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228916 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228919 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228922 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.228924 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229006 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229019 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229026 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229030 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229036 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229041 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229046 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229050 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229054 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229057 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229061 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229065 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229068 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229071 2559 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229074 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229077 2559 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229080 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229083 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229088 2559 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229091 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:38:50.439426 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229094 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229097 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229100 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229104 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229108 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229111 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229115 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229118 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229121 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229124 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229128 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229131 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229135 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229138 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229141 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229144 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229147 2559 flags.go:64] FLAG: --enable-server="true" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229153 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229157 2559 flags.go:64] FLAG: --event-burst="100" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229160 2559 flags.go:64] FLAG: --event-qps="50" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229163 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229167 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229170 2559 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229174 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:38:50.440174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229176 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229179 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229182 2559 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229185 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229188 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229191 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229194 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229197 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229200 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229203 2559 flags.go:64] FLAG: --feature-gates="" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229206 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229210 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229214 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229218 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229221 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229224 2559 flags.go:64] FLAG: --help="false" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229227 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229230 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229233 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229236 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229239 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229243 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229245 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:38:50.440935 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229248 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229251 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229255 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229259 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229262 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229265 2559 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229268 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229271 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229274 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229276 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229279 2559 flags.go:64] FLAG: --lock-file="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229282 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229284 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229287 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229293 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229295 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229298 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229301 2559 flags.go:64] FLAG: --logging-format="text" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229304 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229307 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229310 2559 flags.go:64] FLAG: --manifest-url="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229315 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229320 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229323 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229327 2559 flags.go:64] FLAG: --max-pods="110" Jul 08 17:38:50.649108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229330 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229333 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229336 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229339 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229342 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229345 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229348 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229356 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229359 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229364 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229367 2559 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229370 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229377 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229380 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229383 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229386 2559 flags.go:64] FLAG: --port="10250" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229389 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229392 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082997f4aee616992" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229395 2559 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229398 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229401 2559 flags.go:64] FLAG: --register-node="true" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229404 2559 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229408 2559 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229411 2559 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:38:50.650046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229414 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229416 2559 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229423 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229426 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229429 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229433 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229436 2559 flags.go:64] FLAG: --runonce="false" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229439 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229442 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229445 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229447 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229450 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229453 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229456 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229459 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229462 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229465 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229470 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229473 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229476 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229479 2559 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229482 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229488 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229490 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229493 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:38:50.650839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229498 2559 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229501 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229504 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229506 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229509 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229512 2559 flags.go:64] FLAG: --v="2" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229516 2559 flags.go:64] FLAG: --version="false" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229521 2559 flags.go:64] FLAG: --vmodule="" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229524 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.229528 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229671 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229675 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229680 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229684 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229687 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229690 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229693 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229696 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229699 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229702 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229705 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:38:50.651566 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229707 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229711 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229715 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229719 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229722 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229724 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229727 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229731 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229733 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229736 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229739 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229741 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229744 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229746 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229748 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229751 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229753 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229756 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229759 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:38:50.652221 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229762 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229764 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229767 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229769 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229773 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229775 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229778 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229781 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229783 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229786 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229788 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229791 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229794 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229797 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229799 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229801 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229805 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229808 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229810 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229813 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:38:50.652799 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.229815 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230174 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230178 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230180 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230183 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230186 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230189 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230192 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230194 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230197 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230200 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230202 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230205 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230207 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230210 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230212 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230216 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230219 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230221 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230224 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:38:50.653338 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230226 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230229 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230232 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230234 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230237 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230239 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230243 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230247 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230251 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230253 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230256 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230259 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230261 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230264 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230268 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230271 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230274 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230277 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230280 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:38:50.653931 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230282 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230284 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230287 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230289 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230292 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230294 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230297 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230299 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230301 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.230305 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.230919 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.241006 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.241028 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.241044 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:38:50.654442 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.241050 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241120 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241126 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241129 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241133 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241135 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241138 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241141 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241143 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241146 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241149 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241152 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241155 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241159 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241162 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241165 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241168 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241171 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241173 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241176 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:38:50.654886 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241178 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241181 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241183 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241186 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241188 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241191 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241194 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241197 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241200 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241204 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241209 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241212 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241215 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241218 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241221 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241223 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241226 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241228 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241231 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:38:50.655410 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241233 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241236 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241239 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241241 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241244 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241247 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241249 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241252 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241255 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241257 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241260 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241262 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241265 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241267 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241271 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241274 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241277 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241279 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241282 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241284 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:38:50.656022 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241287 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241289 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241292 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241295 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241298 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241300 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241303 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241306 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241308 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241311 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241318 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241321 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241324 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241326 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241329 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241332 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241336 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241339 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241343 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:38:50.656896 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241346 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241350 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241353 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241356 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241359 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241362 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241365 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241368 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241371 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241374 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241377 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241380 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241383 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241385 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241387 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241390 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241393 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241395 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241398 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241401 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:38:50.657456 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241403 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241406 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.241412 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241968 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241990 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.241996 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242001 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242007 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242014 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242021 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242027 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242032 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242037 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242042 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:38:50.859266 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242055 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242060 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242065 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242070 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242074 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242079 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242083 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242087 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242092 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242097 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242101 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242106 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242116 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242120 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242125 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242129 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242133 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242138 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242142 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:38:50.859822 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242146 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242154 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242160 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242168 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242175 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242179 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242192 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242196 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242202 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242209 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242213 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242217 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242221 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242225 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242230 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242235 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242241 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242247 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242251 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242260 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:38:50.860347 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242265 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242269 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242273 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242278 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242286 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242291 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242296 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242301 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242306 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242311 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242315 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242325 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242329 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242334 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242338 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242344 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242348 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242352 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242357 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242362 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:38:50.860982 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242366 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242371 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242375 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242384 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242388 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242392 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242397 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242403 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242407 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242412 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242416 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242421 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242425 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242430 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242434 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242438 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242449 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242454 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242458 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242463 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:38:50.861508 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242467 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242472 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242476 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242480 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242485 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242489 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242493 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242499 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:50.242508 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.242517 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.242983 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.245074 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.246242 2559 server.go:1019] "Starting client certificate rotation" Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.246341 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:38:50.862071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.246373 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.248691 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.252554 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.259940 2559 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.262164 2559 log.go:25] "Validated CRI v1 image API" Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.263794 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.266172 2559 fs.go:135] Filesystem UUIDs: map[1aa8daa8-b5fa-4467-9418-1f780df6c9dd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b1f33328-2c09-4681-b2ec-ca40d5249541:/dev/nvme0n1p3] Jul 08 17:38:50.862471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.266199 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.272994 2559 manager.go:216] Machine: {Timestamp:2026-07-08 17:38:50.271565234 +0000 UTC m=+0.334516638 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098682 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a13edb4ce03f77f6cf337f38b97e0 SystemUUID:ec2a13ed-b4ce-03f7-7f6c-f337f38b97e0 BootID:e6043548-8fa1-4923-8f9f-589e6a156963 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c9:57:c8:95:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c9:57:c8:95:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:e6:4d:9e:66:84 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.273119 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.273217 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.276362 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.276402 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.277171 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.277187 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.277201 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.277766 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.279004 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.279704 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282071 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282251 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282286 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282300 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282314 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:38:50.862796 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282326 2559 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282340 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282861 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.282883 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.286918 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.288809 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.288849 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.289919 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.289939 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.289948 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.289956 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.289975 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.289984 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.290198 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.290207 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.290217 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.290225 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.290236 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.290247 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.292882 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.292882 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.293009 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.293025 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.296082 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.297091 2559 server.go:1268] "Started kubelet" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.297191 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.297250 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.297352 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.298960 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.299577 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.303187 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.302907 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-203.ec2.internal.18c0613470c7bd8a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-203.ec2.internal,UID:ip-10-0-136-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-203.ec2.internal,},FirstTimestamp:2026-07-08 17:38:50.297048458 +0000 UTC m=+0.359999892,LastTimestamp:2026-07-08 17:38:50.297048458 +0000 UTC m=+0.359999892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-203.ec2.internal,}" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.305530 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.305528 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.305649 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306037 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306067 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306083 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306243 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306251 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306514 2559 factory.go:55] Registering systemd factory Jul 08 17:38:50.863328 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306529 2559 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306749 2559 factory.go:153] Registering CRI-O factory Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306767 2559 factory.go:223] Registration of the crio container factory successfully Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306821 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306847 2559 factory.go:103] Registering Raw factory Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.306863 2559 manager.go:1196] Started watching for new ooms in manager Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.307419 2559 manager.go:349] Starting recovery of all containers Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.309759 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.309771 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.310458 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smzq6" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.316433 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smzq6" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.322063 2559 manager.go:354] Recovery completed Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.328059 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330240 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330276 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330290 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330874 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330887 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330889 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.330926 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.331551 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.331574 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.331584 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.332211 2559 policy_none.go:49] "None policy: Start" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.332225 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.332235 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.332782 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-203.ec2.internal.18c0613472c278a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-203.ec2.internal,UID:ip-10-0-136-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-203.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-203.ec2.internal,},FirstTimestamp:2026-07-08 17:38:50.330257569 +0000 UTC m=+0.393208980,LastTimestamp:2026-07-08 17:38:50.330257569 +0000 UTC m=+0.393208980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-203.ec2.internal,}" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.333319 2559 policy_none.go:47] "Start" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.405934 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.443384 2559 manager.go:337] "Starting Device Plugin manager" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.443502 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.443517 2559 server.go:87] "Starting device plugin registration server" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.443849 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.443862 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.444074 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.444170 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.444178 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.444673 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.444729 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.864406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.458310 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.459591 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.459653 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.459704 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.459759 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.461946 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.523596 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-203.ec2.internal\" not found" node="ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.544720 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.546163 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.546196 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.546210 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.546237 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.553293 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.553319 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-203.ec2.internal\": node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.563566 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal"] Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.563652 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.564230 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.565234 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.565261 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.565271 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.566642 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.566735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.566764 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.567424 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.567443 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.567452 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.567489 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.567529 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.567541 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.568742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.568768 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.569608 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.569654 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.569673 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.598611 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-203.ec2.internal\" not found" node="ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.603479 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-203.ec2.internal\" not found" node="ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.865827 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.608721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38e3abca27644d830be1c35e80edb1bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal\" (UID: \"38e3abca27644d830be1c35e80edb1bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.608756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38e3abca27644d830be1c35e80edb1bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal\" (UID: \"38e3abca27644d830be1c35e80edb1bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.608776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0ce9e9a292ed52094c87bbcba5cc0e4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-203.ec2.internal\" (UID: \"c0ce9e9a292ed52094c87bbcba5cc0e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.664348 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.709225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38e3abca27644d830be1c35e80edb1bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal\" (UID: \"38e3abca27644d830be1c35e80edb1bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.709255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38e3abca27644d830be1c35e80edb1bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal\" (UID: \"38e3abca27644d830be1c35e80edb1bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.709278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0ce9e9a292ed52094c87bbcba5cc0e4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-203.ec2.internal\" (UID: \"c0ce9e9a292ed52094c87bbcba5cc0e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.709367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38e3abca27644d830be1c35e80edb1bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal\" (UID: \"38e3abca27644d830be1c35e80edb1bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.709375 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0ce9e9a292ed52094c87bbcba5cc0e4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-203.ec2.internal\" (UID: \"c0ce9e9a292ed52094c87bbcba5cc0e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.709383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38e3abca27644d830be1c35e80edb1bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal\" (UID: \"38e3abca27644d830be1c35e80edb1bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.765397 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:50.866927 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.866119 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.021809 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.904142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:51.021809 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:50.912707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" Jul 08 17:38:51.021809 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:50.966439 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.227618 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.070665 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.227618 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.171049 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.247798 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.247979 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.272125 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.318683 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:33:50 +0000 UTC" deadline="2028-03-19 17:23:41.919118524 +0000 UTC" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.318758 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14879h44m50.600365794s" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.318766 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:38:51.374853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.372466 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.488593 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.473339 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.495159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:51.494407 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e3abca27644d830be1c35e80edb1bd.slice/crio-9ac07b61c39ab440dd77ae08037f097110fabb5054177778c4c9d47ae2805898 WatchSource:0}: Error finding container 9ac07b61c39ab440dd77ae08037f097110fabb5054177778c4c9d47ae2805898: Status 404 returned error can't find the container with id 9ac07b61c39ab440dd77ae08037f097110fabb5054177778c4c9d47ae2805898 Jul 08 17:38:51.495159 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:51.494609 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ce9e9a292ed52094c87bbcba5cc0e4.slice/crio-d0dce62d3094dc524202ef575998fb62c5430d3a2f4c4f91fe33439b11bbe72b WatchSource:0}: Error finding container d0dce62d3094dc524202ef575998fb62c5430d3a2f4c4f91fe33439b11bbe72b: Status 404 returned error can't find the container with id d0dce62d3094dc524202ef575998fb62c5430d3a2f4c4f91fe33439b11bbe72b Jul 08 17:38:51.644483 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.502610 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:38:51.644483 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.565153 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:38:51.644483 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.574051 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.868933 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:51.676466 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-203.ec2.internal\" not found" Jul 08 17:38:51.868933 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.691182 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:38:51.868933 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.706311 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" Jul 08 17:38:51.868933 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.720716 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:38:51.868933 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.721833 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" Jul 08 17:38:51.868933 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:51.732305 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.284012 2559 apiserver.go:52] "Watching apiserver" Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.296246 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.301064 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5","openshift-cluster-node-tuning-operator/tuned-fdd9g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal","openshift-multus/multus-6m44h","openshift-multus/multus-additional-cni-plugins-slm9d","openshift-multus/network-metrics-daemon-xnln6","kube-system/konnectivity-agent-klt62","openshift-dns/node-resolver-44qjc","openshift-image-registry/node-ca-t44lb","openshift-network-diagnostics/network-check-target-6w2cn","openshift-network-operator/iptables-alerter-rc5pb","openshift-ovn-kubernetes/ovnkube-node-8bgb7","kube-system/global-pull-secret-syncer-lk652","kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal"] Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.302930 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.304272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.304352 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:38:52.306508 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.305603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.307968 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.307215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.307968 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.307609 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:38:52.309058 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.308792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.312276 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.309468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:52.312276 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.309534 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:38:52.312276 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.311679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.313449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.314897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.317214 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.317296 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.318650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-system-cni-dir\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/191bd147-76c5-44df-a1ec-7eba9a6d42c5-cni-binary-copy\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-cni-multus\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-multus-certs\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320683 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-cni-binary-copy\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84c3138a-3638-4230-ac62-62ff579b23e3-konnectivity-ca\") pod \"konnectivity-agent-klt62\" (UID: \"84c3138a-3638-4230-ac62-62ff579b23e3\") " pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-netns\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/deb22042-8c30-44e7-829d-a905c9957d53-kubelet-config\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/deb22042-8c30-44e7-829d-a905c9957d53-dbus\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-system-cni-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.322060 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-daemon-config\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-os-release\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72c39a38-4a03-4003-b332-83717330276a-hosts-file\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.320983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c39a38-4a03-4003-b332-83717330276a-tmp-dir\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-cnibin\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-os-release\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-socket-dir-parent\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-conf-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-cnibin\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv99n\" (UniqueName: \"kubernetes.io/projected/7f777e37-36c6-4066-a601-34e0603a63db-kube-api-access-vv99n\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84c3138a-3638-4230-ac62-62ff579b23e3-agent-certs\") pod \"konnectivity-agent-klt62\" (UID: \"84c3138a-3638-4230-ac62-62ff579b23e3\") " pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321183 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-kubelet\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-hostroot\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-cni-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-k8s-cni-cncf-io\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.323393 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-cni-bin\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.325403 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-etc-kubernetes\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.325403 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbt6\" (UniqueName: \"kubernetes.io/projected/72c39a38-4a03-4003-b332-83717330276a-kube-api-access-2nbt6\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.325403 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.321434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9888\" (UniqueName: \"kubernetes.io/projected/191bd147-76c5-44df-a1ec-7eba9a6d42c5-kube-api-access-w9888\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.384085 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.383925 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.384085 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.383971 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:38:52.384085 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384000 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:38:52.384085 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384060 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.384741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.383985 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.384741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384364 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7kr5g\"" Jul 08 17:38:52.384741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384399 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.384741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384680 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.384741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384729 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.385101 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384845 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:38:52.385101 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.384913 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c2ft6\"" Jul 08 17:38:52.385101 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385033 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:38:52.385639 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385255 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.385639 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-25c4c\"" Jul 08 17:38:52.385639 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385310 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ncdjm\"" Jul 08 17:38:52.385639 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385424 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:38:52.385639 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385612 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:38:52.385639 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385637 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:38:52.386200 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385783 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:38:52.386200 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.385805 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6tp2n\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.386533 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.386963 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.387192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.387222 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rj2dn\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.387516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.387727 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4zfs8\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.388306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.388317 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.388439 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.388662 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.389037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gcscn\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.389105 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6fk94\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.389295 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.389381 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.389453 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.389506 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.394371 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.394402 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5v9q7" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.408942 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-device-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e843d703-bc03-42f5-bdce-f2000da916c1-ovn-node-metrics-cert\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-modprobe-d\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-system-cni-dir\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/191bd147-76c5-44df-a1ec-7eba9a6d42c5-cni-binary-copy\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-cni-multus\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-system-cni-dir\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.477582 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-ovnkube-config\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.421977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422000 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysconfig\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-kubernetes\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-var-lib-kubelet\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422062 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-cni-multus\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-cni-binary-copy\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-netns\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-iptables-alerter-script\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-cni-netd\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-netns\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4wkc\" (UniqueName: \"kubernetes.io/projected/e843d703-bc03-42f5-bdce-f2000da916c1-kube-api-access-t4wkc\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkv2g\" (UniqueName: \"kubernetes.io/projected/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-kube-api-access-wkv2g\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-sys-fs\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-run-netns\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.479015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-socket-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-var-lib-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-cni-bin\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysctl-conf\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-run\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422552 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/191bd147-76c5-44df-a1ec-7eba9a6d42c5-cni-binary-copy\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-cnibin\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-cni-binary-copy\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-cnibin\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422694 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-host-slash\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqqgh\" (UniqueName: \"kubernetes.io/projected/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-kube-api-access-jqqgh\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422762 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-serviceca\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-conf-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.480043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-kubelet\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-hostroot\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-conf-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-host\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-sys\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-hostroot\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-kubelet\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.422996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e349a0-97b7-44bc-8761-e78188280a33-tmp\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.422999 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-k8s-cni-cncf-io\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-cni-bin\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.423067 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:52.923045481 +0000 UTC m=+2.985996899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423083 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-var-lib-cni-bin\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423101 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-k8s-cni-cncf-io\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-etc-kubernetes\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.480875 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-kubelet\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423174 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-etc-kubernetes\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76e349a0-97b7-44bc-8761-e78188280a33-etc-tuned\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9888\" (UniqueName: \"kubernetes.io/projected/191bd147-76c5-44df-a1ec-7eba9a6d42c5-kube-api-access-w9888\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysctl-d\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xrkq\" (UniqueName: \"kubernetes.io/projected/76e349a0-97b7-44bc-8761-e78188280a33-kube-api-access-4xrkq\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-multus-certs\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-ovn\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423394 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84c3138a-3638-4230-ac62-62ff579b23e3-konnectivity-ca\") pod \"konnectivity-agent-klt62\" (UID: \"84c3138a-3638-4230-ac62-62ff579b23e3\") " pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-lib-modules\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423428 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-host-run-multus-certs\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwwh\" (UniqueName: \"kubernetes.io/projected/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-kube-api-access-sqwwh\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-systemd-units\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/deb22042-8c30-44e7-829d-a905c9957d53-kubelet-config\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.481833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/deb22042-8c30-44e7-829d-a905c9957d53-dbus\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-system-cni-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-daemon-config\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-registration-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-os-release\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72c39a38-4a03-4003-b332-83717330276a-hosts-file\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c39a38-4a03-4003-b332-83717330276a-tmp-dir\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-os-release\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-socket-dir-parent\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-etc-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-node-log\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms6tv\" (UniqueName: \"kubernetes.io/projected/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-kube-api-access-ms6tv\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-env-overrides\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-host\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-cnibin\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72c39a38-4a03-4003-b332-83717330276a-hosts-file\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.482670 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f777e37-36c6-4066-a601-34e0603a63db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv99n\" (UniqueName: \"kubernetes.io/projected/7f777e37-36c6-4066-a601-34e0603a63db-kube-api-access-vv99n\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424066 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/deb22042-8c30-44e7-829d-a905c9957d53-kubelet-config\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84c3138a-3638-4230-ac62-62ff579b23e3-agent-certs\") pod \"konnectivity-agent-klt62\" (UID: \"84c3138a-3638-4230-ac62-62ff579b23e3\") " pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.423952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84c3138a-3638-4230-ac62-62ff579b23e3-konnectivity-ca\") pod \"konnectivity-agent-klt62\" (UID: \"84c3138a-3638-4230-ac62-62ff579b23e3\") " pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-slash\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-systemd\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-ovnkube-script-lib\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-cni-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-log-socket\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-os-release\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-socket-dir-parent\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424403 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424447 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-os-release\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424456 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/deb22042-8c30-44e7-829d-a905c9957d53-dbus\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c39a38-4a03-4003-b332-83717330276a-tmp-dir\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-system-cni-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.483669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-systemd\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424503 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-cni-dir\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f777e37-36c6-4066-a601-34e0603a63db-cnibin\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbt6\" (UniqueName: \"kubernetes.io/projected/72c39a38-4a03-4003-b332-83717330276a-kube-api-access-2nbt6\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.424651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/191bd147-76c5-44df-a1ec-7eba9a6d42c5-multus-daemon-config\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.462052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84c3138a-3638-4230-ac62-62ff579b23e3-agent-certs\") pod \"konnectivity-agent-klt62\" (UID: \"84c3138a-3638-4230-ac62-62ff579b23e3\") " pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.465116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9888\" (UniqueName: \"kubernetes.io/projected/191bd147-76c5-44df-a1ec-7eba9a6d42c5-kube-api-access-w9888\") pod \"multus-6m44h\" (UID: \"191bd147-76c5-44df-a1ec-7eba9a6d42c5\") " pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.465392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbt6\" (UniqueName: \"kubernetes.io/projected/72c39a38-4a03-4003-b332-83717330276a-kube-api-access-2nbt6\") pod \"node-resolver-44qjc\" (UID: \"72c39a38-4a03-4003-b332-83717330276a\") " pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.465652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv99n\" (UniqueName: \"kubernetes.io/projected/7f777e37-36c6-4066-a601-34e0603a63db-kube-api-access-vv99n\") pod \"multus-additional-cni-plugins-slm9d\" (UID: \"7f777e37-36c6-4066-a601-34e0603a63db\") " pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.466947 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" event={"ID":"38e3abca27644d830be1c35e80edb1bd","Type":"ContainerStarted","Data":"9ac07b61c39ab440dd77ae08037f097110fabb5054177778c4c9d47ae2805898"} Jul 08 17:38:52.484408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.469001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" event={"ID":"c0ce9e9a292ed52094c87bbcba5cc0e4","Type":"ContainerStarted","Data":"d0dce62d3094dc524202ef575998fb62c5430d3a2f4c4f91fe33439b11bbe72b"} Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-kubernetes\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-var-lib-kubelet\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-iptables-alerter-script\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-kubernetes\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-var-lib-kubelet\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-cni-netd\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-cni-netd\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4wkc\" (UniqueName: \"kubernetes.io/projected/e843d703-bc03-42f5-bdce-f2000da916c1-kube-api-access-t4wkc\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv2g\" (UniqueName: \"kubernetes.io/projected/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-kube-api-access-wkv2g\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-sys-fs\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-run-netns\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-socket-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.525982 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-var-lib-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-cni-bin\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysctl-conf\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-run\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.564091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-host-slash\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-var-lib-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqqgh\" (UniqueName: \"kubernetes.io/projected/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-kube-api-access-jqqgh\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-run\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-serviceca\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-cni-bin\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-iptables-alerter-script\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-run-netns\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526222 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-socket-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-host-slash\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-sys-fs\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-host\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-sys\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.565000 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e349a0-97b7-44bc-8761-e78188280a33-tmp\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-sys\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526461 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysctl-conf\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526481 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-host\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-kubelet\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76e349a0-97b7-44bc-8761-e78188280a33-etc-tuned\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysctl-d\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xrkq\" (UniqueName: \"kubernetes.io/projected/76e349a0-97b7-44bc-8761-e78188280a33-kube-api-access-4xrkq\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-ovn\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526666 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-kubelet\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-lib-modules\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526791 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysctl-d\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-serviceca\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwwh\" (UniqueName: \"kubernetes.io/projected/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-kube-api-access-sqwwh\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-lib-modules\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.568174 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-systemd-units\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-registration-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-etc-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-node-log\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms6tv\" (UniqueName: \"kubernetes.io/projected/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-kube-api-access-ms6tv\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.526636 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-ovn\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-etc-openvswitch\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-systemd-units\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-env-overrides\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-host\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527149 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-registration-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-slash\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-node-log\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527243 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-host\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.569053 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-slash\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-systemd\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-run-systemd\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-ovnkube-script-lib\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-log-socket\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-systemd\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527411 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-device-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e843d703-bc03-42f5-bdce-f2000da916c1-ovn-node-metrics-cert\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-modprobe-d\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-ovnkube-config\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e843d703-bc03-42f5-bdce-f2000da916c1-log-socket\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysconfig\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.527572 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-env-overrides\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.569921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-sysconfig\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.527663 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:53.027642787 +0000 UTC m=+3.090594195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-modprobe-d\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76e349a0-97b7-44bc-8761-e78188280a33-etc-systemd\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-device-dir\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.527949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-ovnkube-script-lib\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.528120 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e843d703-bc03-42f5-bdce-f2000da916c1-ovnkube-config\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.529810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e349a0-97b7-44bc-8761-e78188280a33-tmp\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.531517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76e349a0-97b7-44bc-8761-e78188280a33-etc-tuned\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.531797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e843d703-bc03-42f5-bdce-f2000da916c1-ovn-node-metrics-cert\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.555894 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.555921 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.555936 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.556135 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:53.056107112 +0000 UTC m=+3.119058521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.558909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqqgh\" (UniqueName: \"kubernetes.io/projected/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-kube-api-access-jqqgh\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.559244 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwwh\" (UniqueName: \"kubernetes.io/projected/1de32d37-5cf2-45f3-ad91-6e8fdfcb5867-kube-api-access-sqwwh\") pod \"aws-ebs-csi-driver-node-dzfp5\" (UID: \"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.571853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.559841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms6tv\" (UniqueName: \"kubernetes.io/projected/2fdd69ca-c1e0-463c-b92b-1f67ae4440d9-kube-api-access-ms6tv\") pod \"iptables-alerter-rc5pb\" (UID: \"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9\") " pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.572968 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.560643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkv2g\" (UniqueName: \"kubernetes.io/projected/0a67156a-9db7-4747-ad82-b2e8e98b9fc3-kube-api-access-wkv2g\") pod \"node-ca-t44lb\" (UID: \"0a67156a-9db7-4747-ad82-b2e8e98b9fc3\") " pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.572968 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.561969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4wkc\" (UniqueName: \"kubernetes.io/projected/e843d703-bc03-42f5-bdce-f2000da916c1-kube-api-access-t4wkc\") pod \"ovnkube-node-8bgb7\" (UID: \"e843d703-bc03-42f5-bdce-f2000da916c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.572968 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.562225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xrkq\" (UniqueName: \"kubernetes.io/projected/76e349a0-97b7-44bc-8761-e78188280a33-kube-api-access-4xrkq\") pod \"tuned-fdd9g\" (UID: \"76e349a0-97b7-44bc-8761-e78188280a33\") " pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.663033 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.622347 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-klt62" Jul 08 17:38:52.663033 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.629534 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44qjc" Jul 08 17:38:52.663033 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:52.632338 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c3138a_3638_4230_ac62_62ff579b23e3.slice/crio-aad1fc23058f610d061701061000f6be128c4cc771580f0642722cdd440a9b4f WatchSource:0}: Error finding container aad1fc23058f610d061701061000f6be128c4cc771580f0642722cdd440a9b4f: Status 404 returned error can't find the container with id aad1fc23058f610d061701061000f6be128c4cc771580f0642722cdd440a9b4f Jul 08 17:38:52.663033 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.638983 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6m44h" Jul 08 17:38:52.663033 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.646104 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-slm9d" Jul 08 17:38:52.663033 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.654280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t44lb" Jul 08 17:38:52.669292 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.664062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" Jul 08 17:38:52.743339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.671836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" Jul 08 17:38:52.743339 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:52.673139 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c39a38_4a03_4003_b332_83717330276a.slice/crio-120561f223c651c9e131325a670e4200e46b3ece798fa0d233930f9b166b6548 WatchSource:0}: Error finding container 120561f223c651c9e131325a670e4200e46b3ece798fa0d233930f9b166b6548: Status 404 returned error can't find the container with id 120561f223c651c9e131325a670e4200e46b3ece798fa0d233930f9b166b6548 Jul 08 17:38:52.743339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.684072 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rc5pb" Jul 08 17:38:52.743339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.692051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:38:52.743339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.698822 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:38:52.743339 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:38:52.709327 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode843d703_bc03_42f5_bdce_f2000da916c1.slice/crio-6e83489ca16b2d93fd81dae090aeec5f17387f73e872c83312bbb909cb3f2b00 WatchSource:0}: Error finding container 6e83489ca16b2d93fd81dae090aeec5f17387f73e872c83312bbb909cb3f2b00: Status 404 returned error can't find the container with id 6e83489ca16b2d93fd81dae090aeec5f17387f73e872c83312bbb909cb3f2b00 Jul 08 17:38:52.955025 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:52.954979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:52.955221 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.955186 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:52.955290 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:52.955272 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:53.955248374 +0000 UTC m=+4.018199783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:53.055528 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.055434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:53.055706 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.055600 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:53.055706 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.055698 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:54.055677574 +0000 UTC m=+4.118628982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:53.156186 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.156137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:53.156403 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.156329 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:38:53.156403 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.156360 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:38:53.156403 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.156373 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:53.156522 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.156436 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:54.156416013 +0000 UTC m=+4.219367419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:53.412490 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.412356 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:33:52 +0000 UTC" deadline="2028-04-24 15:09:55.043798578 +0000 UTC" Jul 08 17:38:53.412490 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.412432 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15741h31m1.631370992s" Jul 08 17:38:53.460720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.460001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:53.460720 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.460151 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:38:53.460720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.460571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:53.460720 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.460681 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:38:53.472764 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.472714 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-klt62" event={"ID":"84c3138a-3638-4230-ac62-62ff579b23e3","Type":"ContainerStarted","Data":"aad1fc23058f610d061701061000f6be128c4cc771580f0642722cdd440a9b4f"} Jul 08 17:38:53.474916 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.474883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rc5pb" event={"ID":"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9","Type":"ContainerStarted","Data":"92ba64505da03233b6d27359cd833f842e34ba27f2ee3e3264e127f2a3a03df4"} Jul 08 17:38:53.476730 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.476468 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t44lb" event={"ID":"0a67156a-9db7-4747-ad82-b2e8e98b9fc3","Type":"ContainerStarted","Data":"b2b0f90f9f1daa7445e3321d4177fb67ef537029280648772dccdbd37547d984"} Jul 08 17:38:53.478047 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.478019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44qjc" event={"ID":"72c39a38-4a03-4003-b332-83717330276a","Type":"ContainerStarted","Data":"120561f223c651c9e131325a670e4200e46b3ece798fa0d233930f9b166b6548"} Jul 08 17:38:53.479971 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.479941 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"6e83489ca16b2d93fd81dae090aeec5f17387f73e872c83312bbb909cb3f2b00"} Jul 08 17:38:53.481970 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.481938 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" event={"ID":"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867","Type":"ContainerStarted","Data":"5bef8bee4e233101e1113751fbfd0de654954879c346eafb0341789d7d41e6b1"} Jul 08 17:38:53.483547 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.483517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" event={"ID":"76e349a0-97b7-44bc-8761-e78188280a33","Type":"ContainerStarted","Data":"cbcf14f2d08979035412f93e8544f18b05e175bf05b0cc9fa58acf27d66869af"} Jul 08 17:38:53.485030 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.485001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerStarted","Data":"c3ca83060e462f6f409f126c9dbbf26eea846e841bfe540c1118c46ba14aeff3"} Jul 08 17:38:53.486823 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.486772 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6m44h" event={"ID":"191bd147-76c5-44df-a1ec-7eba9a6d42c5","Type":"ContainerStarted","Data":"5027d1da0c4496877888c6b8be7b4763a25c62911b74fd76821890196c0cb711"} Jul 08 17:38:53.962952 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:53.962900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:53.963132 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.963052 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:53.963132 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:53.963119 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:55.963101162 +0000 UTC m=+6.026052570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:54.064239 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:54.063577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:54.064239 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.063820 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:54.064239 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.063886 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:56.063866779 +0000 UTC m=+6.126818188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:54.165656 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:54.165011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:54.165656 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.165179 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:38:54.165656 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.165199 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:38:54.165656 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.165213 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:54.165656 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.165275 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:56.16525453 +0000 UTC m=+6.228205940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:54.415367 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:54.412816 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:33:52 +0000 UTC" deadline="2028-04-03 15:16:07.93138814 +0000 UTC" Jul 08 17:38:54.415367 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:54.412863 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15237h37m13.518530153s" Jul 08 17:38:54.461216 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:54.460636 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:54.461216 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:54.460795 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:38:55.461073 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:55.460764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:55.461528 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:55.461169 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:38:55.461593 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:55.461572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:55.461730 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:55.461703 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:38:55.519654 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:55.515991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" event={"ID":"c0ce9e9a292ed52094c87bbcba5cc0e4","Type":"ContainerStarted","Data":"c4b03ede9941cb427d579f6ef8ffc2721eec8add4eba94492f7a9fe1680d778d"} Jul 08 17:38:55.528184 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:55.527739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" event={"ID":"38e3abca27644d830be1c35e80edb1bd","Type":"ContainerStarted","Data":"a2c2ea074cdb0bbdd908da3b7935f8fa122874b9d0fd563217cee3ab89e6b598"} Jul 08 17:38:55.552576 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:55.551727 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-203.ec2.internal" podStartSLOduration=4.551701524 podStartE2EDuration="4.551701524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:38:55.534800398 +0000 UTC m=+5.597751831" watchObservedRunningTime="2026-07-08 17:38:55.551701524 +0000 UTC m=+5.614652940" Jul 08 17:38:55.984378 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:55.984333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:55.984558 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:55.984537 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:55.984647 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:55.984603 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:38:59.984583364 +0000 UTC m=+10.047534757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:38:56.085739 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:56.085676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:56.085935 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.085909 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:56.085994 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.085978 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:00.085956804 +0000 UTC m=+10.148908216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:38:56.187019 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:56.186976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:56.187271 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.187250 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:38:56.187328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.187280 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:38:56.187328 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.187294 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:56.187440 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.187359 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:00.187340258 +0000 UTC m=+10.250291654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:38:56.462261 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:56.462228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:56.462769 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:56.462377 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:38:57.460357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:57.460317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:57.460357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:57.460346 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:57.460606 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:57.460466 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:38:57.460606 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:57.460568 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:38:58.461129 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:58.461094 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:38:58.461690 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:58.461250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:38:58.537132 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:58.537072 2559 generic.go:356] "Generic (PLEG): container finished" podID="38e3abca27644d830be1c35e80edb1bd" containerID="a2c2ea074cdb0bbdd908da3b7935f8fa122874b9d0fd563217cee3ab89e6b598" exitCode=0 Jul 08 17:38:58.537413 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:58.537148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" event={"ID":"38e3abca27644d830be1c35e80edb1bd","Type":"ContainerDied","Data":"a2c2ea074cdb0bbdd908da3b7935f8fa122874b9d0fd563217cee3ab89e6b598"} Jul 08 17:38:59.460061 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:59.459956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:38:59.460061 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:38:59.460008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:38:59.460309 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:59.460117 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:38:59.460591 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:38:59.460515 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:00.022876 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:00.022828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:00.023374 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.023010 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:39:00.023374 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.023092 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:08.023071819 +0000 UTC m=+18.086023213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:39:00.123976 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:00.123794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:00.124152 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.123984 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:39:00.124152 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.124064 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:08.124042825 +0000 UTC m=+18.186994239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:39:00.224401 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:00.224358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:00.224581 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.224566 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:39:00.224667 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.224589 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:39:00.224667 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.224603 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:39:00.224766 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.224686 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:08.22466807 +0000 UTC m=+18.287619464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:39:00.461446 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:00.460897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:00.461446 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:00.461032 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:01.460824 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:01.460788 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:01.461299 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:01.460936 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:01.461382 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:01.461327 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:01.461434 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:01.461410 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:02.460331 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:02.460291 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:02.460501 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:02.460444 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:03.460414 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:03.460374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:03.460873 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:03.460421 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:03.460873 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:03.460517 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:03.460873 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:03.460679 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:04.460654 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:04.460542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:04.461267 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:04.461224 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:05.460277 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:05.460236 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:05.460277 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:05.460262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:05.460503 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:05.460372 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:05.460503 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:05.460478 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:06.460077 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:06.460038 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:06.460555 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:06.460192 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:07.460268 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:07.460224 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:07.460764 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:07.460223 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:07.460764 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:07.460353 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:07.460764 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:07.460404 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:08.087916 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:08.087872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:08.088096 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.088002 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:39:08.088096 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.088065 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:24.088051803 +0000 UTC m=+34.151003198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:39:08.188379 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:08.188338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:08.188539 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.188515 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:39:08.188596 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.188584 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:24.188568718 +0000 UTC m=+34.251520108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:39:08.288897 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:08.288856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:08.289082 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.289051 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:39:08.289082 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.289078 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:39:08.289190 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.289093 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:39:08.289190 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.289163 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:24.289143462 +0000 UTC m=+34.352094871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:39:08.460471 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:08.460438 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:08.460938 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:08.460571 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:09.460245 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:09.460188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:09.460245 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:09.460228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:09.460471 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:09.460329 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:09.460471 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:09.460437 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:10.461760 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:10.461718 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:10.462235 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:10.461861 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:11.460909 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:11.460870 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:11.461086 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:11.460870 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:11.461086 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:11.461006 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:11.461184 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:11.461074 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:12.460260 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.459937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:12.460920 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:12.460348 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:12.590634 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.590591 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t44lb" event={"ID":"0a67156a-9db7-4747-ad82-b2e8e98b9fc3","Type":"ContainerStarted","Data":"8d2d87b6f1eca993385bce491b2ac5e305a296ba6e289ebe518d42fe2c8edfac"} Jul 08 17:39:12.592167 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.592135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44qjc" event={"ID":"72c39a38-4a03-4003-b332-83717330276a","Type":"ContainerStarted","Data":"b576e83f4a3703c6ea40485c4c9ddf77f836caa4dd099dd59658c72eedd6e0c5"} Jul 08 17:39:12.594062 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.594035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" event={"ID":"38e3abca27644d830be1c35e80edb1bd","Type":"ContainerStarted","Data":"cba2170b1f404bf7abb3ce7af26d4fc83a5bd7da296b326394cc718afb86bab9"} Jul 08 17:39:12.596424 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.596397 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"0bb0fc0a5ec57f81a09d8419bff05d5665c7c1fcb7ac09dbade87bf3d24920cb"} Jul 08 17:39:12.596548 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.596459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"e8b112a649dd1abc4381aefb5c4019c9f25605beae18717e1c12a70e68a8fc73"} Jul 08 17:39:12.596548 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.596501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"03df34a1592f45c9a84c9c176ded0f9dc00978bea92a47b6271e3044d8a1b076"} Jul 08 17:39:12.596548 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.596534 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"7bd3a126b0f8c04486929a873a2c259ba9b26683ab2c2d351cc15ef94f70758c"} Jul 08 17:39:12.597845 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.597821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" event={"ID":"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867","Type":"ContainerStarted","Data":"f37e85e9c111e927728810fb6f1599d15e044018683f7a667853571c78eeb0cb"} Jul 08 17:39:12.599040 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.599020 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" event={"ID":"76e349a0-97b7-44bc-8761-e78188280a33","Type":"ContainerStarted","Data":"f7c2fc8ef3a520e76d2ac4a80d623ea096df462809a1fa87128c4951aabc661b"} Jul 08 17:39:12.600322 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.600297 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f777e37-36c6-4066-a601-34e0603a63db" containerID="246106d96764ff0e8244c15565047459a3f23484439036f57863afd2119b7bad" exitCode=0 Jul 08 17:39:12.600422 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.600383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerDied","Data":"246106d96764ff0e8244c15565047459a3f23484439036f57863afd2119b7bad"} Jul 08 17:39:12.601845 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.601825 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6m44h" event={"ID":"191bd147-76c5-44df-a1ec-7eba9a6d42c5","Type":"ContainerStarted","Data":"9faac4b85351c6ebf2eb3088b668ab2cab8c56795c04c2a1ce60b52451ef0250"} Jul 08 17:39:12.603124 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.603106 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-klt62" event={"ID":"84c3138a-3638-4230-ac62-62ff579b23e3","Type":"ContainerStarted","Data":"bc70cfb69c9609afbd262a4ac33cb4e2d1ed53c9a00c9b25f66cb36dcb6ae6d6"} Jul 08 17:39:12.624329 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.624277 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t44lb" podStartSLOduration=3.36023058 podStartE2EDuration="22.624183561s" totalImagesPullingTime="19.263952981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:12.607341739 +0000 UTC m=+22.670293154" watchObservedRunningTime="2026-07-08 17:39:12.624183561 +0000 UTC m=+22.687134974" Jul 08 17:39:12.644739 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.644690 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-44qjc" podStartSLOduration=3.379262387 podStartE2EDuration="22.644672874s" totalImagesPullingTime="19.265410487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:12.624186857 +0000 UTC m=+22.687138271" watchObservedRunningTime="2026-07-08 17:39:12.644672874 +0000 UTC m=+22.707624288" Jul 08 17:39:12.660480 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.660434 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-203.ec2.internal" podStartSLOduration=21.660420145 podStartE2EDuration="21.660420145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:12.660110503 +0000 UTC m=+22.723061917" watchObservedRunningTime="2026-07-08 17:39:12.660420145 +0000 UTC m=+22.723371557" Jul 08 17:39:12.694309 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.694262 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-klt62" podStartSLOduration=8.0153465 podStartE2EDuration="22.694244769s" totalImagesPullingTime="14.678898269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:12.674325977 +0000 UTC m=+22.737277393" watchObservedRunningTime="2026-07-08 17:39:12.694244769 +0000 UTC m=+22.757196176" Jul 08 17:39:12.694966 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.694923 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6m44h" podStartSLOduration=3.394439506 podStartE2EDuration="22.694907534s" totalImagesPullingTime="19.300468028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:12.694391627 +0000 UTC m=+22.757343022" watchObservedRunningTime="2026-07-08 17:39:12.694907534 +0000 UTC m=+22.757858951" Jul 08 17:39:12.710764 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:12.710669 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fdd9g" podStartSLOduration=3.457167733 podStartE2EDuration="22.710652832s" totalImagesPullingTime="19.253485099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:12.710589013 +0000 UTC m=+22.773540425" watchObservedRunningTime="2026-07-08 17:39:12.710652832 +0000 UTC m=+22.773604238" Jul 08 17:39:13.460600 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.460566 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:13.461061 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:13.460682 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:13.461061 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.460758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:13.461061 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:13.460867 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:13.606825 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.606727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rc5pb" event={"ID":"2fdd69ca-c1e0-463c-b92b-1f67ae4440d9","Type":"ContainerStarted","Data":"9686ede0cb83420721720bbbb6c2edf0ee21d59a54bd309d2fba1d7025c0c4aa"} Jul 08 17:39:13.609468 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.609434 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"52101d888fa8679d8df65f8df355a835870636a0e4b24e6f705fb8bf024d55d6"} Jul 08 17:39:13.609616 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.609515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"31d40ef1eeaa3ab9c8628209838216e80241eb17ac1a097771b38e3108c82831"} Jul 08 17:39:13.624487 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.624433 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rc5pb" podStartSLOduration=4.386588186 podStartE2EDuration="23.624415096s" totalImagesPullingTime="19.23782691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:13.624348606 +0000 UTC m=+23.687300018" watchObservedRunningTime="2026-07-08 17:39:13.624415096 +0000 UTC m=+23.687366501" Jul 08 17:39:13.875977 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:13.875948 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:39:14.460905 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.460865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:14.461343 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:14.460981 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:14.467459 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.467357 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:39:13.875968661Z","UUID":"e6658113-b063-4851-a8ac-1e2b3a8505b0","Handler":null,"Name":"","Endpoint":""} Jul 08 17:39:14.469259 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.469234 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:39:14.469406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.469277 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:39:14.614142 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.614094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" event={"ID":"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867","Type":"ContainerStarted","Data":"8730758cdacb22fd971147fdc8925c68470580286ad302de1a9919a8a85a9560"} Jul 08 17:39:14.686982 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.686937 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-klt62" Jul 08 17:39:14.687615 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:14.687593 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-klt62" Jul 08 17:39:15.460484 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:15.460450 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:15.460705 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:15.460449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:15.460705 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:15.460563 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:15.460705 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:15.460643 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:15.621332 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:15.621057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"de471659e2adae70637a8d832041c436d0e068e1afe26de054d2bed9bb3b8bcf"} Jul 08 17:39:15.621837 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:15.621392 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-klt62" Jul 08 17:39:15.622301 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:15.622282 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-klt62" Jul 08 17:39:16.460759 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:16.460722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:16.460940 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:16.460840 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:16.626461 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:16.626427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" event={"ID":"1de32d37-5cf2-45f3-ad91-6e8fdfcb5867","Type":"ContainerStarted","Data":"4ae8ec836960a9552d1b2e532885486ed4955e6df288c2b792ac1c50049ee738"} Jul 08 17:39:16.648522 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:16.648467 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzfp5" podStartSLOduration=4.27434048 podStartE2EDuration="26.648448561s" totalImagesPullingTime="22.374108081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:16.648116543 +0000 UTC m=+26.711067957" watchObservedRunningTime="2026-07-08 17:39:16.648448561 +0000 UTC m=+26.711399973" Jul 08 17:39:17.460205 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:17.460154 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:17.460205 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:17.460180 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:17.460390 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:17.460292 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:17.460429 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:17.460408 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:17.634939 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:17.634897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" event={"ID":"e843d703-bc03-42f5-bdce-f2000da916c1","Type":"ContainerStarted","Data":"d0342f9aafe9e4d5da9acdad8d3247646d9748358dee27d1d4caa42f73367e48"} Jul 08 17:39:17.664833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:17.664779 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" podStartSLOduration=8.222973053 podStartE2EDuration="27.664764798s" totalImagesPullingTime="19.441791745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:17.664492245 +0000 UTC m=+27.727443658" watchObservedRunningTime="2026-07-08 17:39:17.664764798 +0000 UTC m=+27.727716211" Jul 08 17:39:18.460168 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:18.460131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:18.460361 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:18.460304 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:18.637680 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:18.637647 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:39:18.638134 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:18.637740 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:39:18.638134 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:18.637787 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:39:18.655558 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:18.655528 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:39:18.655754 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:18.655698 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:39:19.383166 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:19.383132 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lk652"] Jul 08 17:39:19.383382 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:19.383273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:19.383450 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:19.383386 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:19.385967 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:19.385933 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6w2cn"] Jul 08 17:39:19.386153 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:19.386137 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:19.386319 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:19.386270 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:19.386728 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:19.386699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xnln6"] Jul 08 17:39:19.386819 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:19.386795 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:19.386918 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:19.386895 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:21.461042 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:21.460777 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:21.461476 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:21.460811 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:21.461476 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:21.461148 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:21.461476 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:21.460831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:21.461476 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:21.461254 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:21.461476 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:21.461306 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:21.645402 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:21.645365 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f777e37-36c6-4066-a601-34e0603a63db" containerID="cf93486f7289963930f3a4b9eafa71e7e170d1732d697fa8cd31a401c10c9d9b" exitCode=0 Jul 08 17:39:21.645551 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:21.645410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerDied","Data":"cf93486f7289963930f3a4b9eafa71e7e170d1732d697fa8cd31a401c10c9d9b"} Jul 08 17:39:22.650137 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:22.650046 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f777e37-36c6-4066-a601-34e0603a63db" containerID="9ca8873be757ba15f14f099933f7e751cf01f45a9f5405cf5852888ea2011e77" exitCode=0 Jul 08 17:39:22.650137 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:22.650089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerDied","Data":"9ca8873be757ba15f14f099933f7e751cf01f45a9f5405cf5852888ea2011e77"} Jul 08 17:39:23.460308 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:23.460276 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:23.460308 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:23.460300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:23.460467 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:23.460300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:23.460467 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:23.460375 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6w2cn" podUID="59536c19-b784-4d77-91d4-09106131d9f7" Jul 08 17:39:23.460551 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:23.460459 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnln6" podUID="9b34a83d-5ed6-4a06-9532-c4de30c19cc2" Jul 08 17:39:23.460551 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:23.460526 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk652" podUID="deb22042-8c30-44e7-829d-a905c9957d53" Jul 08 17:39:23.655132 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:23.655046 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f777e37-36c6-4066-a601-34e0603a63db" containerID="f82f78045ac67203b116cbad864545eb06df5fa07ab3cad2a71abaab4675ba7f" exitCode=0 Jul 08 17:39:23.655132 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:23.655102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerDied","Data":"f82f78045ac67203b116cbad864545eb06df5fa07ab3cad2a71abaab4675ba7f"} Jul 08 17:39:24.112296 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.112261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:24.112460 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.112373 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:39:24.112460 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.112425 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret podName:deb22042-8c30-44e7-829d-a905c9957d53 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:56.11241307 +0000 UTC m=+66.175364475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret") pod "global-pull-secret-syncer-lk652" (UID: "deb22042-8c30-44e7-829d-a905c9957d53") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:39:24.213438 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.213392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:24.213592 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.213548 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:39:24.213670 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.213614 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs podName:9b34a83d-5ed6-4a06-9532-c4de30c19cc2 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:56.21359843 +0000 UTC m=+66.276549841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs") pod "network-metrics-daemon-xnln6" (UID: "9b34a83d-5ed6-4a06-9532-c4de30c19cc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:39:24.314396 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.314362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:24.314553 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.314532 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:39:24.314610 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.314558 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:39:24.314610 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.314569 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c6z2j for pod openshift-network-diagnostics/network-check-target-6w2cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:39:24.314696 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.314639 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j podName:59536c19-b784-4d77-91d4-09106131d9f7 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:56.314607819 +0000 UTC m=+66.377559209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6z2j" (UniqueName: "kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j") pod "network-check-target-6w2cn" (UID: "59536c19-b784-4d77-91d4-09106131d9f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:39:24.654038 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.654010 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-203.ec2.internal" event="NodeReady" Jul 08 17:39:24.654196 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.654151 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:39:24.693409 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.693373 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-564c45f46c-pxmjb"] Jul 08 17:39:24.695702 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.695679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.698229 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.698201 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:39:24.698357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.698256 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:39:24.698357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.698269 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-96l64\"" Jul 08 17:39:24.698357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.698308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:39:24.701592 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.701568 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tspzj"] Jul 08 17:39:24.703949 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.703872 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:39:24.704098 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.704076 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dv6gz"] Jul 08 17:39:24.704220 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.704202 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.705775 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.705754 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.707064 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.707048 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2bzl9\"" Jul 08 17:39:24.707549 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.707534 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:39:24.707656 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.707538 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:39:24.707973 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.707960 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:39:24.708346 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.708331 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tv27j\"" Jul 08 17:39:24.708429 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.708362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:39:24.708429 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.708363 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:39:24.712095 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.712071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-564c45f46c-pxmjb"] Jul 08 17:39:24.715408 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.715381 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tspzj"] Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.722930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f427dd9-325a-4670-a33a-b52cdd9e3b96-ca-trust-extracted\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.722978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-trusted-ca\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a9333-0484-40e1-b0ce-26ab57fc8848-tmp-dir\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2hl\" (UniqueName: \"kubernetes.io/projected/746d1e81-4e5c-48bc-9a98-455bc671e8b9-kube-api-access-pf2hl\") pod \"ingress-canary-dv6gz\" (UID: \"746d1e81-4e5c-48bc-9a98-455bc671e8b9\") " pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-bound-sa-token\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k24sl\" (UniqueName: \"kubernetes.io/projected/aa8a9333-0484-40e1-b0ce-26ab57fc8848-kube-api-access-k24sl\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-certificates\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8a9333-0484-40e1-b0ce-26ab57fc8848-config-volume\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-image-registry-private-configuration\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cjw\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-kube-api-access-h4cjw\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-installation-pull-secrets\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.725452 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.723328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746d1e81-4e5c-48bc-9a98-455bc671e8b9-cert\") pod \"ingress-canary-dv6gz\" (UID: \"746d1e81-4e5c-48bc-9a98-455bc671e8b9\") " pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.737168 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.736021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dv6gz"] Jul 08 17:39:24.824138 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8a9333-0484-40e1-b0ce-26ab57fc8848-config-volume\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.824138 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-image-registry-private-configuration\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cjw\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-kube-api-access-h4cjw\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824213 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-installation-pull-secrets\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746d1e81-4e5c-48bc-9a98-455bc671e8b9-cert\") pod \"ingress-canary-dv6gz\" (UID: \"746d1e81-4e5c-48bc-9a98-455bc671e8b9\") " pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f427dd9-325a-4670-a33a-b52cdd9e3b96-ca-trust-extracted\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-trusted-ca\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a9333-0484-40e1-b0ce-26ab57fc8848-tmp-dir\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.824356 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.824377 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564c45f46c-pxmjb: secret "image-registry-tls" not found Jul 08 17:39:24.824460 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.824453 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls podName:4f427dd9-325a-4670-a33a-b52cdd9e3b96 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:25.324432063 +0000 UTC m=+35.387383477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls") pod "image-registry-564c45f46c-pxmjb" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96") : secret "image-registry-tls" not found Jul 08 17:39:24.824921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2hl\" (UniqueName: \"kubernetes.io/projected/746d1e81-4e5c-48bc-9a98-455bc671e8b9-kube-api-access-pf2hl\") pod \"ingress-canary-dv6gz\" (UID: \"746d1e81-4e5c-48bc-9a98-455bc671e8b9\") " pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.824921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824541 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-bound-sa-token\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.824921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k24sl\" (UniqueName: \"kubernetes.io/projected/aa8a9333-0484-40e1-b0ce-26ab57fc8848-kube-api-access-k24sl\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.824921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-certificates\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.824921 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8a9333-0484-40e1-b0ce-26ab57fc8848-config-volume\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.825274 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.824954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f427dd9-325a-4670-a33a-b52cdd9e3b96-ca-trust-extracted\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.825274 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.825011 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a9333-0484-40e1-b0ce-26ab57fc8848-tmp-dir\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.825274 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.825096 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:39:24.825274 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:24.825146 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls podName:aa8a9333-0484-40e1-b0ce-26ab57fc8848 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:25.325129441 +0000 UTC m=+35.388080847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls") pod "dns-default-tspzj" (UID: "aa8a9333-0484-40e1-b0ce-26ab57fc8848") : secret "dns-default-metrics-tls" not found Jul 08 17:39:24.825274 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.825248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-certificates\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.825749 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.825726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-trusted-ca\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.829413 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.829387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746d1e81-4e5c-48bc-9a98-455bc671e8b9-cert\") pod \"ingress-canary-dv6gz\" (UID: \"746d1e81-4e5c-48bc-9a98-455bc671e8b9\") " pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.829555 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.829387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-installation-pull-secrets\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.829555 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.829392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-image-registry-private-configuration\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.851368 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.851315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-bound-sa-token\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:24.851649 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.851597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k24sl\" (UniqueName: \"kubernetes.io/projected/aa8a9333-0484-40e1-b0ce-26ab57fc8848-kube-api-access-k24sl\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:24.851736 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.851614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2hl\" (UniqueName: \"kubernetes.io/projected/746d1e81-4e5c-48bc-9a98-455bc671e8b9-kube-api-access-pf2hl\") pod \"ingress-canary-dv6gz\" (UID: \"746d1e81-4e5c-48bc-9a98-455bc671e8b9\") " pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:24.851843 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:24.851802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cjw\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-kube-api-access-h4cjw\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:25.046652 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.046601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dv6gz" Jul 08 17:39:25.197160 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.196968 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dv6gz"] Jul 08 17:39:25.200619 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:25.200593 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746d1e81_4e5c_48bc_9a98_455bc671e8b9.slice/crio-5da14af3c4d82826a08265feb1b8ad8744367320bb6c6aa3011e00d4856dd639 WatchSource:0}: Error finding container 5da14af3c4d82826a08265feb1b8ad8744367320bb6c6aa3011e00d4856dd639: Status 404 returned error can't find the container with id 5da14af3c4d82826a08265feb1b8ad8744367320bb6c6aa3011e00d4856dd639 Jul 08 17:39:25.329434 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.329396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:25.329598 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:25.329509 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:39:25.329598 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:25.329524 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564c45f46c-pxmjb: secret "image-registry-tls" not found Jul 08 17:39:25.329598 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.329546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:25.329598 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:25.329572 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls podName:4f427dd9-325a-4670-a33a-b52cdd9e3b96 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:26.329558594 +0000 UTC m=+36.392510023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls") pod "image-registry-564c45f46c-pxmjb" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96") : secret "image-registry-tls" not found Jul 08 17:39:25.329767 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:25.329640 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:39:25.330033 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:25.330017 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls podName:aa8a9333-0484-40e1-b0ce-26ab57fc8848 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:26.329686041 +0000 UTC m=+36.392637454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls") pod "dns-default-tspzj" (UID: "aa8a9333-0484-40e1-b0ce-26ab57fc8848") : secret "dns-default-metrics-tls" not found Jul 08 17:39:25.460659 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.460607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:25.460843 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.460707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:25.460843 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.460809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:25.463519 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.463492 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:39:25.463691 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.463552 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jwhsf\"" Jul 08 17:39:25.463691 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.463581 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:39:25.463812 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.463801 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d5skf\"" Jul 08 17:39:25.463906 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.463892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:39:25.464001 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.463987 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:39:25.661365 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:25.661272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dv6gz" event={"ID":"746d1e81-4e5c-48bc-9a98-455bc671e8b9","Type":"ContainerStarted","Data":"5da14af3c4d82826a08265feb1b8ad8744367320bb6c6aa3011e00d4856dd639"} Jul 08 17:39:26.339435 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:26.339390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:26.340100 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:26.339485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:26.340100 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:26.339546 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:39:26.340100 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:26.339570 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564c45f46c-pxmjb: secret "image-registry-tls" not found Jul 08 17:39:26.340100 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:26.339651 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls podName:4f427dd9-325a-4670-a33a-b52cdd9e3b96 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:28.339615419 +0000 UTC m=+38.402566826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls") pod "image-registry-564c45f46c-pxmjb" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96") : secret "image-registry-tls" not found Jul 08 17:39:26.340100 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:26.339665 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:39:26.340100 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:26.339732 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls podName:aa8a9333-0484-40e1-b0ce-26ab57fc8848 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:28.339714683 +0000 UTC m=+38.402666091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls") pod "dns-default-tspzj" (UID: "aa8a9333-0484-40e1-b0ce-26ab57fc8848") : secret "dns-default-metrics-tls" not found Jul 08 17:39:28.357729 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:28.357689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:28.358128 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:28.357749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:28.358128 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:28.357849 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:39:28.358128 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:28.357906 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls podName:aa8a9333-0484-40e1-b0ce-26ab57fc8848 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:32.357893256 +0000 UTC m=+42.420844661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls") pod "dns-default-tspzj" (UID: "aa8a9333-0484-40e1-b0ce-26ab57fc8848") : secret "dns-default-metrics-tls" not found Jul 08 17:39:28.358128 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:28.357849 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:39:28.358128 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:28.357958 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564c45f46c-pxmjb: secret "image-registry-tls" not found Jul 08 17:39:28.358128 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:28.358013 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls podName:4f427dd9-325a-4670-a33a-b52cdd9e3b96 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:32.357999383 +0000 UTC m=+42.420950773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls") pod "image-registry-564c45f46c-pxmjb" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96") : secret "image-registry-tls" not found Jul 08 17:39:28.671386 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:28.671281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dv6gz" event={"ID":"746d1e81-4e5c-48bc-9a98-455bc671e8b9","Type":"ContainerStarted","Data":"dfd49cd68c324ffa45dc8759cbcd8810e4d2610d993821bb6651057c691014d5"} Jul 08 17:39:28.691590 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:28.691527 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dv6gz" podStartSLOduration=2.085648291 podStartE2EDuration="4.691509156s" totalImagesPullingTime="2.605860865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:28.689950834 +0000 UTC m=+38.752902246" watchObservedRunningTime="2026-07-08 17:39:28.691509156 +0000 UTC m=+38.754460599" Jul 08 17:39:31.681611 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:31.681581 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f777e37-36c6-4066-a601-34e0603a63db" containerID="260c8ff9815a8ee866b34233261e866d03077914a3faab8f773b556fc616dd54" exitCode=0 Jul 08 17:39:31.682015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:31.681671 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerDied","Data":"260c8ff9815a8ee866b34233261e866d03077914a3faab8f773b556fc616dd54"} Jul 08 17:39:32.391843 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:32.391807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:32.392039 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:32.391871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:32.392039 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:32.391956 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:39:32.392039 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:32.391962 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:39:32.392039 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:32.391980 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564c45f46c-pxmjb: secret "image-registry-tls" not found Jul 08 17:39:32.392039 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:32.392008 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls podName:aa8a9333-0484-40e1-b0ce-26ab57fc8848 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:40.391995393 +0000 UTC m=+50.454946816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls") pod "dns-default-tspzj" (UID: "aa8a9333-0484-40e1-b0ce-26ab57fc8848") : secret "dns-default-metrics-tls" not found Jul 08 17:39:32.392039 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:32.392026 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls podName:4f427dd9-325a-4670-a33a-b52cdd9e3b96 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:40.3920141 +0000 UTC m=+50.454965491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls") pod "image-registry-564c45f46c-pxmjb" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96") : secret "image-registry-tls" not found Jul 08 17:39:32.687209 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:32.687169 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f777e37-36c6-4066-a601-34e0603a63db" containerID="ac65c0e1b768e1327f9a838cc29132fbc117fac4373d57c6bbfdf915fd59e589" exitCode=0 Jul 08 17:39:32.687612 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:32.687223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerDied","Data":"ac65c0e1b768e1327f9a838cc29132fbc117fac4373d57c6bbfdf915fd59e589"} Jul 08 17:39:33.693320 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:33.693278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slm9d" event={"ID":"7f777e37-36c6-4066-a601-34e0603a63db","Type":"ContainerStarted","Data":"5b498c486eee1790d4f8c52d9cd254f6e0a371732f7adb72de5ebfa3b9111b8c"} Jul 08 17:39:33.717852 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:33.717695 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-slm9d" podStartSLOduration=7.330659215 podStartE2EDuration="43.717675154s" totalImagesPullingTime="36.387015939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:33.71724834 +0000 UTC m=+43.780199753" watchObservedRunningTime="2026-07-08 17:39:33.717675154 +0000 UTC m=+43.780626568" Jul 08 17:39:34.525719 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.525680 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb"] Jul 08 17:39:34.558234 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.558196 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb"] Jul 08 17:39:34.558398 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.558328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" Jul 08 17:39:34.561015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.560983 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 17:39:34.561015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.561007 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 17:39:34.561879 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.561860 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xjhgv\"" Jul 08 17:39:34.600546 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.600507 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fm2m7"] Jul 08 17:39:34.608954 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.608919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rj2d\" (UniqueName: \"kubernetes.io/projected/aaa2c201-e010-4a0b-a510-9783929f9d70-kube-api-access-2rj2d\") pod \"migrator-d57d58cc9-7dpnb\" (UID: \"aaa2c201-e010-4a0b-a510-9783929f9d70\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" Jul 08 17:39:34.621885 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.621856 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fm2m7"] Jul 08 17:39:34.622070 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.621998 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.624964 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.624939 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 17:39:34.625239 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.625216 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 17:39:34.625345 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.625222 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2ql9\"" Jul 08 17:39:34.625345 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.625323 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 17:39:34.625433 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.625346 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 17:39:34.710260 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.710216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rj2d\" (UniqueName: \"kubernetes.io/projected/aaa2c201-e010-4a0b-a510-9783929f9d70-kube-api-access-2rj2d\") pod \"migrator-d57d58cc9-7dpnb\" (UID: \"aaa2c201-e010-4a0b-a510-9783929f9d70\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" Jul 08 17:39:34.710260 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.710264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c26cb933-469c-4e86-8f97-11ff7da58cd8-crio-socket\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.710736 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.710284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26cb933-469c-4e86-8f97-11ff7da58cd8-data-volume\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.710736 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.710409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.710736 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.710479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.710736 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.710554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ntm9\" (UniqueName: \"kubernetes.io/projected/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-api-access-6ntm9\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.723963 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.723928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rj2d\" (UniqueName: \"kubernetes.io/projected/aaa2c201-e010-4a0b-a510-9783929f9d70-kube-api-access-2rj2d\") pod \"migrator-d57d58cc9-7dpnb\" (UID: \"aaa2c201-e010-4a0b-a510-9783929f9d70\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" Jul 08 17:39:34.811810 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.811731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c26cb933-469c-4e86-8f97-11ff7da58cd8-crio-socket\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.811810 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.811775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26cb933-469c-4e86-8f97-11ff7da58cd8-data-volume\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.811810 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.811801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.812038 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.811862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.812038 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.811954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c26cb933-469c-4e86-8f97-11ff7da58cd8-crio-socket\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.812038 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:34.811972 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:39:34.812038 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:34.811981 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:39:34.812038 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.811961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ntm9\" (UniqueName: \"kubernetes.io/projected/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-api-access-6ntm9\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.812264 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:34.812044 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:35.31202472 +0000 UTC m=+45.374976125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : secret "insights-runtime-extractor-tls" not found Jul 08 17:39:34.812264 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:34.812070 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:35.312059567 +0000 UTC m=+45.375010962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : configmap "kube-rbac-proxy" not found Jul 08 17:39:34.812264 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.812112 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c26cb933-469c-4e86-8f97-11ff7da58cd8-data-volume\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.825300 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.825264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ntm9\" (UniqueName: \"kubernetes.io/projected/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-api-access-6ntm9\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:34.867454 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:34.867418 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" Jul 08 17:39:35.022405 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:35.022369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb"] Jul 08 17:39:35.026306 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:35.026278 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa2c201_e010_4a0b_a510_9783929f9d70.slice/crio-dcaced3d5a8fdeece6053a4c79bca9152d25b2eb975b7241e72478cf0d69fbbb WatchSource:0}: Error finding container dcaced3d5a8fdeece6053a4c79bca9152d25b2eb975b7241e72478cf0d69fbbb: Status 404 returned error can't find the container with id dcaced3d5a8fdeece6053a4c79bca9152d25b2eb975b7241e72478cf0d69fbbb Jul 08 17:39:35.315334 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:35.315288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:35.315543 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:35.315348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:35.315543 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:35.315440 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:39:35.315543 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:35.315460 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:39:35.315543 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:35.315511 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:36.31549218 +0000 UTC m=+46.378443585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : configmap "kube-rbac-proxy" not found Jul 08 17:39:35.315543 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:35.315529 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:36.315520102 +0000 UTC m=+46.378471499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : secret "insights-runtime-extractor-tls" not found Jul 08 17:39:35.699322 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:35.699284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" event={"ID":"aaa2c201-e010-4a0b-a510-9783929f9d70","Type":"ContainerStarted","Data":"dcaced3d5a8fdeece6053a4c79bca9152d25b2eb975b7241e72478cf0d69fbbb"} Jul 08 17:39:36.324572 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.324532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:36.325008 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.324586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:36.325008 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:36.324676 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:39:36.325008 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:36.324724 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:39:36.325008 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:36.324742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:38.324721606 +0000 UTC m=+48.387673014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : configmap "kube-rbac-proxy" not found Jul 08 17:39:36.325008 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:36.324778 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:38.324765664 +0000 UTC m=+48.387717054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : secret "insights-runtime-extractor-tls" not found Jul 08 17:39:36.640446 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.640346 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dgtqh"] Jul 08 17:39:36.646963 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.646934 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.650095 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.650060 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 17:39:36.650756 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.650731 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 17:39:36.650756 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.650749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gjkwm\"" Jul 08 17:39:36.650947 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.650819 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 17:39:36.651004 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.650988 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dgtqh"] Jul 08 17:39:36.651079 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.651058 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 17:39:36.728888 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.728843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-signing-key\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.728888 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.728896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-signing-cabundle\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.729151 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.728928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzq4v\" (UniqueName: \"kubernetes.io/projected/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-kube-api-access-pzq4v\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.829648 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.829581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-signing-key\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.829648 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.829653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-signing-cabundle\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.829898 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.829677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzq4v\" (UniqueName: \"kubernetes.io/projected/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-kube-api-access-pzq4v\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.830425 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.830403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-signing-cabundle\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.832039 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.832017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-signing-key\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.839523 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.839496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzq4v\" (UniqueName: \"kubernetes.io/projected/18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7-kube-api-access-pzq4v\") pod \"service-ca-758f599c5-dgtqh\" (UID: \"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7\") " pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:36.959068 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:36.959036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dgtqh" Jul 08 17:39:37.000096 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:37.000066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44qjc_72c39a38-4a03-4003-b332-83717330276a/dns-node-resolver/0.log" Jul 08 17:39:37.270586 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:37.270553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dgtqh"] Jul 08 17:39:37.273285 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:37.273260 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bb7aed_e6ec_4d83_9e10_ca8e2ae028b7.slice/crio-1a97c8a0d344c6fe66a25887bdb22e9732ceab2e450220e7edb66c79ce19f8b4 WatchSource:0}: Error finding container 1a97c8a0d344c6fe66a25887bdb22e9732ceab2e450220e7edb66c79ce19f8b4: Status 404 returned error can't find the container with id 1a97c8a0d344c6fe66a25887bdb22e9732ceab2e450220e7edb66c79ce19f8b4 Jul 08 17:39:37.706385 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:37.706342 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" event={"ID":"aaa2c201-e010-4a0b-a510-9783929f9d70","Type":"ContainerStarted","Data":"32a5cefda01f3ed768751a488a5af5dfba410e55bf50c49f2b88262655e3cf02"} Jul 08 17:39:37.706912 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:37.706411 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" event={"ID":"aaa2c201-e010-4a0b-a510-9783929f9d70","Type":"ContainerStarted","Data":"48d80ee89e58f11985437b565e171acd4a62e72ebc12f1642e683a26de855a05"} Jul 08 17:39:37.707598 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:37.707573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dgtqh" event={"ID":"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7","Type":"ContainerStarted","Data":"1a97c8a0d344c6fe66a25887bdb22e9732ceab2e450220e7edb66c79ce19f8b4"} Jul 08 17:39:37.729070 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:37.729013 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dpnb" podStartSLOduration=1.6124038280000001 podStartE2EDuration="3.728996559s" totalImagesPullingTime="2.116592731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:37.728684167 +0000 UTC m=+47.791635605" watchObservedRunningTime="2026-07-08 17:39:37.728996559 +0000 UTC m=+47.791947971" Jul 08 17:39:38.200528 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:38.200498 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t44lb_0a67156a-9db7-4747-ad82-b2e8e98b9fc3/node-ca/0.log" Jul 08 17:39:38.342243 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:38.342197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:38.342437 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:38.342337 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:39:38.342437 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:38.342357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:38.342437 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:38.342406 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:42.342387177 +0000 UTC m=+52.405338567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : configmap "kube-rbac-proxy" not found Jul 08 17:39:38.342609 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:38.342469 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:39:38.342609 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:38.342518 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:42.342506575 +0000 UTC m=+52.405457965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : secret "insights-runtime-extractor-tls" not found Jul 08 17:39:38.600702 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:38.600602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dv6gz_746d1e81-4e5c-48bc-9a98-455bc671e8b9/serve-healthcheck-canary/0.log" Jul 08 17:39:39.002195 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:39.002166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7dpnb_aaa2c201-e010-4a0b-a510-9783929f9d70/migrator/0.log" Jul 08 17:39:39.200242 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:39.200207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7dpnb_aaa2c201-e010-4a0b-a510-9783929f9d70/graceful-termination/0.log" Jul 08 17:39:40.460232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:40.460198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:40.460753 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:40.460308 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:40.460753 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:40.460360 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:39:40.460753 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:40.460424 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:39:40.460753 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:40.460443 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564c45f46c-pxmjb: secret "image-registry-tls" not found Jul 08 17:39:40.460753 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:40.460447 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls podName:aa8a9333-0484-40e1-b0ce-26ab57fc8848 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:56.460425788 +0000 UTC m=+66.523377197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls") pod "dns-default-tspzj" (UID: "aa8a9333-0484-40e1-b0ce-26ab57fc8848") : secret "dns-default-metrics-tls" not found Jul 08 17:39:40.460753 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:40.460494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls podName:4f427dd9-325a-4670-a33a-b52cdd9e3b96 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:56.460477376 +0000 UTC m=+66.523428784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls") pod "image-registry-564c45f46c-pxmjb" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96") : secret "image-registry-tls" not found Jul 08 17:39:40.718155 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:40.718064 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dgtqh" event={"ID":"18bb7aed-e6ec-4d83-9e10-ca8e2ae028b7","Type":"ContainerStarted","Data":"32f1fda1b8cc16accc69a9a87446868162595c7d87c52a51e83a69e349220222"} Jul 08 17:39:42.380551 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:42.380500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:42.381141 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:42.380565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:42.381141 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:42.380683 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:39:42.381141 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:42.380758 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:50.38073974 +0000 UTC m=+60.443691132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : configmap "kube-rbac-proxy" not found Jul 08 17:39:42.381141 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:42.380684 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:39:42.381141 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:42.380834 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:39:50.380819308 +0000 UTC m=+60.443770718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : secret "insights-runtime-extractor-tls" not found Jul 08 17:39:50.453513 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:50.453480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:50.454114 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:50.453527 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:50.454114 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:50.453640 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:39:50.454114 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:50.453701 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls podName:c26cb933-469c-4e86-8f97-11ff7da58cd8 nodeName:}" failed. No retries permitted until 2026-07-08 17:40:06.453686546 +0000 UTC m=+76.516637937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fm2m7" (UID: "c26cb933-469c-4e86-8f97-11ff7da58cd8") : secret "insights-runtime-extractor-tls" not found Jul 08 17:39:50.454114 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:50.453969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c26cb933-469c-4e86-8f97-11ff7da58cd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:39:50.654287 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:50.654254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bgb7" Jul 08 17:39:50.684235 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:50.684171 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-dgtqh" podStartSLOduration=11.982825262 podStartE2EDuration="14.684154623s" totalImagesPullingTime="2.701329361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:40.736859434 +0000 UTC m=+50.799810848" watchObservedRunningTime="2026-07-08 17:39:50.684154623 +0000 UTC m=+60.747106035" Jul 08 17:39:56.128538 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.128498 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf"] Jul 08 17:39:56.131646 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.131606 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc"] Jul 08 17:39:56.131809 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.131725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.134018 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.133993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.134988 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.134960 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 17:39:56.135122 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.134995 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj"] Jul 08 17:39:56.135122 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.134963 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 17:39:56.135122 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.135038 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-25g4g\"" Jul 08 17:39:56.136804 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.136784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 17:39:56.136965 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.136950 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nvndd\"" Jul 08 17:39:56.137088 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.136999 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 17:39:56.137088 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.137071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.137252 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.137213 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 17:39:56.137311 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.137279 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 17:39:56.140284 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.140267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 17:39:56.140595 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.140582 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 17:39:56.140679 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.140634 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 17:39:56.140845 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.140831 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 17:39:56.144423 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.144401 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf"] Jul 08 17:39:56.150073 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.150035 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc"] Jul 08 17:39:56.157411 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.157379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj"] Jul 08 17:39:56.197944 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.197907 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-564c45f46c-pxmjb"] Jul 08 17:39:56.198154 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:39:56.198133 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" podUID="4f427dd9-325a-4670-a33a-b52cdd9e3b96" Jul 08 17:39:56.201783 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.201742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:56.204091 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.204075 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:39:56.214750 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.214726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/deb22042-8c30-44e7-829d-a905c9957d53-original-pull-secret\") pod \"global-pull-secret-syncer-lk652\" (UID: \"deb22042-8c30-44e7-829d-a905c9957d53\") " pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:56.302406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.302406 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.302616 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:56.302616 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mm8\" (UniqueName: \"kubernetes.io/projected/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-kube-api-access-q6mm8\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.302616 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aff18aa4-fee8-49c7-ba03-85a9d241fd7c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-649d5445cb-ds2mc\" (UID: \"aff18aa4-fee8-49c7-ba03-85a9d241fd7c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.302752 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-ca\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.302752 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-hub\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.302752 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzngd\" (UniqueName: \"kubernetes.io/projected/aff18aa4-fee8-49c7-ba03-85a9d241fd7c-kube-api-access-fzngd\") pod \"managed-serviceaccount-addon-agent-649d5445cb-ds2mc\" (UID: \"aff18aa4-fee8-49c7-ba03-85a9d241fd7c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.302844 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/af30f307-3c91-4cda-b6b7-74e2972db207-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2nlqf\" (UID: \"af30f307-3c91-4cda-b6b7-74e2972db207\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.302844 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302833 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.302906 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.302852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/af30f307-3c91-4cda-b6b7-74e2972db207-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2nlqf\" (UID: \"af30f307-3c91-4cda-b6b7-74e2972db207\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.305351 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.305332 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:39:56.315467 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.315421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b34a83d-5ed6-4a06-9532-c4de30c19cc2-metrics-certs\") pod \"network-metrics-daemon-xnln6\" (UID: \"9b34a83d-5ed6-4a06-9532-c4de30c19cc2\") " pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:56.332858 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.332822 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f9cc9f-p752f"] Jul 08 17:39:56.335210 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.335190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.350085 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.350054 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f9cc9f-p752f"] Jul 08 17:39:56.380565 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.380481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk652" Jul 08 17:39:56.387519 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.387492 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d5skf\"" Jul 08 17:39:56.395559 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.395527 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnln6" Jul 08 17:39:56.403816 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.403784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mm8\" (UniqueName: \"kubernetes.io/projected/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-kube-api-access-q6mm8\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.403976 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.403836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aff18aa4-fee8-49c7-ba03-85a9d241fd7c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-649d5445cb-ds2mc\" (UID: \"aff18aa4-fee8-49c7-ba03-85a9d241fd7c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.403976 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.403865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-ca\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.403976 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.403925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-hub\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.403976 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.403965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzngd\" (UniqueName: \"kubernetes.io/projected/aff18aa4-fee8-49c7-ba03-85a9d241fd7c-kube-api-access-fzngd\") pod \"managed-serviceaccount-addon-agent-649d5445cb-ds2mc\" (UID: \"aff18aa4-fee8-49c7-ba03-85a9d241fd7c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.404310 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.404001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/af30f307-3c91-4cda-b6b7-74e2972db207-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2nlqf\" (UID: \"af30f307-3c91-4cda-b6b7-74e2972db207\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.404310 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.404088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:56.404310 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.404116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.404310 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.404142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/af30f307-3c91-4cda-b6b7-74e2972db207-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2nlqf\" (UID: \"af30f307-3c91-4cda-b6b7-74e2972db207\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.404310 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.404197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.404310 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.404226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.405891 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.405773 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.405891 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.405828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/af30f307-3c91-4cda-b6b7-74e2972db207-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2nlqf\" (UID: \"af30f307-3c91-4cda-b6b7-74e2972db207\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.406956 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.406918 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:39:56.407543 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.407494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-hub\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.408543 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.408417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/af30f307-3c91-4cda-b6b7-74e2972db207-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2nlqf\" (UID: \"af30f307-3c91-4cda-b6b7-74e2972db207\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.408543 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.408504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aff18aa4-fee8-49c7-ba03-85a9d241fd7c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-649d5445cb-ds2mc\" (UID: \"aff18aa4-fee8-49c7-ba03-85a9d241fd7c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.408543 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.408519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-ca\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.408988 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.408971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.409702 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.409616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.418186 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.418154 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:39:56.418337 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.418168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mm8\" (UniqueName: \"kubernetes.io/projected/3e3b0d97-d085-4ff0-a989-a746a8d83fd7-kube-api-access-q6mm8\") pod \"cluster-proxy-proxy-agent-7c648fd7b9-nhdnj\" (UID: \"3e3b0d97-d085-4ff0-a989-a746a8d83fd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.418946 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.418907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzngd\" (UniqueName: \"kubernetes.io/projected/aff18aa4-fee8-49c7-ba03-85a9d241fd7c-kube-api-access-fzngd\") pod \"managed-serviceaccount-addon-agent-649d5445cb-ds2mc\" (UID: \"aff18aa4-fee8-49c7-ba03-85a9d241fd7c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.428305 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.428267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6z2j\" (UniqueName: \"kubernetes.io/projected/59536c19-b784-4d77-91d4-09106131d9f7-kube-api-access-c6z2j\") pod \"network-check-target-6w2cn\" (UID: \"59536c19-b784-4d77-91d4-09106131d9f7\") " pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:56.442854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.442817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" Jul 08 17:39:56.460830 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.460799 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" Jul 08 17:39:56.467287 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.466997 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" Jul 08 17:39:56.505399 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-registry-tls\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505399 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/771fdf55-2329-4670-b2c4-ca5022ab37d0-installation-pull-secrets\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505399 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-bound-sa-token\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505399 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqpp7\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-kube-api-access-qqpp7\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/771fdf55-2329-4670-b2c4-ca5022ab37d0-image-registry-private-configuration\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/771fdf55-2329-4670-b2c4-ca5022ab37d0-trusted-ca\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:56.505854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/771fdf55-2329-4670-b2c4-ca5022ab37d0-registry-certificates\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.505854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:56.505854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.505684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/771fdf55-2329-4670-b2c4-ca5022ab37d0-ca-trust-extracted\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.509703 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.509614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8a9333-0484-40e1-b0ce-26ab57fc8848-metrics-tls\") pod \"dns-default-tspzj\" (UID: \"aa8a9333-0484-40e1-b0ce-26ab57fc8848\") " pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:56.510688 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.510588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"image-registry-564c45f46c-pxmjb\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:56.543874 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.543778 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2bzl9\"" Jul 08 17:39:56.548853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.547571 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lk652"] Jul 08 17:39:56.548853 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.547802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tspzj" Jul 08 17:39:56.551519 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.551485 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb22042_8c30_44e7_829d_a905c9957d53.slice/crio-9ca425010bb7f4edcdcd99d614b2f1784430dca5f3ca5c67625ef9ee6c14f3d1 WatchSource:0}: Error finding container 9ca425010bb7f4edcdcd99d614b2f1784430dca5f3ca5c67625ef9ee6c14f3d1: Status 404 returned error can't find the container with id 9ca425010bb7f4edcdcd99d614b2f1784430dca5f3ca5c67625ef9ee6c14f3d1 Jul 08 17:39:56.580357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.580206 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xnln6"] Jul 08 17:39:56.588687 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.588615 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b34a83d_5ed6_4a06_9532_c4de30c19cc2.slice/crio-9d1cb7eefb7b4242f69ff7c5ae8f1c75263fcd80110ea598b71bfe74e707acf6 WatchSource:0}: Error finding container 9d1cb7eefb7b4242f69ff7c5ae8f1c75263fcd80110ea598b71bfe74e707acf6: Status 404 returned error can't find the container with id 9d1cb7eefb7b4242f69ff7c5ae8f1c75263fcd80110ea598b71bfe74e707acf6 Jul 08 17:39:56.606685 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/771fdf55-2329-4670-b2c4-ca5022ab37d0-registry-certificates\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.606685 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/771fdf55-2329-4670-b2c4-ca5022ab37d0-ca-trust-extracted\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.606685 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-registry-tls\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.606685 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/771fdf55-2329-4670-b2c4-ca5022ab37d0-installation-pull-secrets\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.606685 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-bound-sa-token\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.607073 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqpp7\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-kube-api-access-qqpp7\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.607073 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/771fdf55-2329-4670-b2c4-ca5022ab37d0-image-registry-private-configuration\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.607073 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.606813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/771fdf55-2329-4670-b2c4-ca5022ab37d0-trusted-ca\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.609714 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.608433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/771fdf55-2329-4670-b2c4-ca5022ab37d0-registry-certificates\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.609714 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.609678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/771fdf55-2329-4670-b2c4-ca5022ab37d0-ca-trust-extracted\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.615383 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.610444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/771fdf55-2329-4670-b2c4-ca5022ab37d0-trusted-ca\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.620110 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.619475 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/771fdf55-2329-4670-b2c4-ca5022ab37d0-installation-pull-secrets\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.620739 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.620133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/771fdf55-2329-4670-b2c4-ca5022ab37d0-image-registry-private-configuration\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.624389 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.622900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-registry-tls\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.628230 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.628131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqpp7\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-kube-api-access-qqpp7\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.632215 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.632135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/771fdf55-2329-4670-b2c4-ca5022ab37d0-bound-sa-token\") pod \"image-registry-59f9cc9f-p752f\" (UID: \"771fdf55-2329-4670-b2c4-ca5022ab37d0\") " pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.658708 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.658680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc"] Jul 08 17:39:56.661439 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.661407 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaff18aa4_fee8_49c7_ba03_85a9d241fd7c.slice/crio-17083736d51f33552dd7a982a9b1535b78810b6bf994db5c7bb94e93f8a72230 WatchSource:0}: Error finding container 17083736d51f33552dd7a982a9b1535b78810b6bf994db5c7bb94e93f8a72230: Status 404 returned error can't find the container with id 17083736d51f33552dd7a982a9b1535b78810b6bf994db5c7bb94e93f8a72230 Jul 08 17:39:56.666095 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.666009 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-96l64\"" Jul 08 17:39:56.667737 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.667710 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf"] Jul 08 17:39:56.668790 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.668764 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj"] Jul 08 17:39:56.669192 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.669162 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf30f307_3c91_4cda_b6b7_74e2972db207.slice/crio-62c3a96769a68e6828866db16a6880c3c698993883fb08ec21a568eb948c88d6 WatchSource:0}: Error finding container 62c3a96769a68e6828866db16a6880c3c698993883fb08ec21a568eb948c88d6: Status 404 returned error can't find the container with id 62c3a96769a68e6828866db16a6880c3c698993883fb08ec21a568eb948c88d6 Jul 08 17:39:56.670179 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.670156 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e3b0d97_d085_4ff0_a989_a746a8d83fd7.slice/crio-4cdf6bf43b46df00d7e264334caa7c4eecfa9ac0c3fb727a8369c8a99693b095 WatchSource:0}: Error finding container 4cdf6bf43b46df00d7e264334caa7c4eecfa9ac0c3fb727a8369c8a99693b095: Status 404 returned error can't find the container with id 4cdf6bf43b46df00d7e264334caa7c4eecfa9ac0c3fb727a8369c8a99693b095 Jul 08 17:39:56.673283 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.672721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:56.676300 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.676281 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jwhsf\"" Jul 08 17:39:56.684160 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.684118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:39:56.715708 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.715667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tspzj"] Jul 08 17:39:56.720773 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.720727 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8a9333_0484_40e1_b0ce_26ab57fc8848.slice/crio-a061e4d15660136fe9b05f775be46f39e964363566cd5e893ea3ad099a2a4aaf WatchSource:0}: Error finding container a061e4d15660136fe9b05f775be46f39e964363566cd5e893ea3ad099a2a4aaf: Status 404 returned error can't find the container with id a061e4d15660136fe9b05f775be46f39e964363566cd5e893ea3ad099a2a4aaf Jul 08 17:39:56.759224 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.759152 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" event={"ID":"3e3b0d97-d085-4ff0-a989-a746a8d83fd7","Type":"ContainerStarted","Data":"4cdf6bf43b46df00d7e264334caa7c4eecfa9ac0c3fb727a8369c8a99693b095"} Jul 08 17:39:56.760468 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.760402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tspzj" event={"ID":"aa8a9333-0484-40e1-b0ce-26ab57fc8848","Type":"ContainerStarted","Data":"a061e4d15660136fe9b05f775be46f39e964363566cd5e893ea3ad099a2a4aaf"} Jul 08 17:39:56.761722 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.761675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" event={"ID":"af30f307-3c91-4cda-b6b7-74e2972db207","Type":"ContainerStarted","Data":"62c3a96769a68e6828866db16a6880c3c698993883fb08ec21a568eb948c88d6"} Jul 08 17:39:56.763008 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.762977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xnln6" event={"ID":"9b34a83d-5ed6-4a06-9532-c4de30c19cc2","Type":"ContainerStarted","Data":"9d1cb7eefb7b4242f69ff7c5ae8f1c75263fcd80110ea598b71bfe74e707acf6"} Jul 08 17:39:56.764430 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.764400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lk652" event={"ID":"deb22042-8c30-44e7-829d-a905c9957d53","Type":"ContainerStarted","Data":"9ca425010bb7f4edcdcd99d614b2f1784430dca5f3ca5c67625ef9ee6c14f3d1"} Jul 08 17:39:56.765789 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.765764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:56.765789 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.765777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" event={"ID":"aff18aa4-fee8-49c7-ba03-85a9d241fd7c","Type":"ContainerStarted","Data":"17083736d51f33552dd7a982a9b1535b78810b6bf994db5c7bb94e93f8a72230"} Jul 08 17:39:56.773350 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.773309 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:56.827701 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.827669 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6w2cn"] Jul 08 17:39:56.830780 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.830751 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59536c19_b784_4d77_91d4_09106131d9f7.slice/crio-08d7174916729a3ae2c9957d5dd15a95e2f6d7fdf5efa6d9d3dfec912cf887f2 WatchSource:0}: Error finding container 08d7174916729a3ae2c9957d5dd15a95e2f6d7fdf5efa6d9d3dfec912cf887f2: Status 404 returned error can't find the container with id 08d7174916729a3ae2c9957d5dd15a95e2f6d7fdf5efa6d9d3dfec912cf887f2 Jul 08 17:39:56.849159 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.849122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f9cc9f-p752f"] Jul 08 17:39:56.852151 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:39:56.852123 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771fdf55_2329_4670_b2c4_ca5022ab37d0.slice/crio-bb8ee4860d378f6dd62976457fe3f1bf8d2bc16c756007b8306284edc1ec5f97 WatchSource:0}: Error finding container bb8ee4860d378f6dd62976457fe3f1bf8d2bc16c756007b8306284edc1ec5f97: Status 404 returned error can't find the container with id bb8ee4860d378f6dd62976457fe3f1bf8d2bc16c756007b8306284edc1ec5f97 Jul 08 17:39:56.910570 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910539 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910587 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-trusted-ca\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910636 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-image-registry-private-configuration\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910661 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f427dd9-325a-4670-a33a-b52cdd9e3b96-ca-trust-extracted\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910691 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-installation-pull-secrets\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910720 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910709 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-bound-sa-token\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910964 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910744 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-certificates\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.910964 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910773 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4cjw\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-kube-api-access-h4cjw\") pod \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\" (UID: \"4f427dd9-325a-4670-a33a-b52cdd9e3b96\") " Jul 08 17:39:56.911063 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910970 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f427dd9-325a-4670-a33a-b52cdd9e3b96-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:39:56.911063 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.910984 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:39:56.911256 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.911212 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:39:56.913431 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.913398 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:39:56.913524 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.913434 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:39:56.913524 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.913453 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:39:56.913524 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.913464 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:39:56.913524 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:56.913511 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-kube-api-access-h4cjw" (OuterVolumeSpecName: "kube-api-access-h4cjw") pod "4f427dd9-325a-4670-a33a-b52cdd9e3b96" (UID: "4f427dd9-325a-4670-a33a-b52cdd9e3b96"). InnerVolumeSpecName "kube-api-access-h4cjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:39:57.011733 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011698 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-trusted-ca\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.011733 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011734 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-image-registry-private-configuration\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.011733 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011746 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f427dd9-325a-4670-a33a-b52cdd9e3b96-ca-trust-extracted\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.012015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011755 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f427dd9-325a-4670-a33a-b52cdd9e3b96-installation-pull-secrets\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.012015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011766 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-bound-sa-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.012015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011774 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-certificates\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.012015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011781 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4cjw\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-kube-api-access-h4cjw\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.012015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.011793 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f427dd9-325a-4670-a33a-b52cdd9e3b96-registry-tls\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 17:39:57.779453 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.779408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6w2cn" event={"ID":"59536c19-b784-4d77-91d4-09106131d9f7","Type":"ContainerStarted","Data":"08d7174916729a3ae2c9957d5dd15a95e2f6d7fdf5efa6d9d3dfec912cf887f2"} Jul 08 17:39:57.786584 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.782114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564c45f46c-pxmjb" Jul 08 17:39:57.786584 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.786236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" event={"ID":"771fdf55-2329-4670-b2c4-ca5022ab37d0","Type":"ContainerStarted","Data":"f342eab28a781a4769645febe1c74251e18407c79091aca1357e34d620ecc1a9"} Jul 08 17:39:57.786584 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.786285 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" event={"ID":"771fdf55-2329-4670-b2c4-ca5022ab37d0","Type":"ContainerStarted","Data":"bb8ee4860d378f6dd62976457fe3f1bf8d2bc16c756007b8306284edc1ec5f97"} Jul 08 17:39:57.786584 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.786310 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:39:57.816528 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.815078 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" podStartSLOduration=1.8150568790000001 podStartE2EDuration="1.815056879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:57.814586355 +0000 UTC m=+67.877537799" watchObservedRunningTime="2026-07-08 17:39:57.815056879 +0000 UTC m=+67.878008271" Jul 08 17:39:57.850466 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.850421 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-564c45f46c-pxmjb"] Jul 08 17:39:57.855424 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:57.855357 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-564c45f46c-pxmjb"] Jul 08 17:39:58.469815 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:39:58.469777 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f427dd9-325a-4670-a33a-b52cdd9e3b96" path="/var/lib/kubelet/pods/4f427dd9-325a-4670-a33a-b52cdd9e3b96/volumes" Jul 08 17:40:05.814181 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.814077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tspzj" event={"ID":"aa8a9333-0484-40e1-b0ce-26ab57fc8848","Type":"ContainerStarted","Data":"621eeec0c2b10303c68daba5cd460c9adc5dd2ccb46c96f084e9d509c8a9131e"} Jul 08 17:40:05.814181 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.814172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tspzj" event={"ID":"aa8a9333-0484-40e1-b0ce-26ab57fc8848","Type":"ContainerStarted","Data":"5bc7343a14eb66d4f093c3cb304f080bf006002a8e5bd6cc29dde7d430e7af95"} Jul 08 17:40:05.814710 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.814204 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tspzj" Jul 08 17:40:05.815565 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.815542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" event={"ID":"af30f307-3c91-4cda-b6b7-74e2972db207","Type":"ContainerStarted","Data":"b8a04682c49a5885bd56fb49ee7371a5dc98809574cbecea9f2b436d64ba404a"} Jul 08 17:40:05.817191 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.817165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xnln6" event={"ID":"9b34a83d-5ed6-4a06-9532-c4de30c19cc2","Type":"ContainerStarted","Data":"aa5e5013041a1d91fd422ff200f5159160cfbb744c4998d84cb849516f237507"} Jul 08 17:40:05.817306 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.817213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xnln6" event={"ID":"9b34a83d-5ed6-4a06-9532-c4de30c19cc2","Type":"ContainerStarted","Data":"82a75c89808d2c9b67edccfaac22f7a0227cc955f840acb3b23ebb0042e44dea"} Jul 08 17:40:05.818537 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.818512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lk652" event={"ID":"deb22042-8c30-44e7-829d-a905c9957d53","Type":"ContainerStarted","Data":"b225937610a2a28d22c0b82a25f9afef3e65778b2c1cb2246322ca3b3ee0256c"} Jul 08 17:40:05.819903 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.819876 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" event={"ID":"aff18aa4-fee8-49c7-ba03-85a9d241fd7c","Type":"ContainerStarted","Data":"c910fa084e2aa7a7d90fdb89728de3231fdca430246d7422ca64609924d0a570"} Jul 08 17:40:05.821153 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.821129 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6w2cn" event={"ID":"59536c19-b784-4d77-91d4-09106131d9f7","Type":"ContainerStarted","Data":"04828f0b3da7b0706b04d304ed247e60dc186a0c4a9478958937f5e5a0275305"} Jul 08 17:40:05.821239 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.821193 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:40:05.823042 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.823023 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" event={"ID":"3e3b0d97-d085-4ff0-a989-a746a8d83fd7","Type":"ContainerStarted","Data":"19fa2de3977e43c734cae51a1546a30586facbe49da116763164da8917487926"} Jul 08 17:40:05.823116 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.823050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" event={"ID":"3e3b0d97-d085-4ff0-a989-a746a8d83fd7","Type":"ContainerStarted","Data":"05be3c6c3e2406951122c4491018b06fd0cf559cb2ec5062bbf70ae1d3d43af9"} Jul 08 17:40:05.823116 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.823062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" event={"ID":"3e3b0d97-d085-4ff0-a989-a746a8d83fd7","Type":"ContainerStarted","Data":"7d8f0fa312e370833ff0e4adee0b34f7ca499361337951a5777ec9ad64d57d6f"} Jul 08 17:40:05.836552 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.836495 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tspzj" podStartSLOduration=33.3018133 podStartE2EDuration="41.836476625s" totalImagesPullingTime="8.534663325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.835530044 +0000 UTC m=+75.898481458" watchObservedRunningTime="2026-07-08 17:40:05.836476625 +0000 UTC m=+75.899428037" Jul 08 17:40:05.855674 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.855592 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lk652" podStartSLOduration=67.140142427 podStartE2EDuration="1m15.855573538s" totalImagesPullingTime="8.715431111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.854949318 +0000 UTC m=+75.917900733" watchObservedRunningTime="2026-07-08 17:40:05.855573538 +0000 UTC m=+75.918524950" Jul 08 17:40:05.872494 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.872439 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xnln6" podStartSLOduration=69.647564681 podStartE2EDuration="1m15.872421019s" totalImagesPullingTime="6.224856338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.871872053 +0000 UTC m=+75.934823490" watchObservedRunningTime="2026-07-08 17:40:05.872421019 +0000 UTC m=+75.935372433" Jul 08 17:40:05.891806 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.891748 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6w2cn" podStartSLOduration=67.451250032 podStartE2EDuration="1m15.891734089s" totalImagesPullingTime="8.440484057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.890807391 +0000 UTC m=+75.953758825" watchObservedRunningTime="2026-07-08 17:40:05.891734089 +0000 UTC m=+75.954685502" Jul 08 17:40:05.907444 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.907381 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2nlqf" podStartSLOduration=1.329444239 podStartE2EDuration="9.9073599s" totalImagesPullingTime="8.577915661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.907027904 +0000 UTC m=+75.969979319" watchObservedRunningTime="2026-07-08 17:40:05.9073599 +0000 UTC m=+75.970311317" Jul 08 17:40:05.922651 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:05.922580 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-649d5445cb-ds2mc" podStartSLOduration=1.322554604 podStartE2EDuration="9.922564937s" totalImagesPullingTime="8.600010333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.92194282 +0000 UTC m=+75.984894234" watchObservedRunningTime="2026-07-08 17:40:05.922564937 +0000 UTC m=+75.985516352" Jul 08 17:40:06.499506 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:06.499457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:40:06.501971 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:06.501936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c26cb933-469c-4e86-8f97-11ff7da58cd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm2m7\" (UID: \"c26cb933-469c-4e86-8f97-11ff7da58cd8\") " pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:40:06.736924 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:06.733849 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2ql9\"" Jul 08 17:40:06.740804 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:06.740772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fm2m7" Jul 08 17:40:06.875207 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:06.875151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c648fd7b9-nhdnj" podStartSLOduration=2.266445541 podStartE2EDuration="10.875133161s" totalImagesPullingTime="8.60868762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:05.940004546 +0000 UTC m=+76.002955961" watchObservedRunningTime="2026-07-08 17:40:06.875133161 +0000 UTC m=+76.938084587" Jul 08 17:40:06.875855 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:06.875837 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fm2m7"] Jul 08 17:40:06.878719 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:40:06.878692 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26cb933_469c_4e86_8f97_11ff7da58cd8.slice/crio-619262f2172e482ddc28513076bab2c732e660f2fd59f4cefa67dc44fe3a5241 WatchSource:0}: Error finding container 619262f2172e482ddc28513076bab2c732e660f2fd59f4cefa67dc44fe3a5241: Status 404 returned error can't find the container with id 619262f2172e482ddc28513076bab2c732e660f2fd59f4cefa67dc44fe3a5241 Jul 08 17:40:07.837672 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:07.837608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm2m7" event={"ID":"c26cb933-469c-4e86-8f97-11ff7da58cd8","Type":"ContainerStarted","Data":"619262f2172e482ddc28513076bab2c732e660f2fd59f4cefa67dc44fe3a5241"} Jul 08 17:40:10.851094 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:10.851055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm2m7" event={"ID":"c26cb933-469c-4e86-8f97-11ff7da58cd8","Type":"ContainerStarted","Data":"a1223b4e05c65f50d0dbd6532bcdbe3559f3d01d9009d4393abb443c583b8923"} Jul 08 17:40:11.856549 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:11.856506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm2m7" event={"ID":"c26cb933-469c-4e86-8f97-11ff7da58cd8","Type":"ContainerStarted","Data":"a3d010fcb416f2112ea4b8bc75366718f42bcd99643ab9b0e645acd5e79a0056"} Jul 08 17:40:14.869245 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:14.869208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm2m7" event={"ID":"c26cb933-469c-4e86-8f97-11ff7da58cd8","Type":"ContainerStarted","Data":"bc8a0d4478527c82ecb62298fb5fb29bec26b88c25e8414bb1d5750ab3719d4f"} Jul 08 17:40:14.890470 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:14.890412 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fm2m7" podStartSLOduration=33.78485458 podStartE2EDuration="40.89039401s" totalImagesPullingTime="7.10553943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:39:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:14.889596469 +0000 UTC m=+84.952547899" watchObservedRunningTime="2026-07-08 17:40:14.89039401 +0000 UTC m=+84.953345423" Jul 08 17:40:15.833850 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:15.833819 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tspzj" Jul 08 17:40:16.678195 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:16.678155 2559 patch_prober.go:28] interesting pod/image-registry-59f9cc9f-p752f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:40:16.678594 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:16.678215 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" podUID="771fdf55-2329-4670-b2c4-ca5022ab37d0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:40:18.505977 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.505935 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8rwlx"] Jul 08 17:40:18.508603 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.508575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.511851 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.511819 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 17:40:18.512003 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.511912 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 17:40:18.512220 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.512057 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 17:40:18.512220 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.512202 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 17:40:18.512599 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.512563 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 17:40:18.512908 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.512888 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 17:40:18.517530 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.516846 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cccpp\"" Jul 08 17:40:18.595902 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.595860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-wtmp\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596102 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.595928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596102 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.595958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/088550d3-f091-42f8-9b19-fcb6667b40bf-metrics-client-ca\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596102 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.595981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-575vp\" (UniqueName: \"kubernetes.io/projected/088550d3-f091-42f8-9b19-fcb6667b40bf-kube-api-access-575vp\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596102 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.596053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-root\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596102 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.596091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596315 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.596118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-sys\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596315 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.596180 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-textfile\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.596315 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.596231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-tls\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.696862 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.696807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-tls\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697052 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.696884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-wtmp\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697052 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.696930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697052 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.696955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/088550d3-f091-42f8-9b19-fcb6667b40bf-metrics-client-ca\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697052 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.696979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-575vp\" (UniqueName: \"kubernetes.io/projected/088550d3-f091-42f8-9b19-fcb6667b40bf-kube-api-access-575vp\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697052 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:40:18.697004 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-root\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: E0708 17:40:18.697088 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-tls podName:088550d3-f091-42f8-9b19-fcb6667b40bf nodeName:}" failed. No retries permitted until 2026-07-08 17:40:19.197066327 +0000 UTC m=+89.260017732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-tls") pod "node-exporter-8rwlx" (UID: "088550d3-f091-42f8-9b19-fcb6667b40bf") : secret "node-exporter-tls" not found Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-root\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-sys\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-wtmp\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697232 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-textfile\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697825 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/088550d3-f091-42f8-9b19-fcb6667b40bf-sys\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.697825 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-textfile\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.698015 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.697856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.698402 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.698381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/088550d3-f091-42f8-9b19-fcb6667b40bf-metrics-client-ca\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.700218 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.700193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.709192 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.709154 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-575vp\" (UniqueName: \"kubernetes.io/projected/088550d3-f091-42f8-9b19-fcb6667b40bf-kube-api-access-575vp\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:18.794888 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:18.794809 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f9cc9f-p752f" Jul 08 17:40:19.200899 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:19.200861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-tls\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:19.203305 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:19.203277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/088550d3-f091-42f8-9b19-fcb6667b40bf-node-exporter-tls\") pod \"node-exporter-8rwlx\" (UID: \"088550d3-f091-42f8-9b19-fcb6667b40bf\") " pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:19.420255 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:19.420219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8rwlx" Jul 08 17:40:19.430824 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:40:19.430793 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088550d3_f091_42f8_9b19_fcb6667b40bf.slice/crio-dd5af9eb32272e2d291e08c0314a3f37144ae5320f5c408099187ce2a3f7fdb0 WatchSource:0}: Error finding container dd5af9eb32272e2d291e08c0314a3f37144ae5320f5c408099187ce2a3f7fdb0: Status 404 returned error can't find the container with id dd5af9eb32272e2d291e08c0314a3f37144ae5320f5c408099187ce2a3f7fdb0 Jul 08 17:40:19.888267 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:19.888196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rwlx" event={"ID":"088550d3-f091-42f8-9b19-fcb6667b40bf","Type":"ContainerStarted","Data":"dd5af9eb32272e2d291e08c0314a3f37144ae5320f5c408099187ce2a3f7fdb0"} Jul 08 17:40:20.893527 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:20.893425 2559 generic.go:356] "Generic (PLEG): container finished" podID="088550d3-f091-42f8-9b19-fcb6667b40bf" containerID="8467de9faf40985890513999d9ee754948505439be5041d50e461445fba82f33" exitCode=0 Jul 08 17:40:20.893980 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:20.893514 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rwlx" event={"ID":"088550d3-f091-42f8-9b19-fcb6667b40bf","Type":"ContainerDied","Data":"8467de9faf40985890513999d9ee754948505439be5041d50e461445fba82f33"} Jul 08 17:40:21.898998 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:21.898958 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rwlx" event={"ID":"088550d3-f091-42f8-9b19-fcb6667b40bf","Type":"ContainerStarted","Data":"9fab3b62edcba6df903ef627c61c9abf1ac73f4fd602db0b5e22820a42b182f6"} Jul 08 17:40:21.899383 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:21.899027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rwlx" event={"ID":"088550d3-f091-42f8-9b19-fcb6667b40bf","Type":"ContainerStarted","Data":"12f2155a0d4b194faa6cdd5f59986aede560f8e831bbfae5a03a8d25d966abfc"} Jul 08 17:40:21.920109 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:21.920050 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8rwlx" podStartSLOduration=2.753968955 podStartE2EDuration="3.920033982s" totalImagesPullingTime="1.095294719s" totalInitContainerRuntime="70.770308ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:21.918868657 +0000 UTC m=+91.981820069" watchObservedRunningTime="2026-07-08 17:40:21.920033982 +0000 UTC m=+91.982985395" Jul 08 17:40:36.833542 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:40:36.833503 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6w2cn" Jul 08 17:43:50.326560 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:50.326531 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 17:43:51.048612 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.048570 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt"] Jul 08 17:43:51.051587 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.051568 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.055809 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.055782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 17:43:51.055969 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.055782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4fllq\"" Jul 08 17:43:51.055969 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.055782 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 17:43:51.056118 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.056105 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:43:51.057546 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.057527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 17:43:51.057862 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.057848 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 17:43:51.080673 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.080640 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt"] Jul 08 17:43:51.148159 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.148122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1bdefe2-8f37-438d-b65a-251562a1e994-manager-config\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.148353 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.148185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgh5r\" (UniqueName: \"kubernetes.io/projected/a1bdefe2-8f37-438d-b65a-251562a1e994-kube-api-access-vgh5r\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.148353 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.148207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1bdefe2-8f37-438d-b65a-251562a1e994-cert\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.148353 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.148287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1bdefe2-8f37-438d-b65a-251562a1e994-metrics-cert\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.248946 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.248887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1bdefe2-8f37-438d-b65a-251562a1e994-manager-config\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.249148 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.248966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgh5r\" (UniqueName: \"kubernetes.io/projected/a1bdefe2-8f37-438d-b65a-251562a1e994-kube-api-access-vgh5r\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.249148 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.248994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1bdefe2-8f37-438d-b65a-251562a1e994-cert\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.249148 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.249031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1bdefe2-8f37-438d-b65a-251562a1e994-metrics-cert\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.249691 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.249651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1bdefe2-8f37-438d-b65a-251562a1e994-manager-config\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.251658 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.251614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1bdefe2-8f37-438d-b65a-251562a1e994-metrics-cert\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.251766 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.251617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1bdefe2-8f37-438d-b65a-251562a1e994-cert\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.259336 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.259303 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgh5r\" (UniqueName: \"kubernetes.io/projected/a1bdefe2-8f37-438d-b65a-251562a1e994-kube-api-access-vgh5r\") pod \"lws-controller-manager-7fbcbf7958-78xvt\" (UID: \"a1bdefe2-8f37-438d-b65a-251562a1e994\") " pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.361682 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.361540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:51.511190 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.511084 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt"] Jul 08 17:43:51.519682 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.519662 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:43:51.605688 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:51.605650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" event={"ID":"a1bdefe2-8f37-438d-b65a-251562a1e994","Type":"ContainerStarted","Data":"d7460263b56f5f97c408e2c1b14bb2d924f5b41b98a2496fb360995517994ff0"} Jul 08 17:43:52.593055 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.593022 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd"] Jul 08 17:43:52.596266 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.596231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.599570 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.599542 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 17:43:52.599741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.599662 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5jqb9\"" Jul 08 17:43:52.599741 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.599662 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 17:43:52.600116 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.600080 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 17:43:52.600116 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.600098 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 17:43:52.617442 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.617400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd"] Jul 08 17:43:52.662645 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.662585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ed586ec-9a9b-48b4-852d-826f77053c7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.662833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.662650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ed586ec-9a9b-48b4-852d-826f77053c7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.662833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.662714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ed586ec-9a9b-48b4-852d-826f77053c7f-manifests\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.662833 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.662771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9gt\" (UniqueName: \"kubernetes.io/projected/1ed586ec-9a9b-48b4-852d-826f77053c7f-kube-api-access-tk9gt\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.662993 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.662898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ed586ec-9a9b-48b4-852d-826f77053c7f-tmp\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.763805 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.763767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ed586ec-9a9b-48b4-852d-826f77053c7f-tmp\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.763984 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.763858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ed586ec-9a9b-48b4-852d-826f77053c7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.763984 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.763884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ed586ec-9a9b-48b4-852d-826f77053c7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.763984 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.763914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ed586ec-9a9b-48b4-852d-826f77053c7f-manifests\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.763984 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.763951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9gt\" (UniqueName: \"kubernetes.io/projected/1ed586ec-9a9b-48b4-852d-826f77053c7f-kube-api-access-tk9gt\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.764351 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.764328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ed586ec-9a9b-48b4-852d-826f77053c7f-manifests\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.766135 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.766109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ed586ec-9a9b-48b4-852d-826f77053c7f-tmp\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.766274 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.766256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ed586ec-9a9b-48b4-852d-826f77053c7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.766359 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.766341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ed586ec-9a9b-48b4-852d-826f77053c7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.774574 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.774537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9gt\" (UniqueName: \"kubernetes.io/projected/1ed586ec-9a9b-48b4-852d-826f77053c7f-kube-api-access-tk9gt\") pod \"opendatahub-operator-controller-manager-6dcf78d495-8hlvd\" (UID: \"1ed586ec-9a9b-48b4-852d-826f77053c7f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:52.909014 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:52.908916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:53.912468 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:53.912438 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd"] Jul 08 17:43:53.914971 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:43:53.914930 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed586ec_9a9b_48b4_852d_826f77053c7f.slice/crio-6657c19346e4cc9e323b6ff0aaf6c885a786b5afbd32d4621bede29b42c86cf9 WatchSource:0}: Error finding container 6657c19346e4cc9e323b6ff0aaf6c885a786b5afbd32d4621bede29b42c86cf9: Status 404 returned error can't find the container with id 6657c19346e4cc9e323b6ff0aaf6c885a786b5afbd32d4621bede29b42c86cf9 Jul 08 17:43:54.620414 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:54.620356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" event={"ID":"a1bdefe2-8f37-438d-b65a-251562a1e994","Type":"ContainerStarted","Data":"6045803ab7b25708907b3d8b33992e30f7887e96c29d58ba69855143afdb4350"} Jul 08 17:43:54.620598 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:54.620423 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:43:54.622090 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:54.622056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" event={"ID":"1ed586ec-9a9b-48b4-852d-826f77053c7f","Type":"ContainerStarted","Data":"6657c19346e4cc9e323b6ff0aaf6c885a786b5afbd32d4621bede29b42c86cf9"} Jul 08 17:43:54.641764 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:54.641701 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" podStartSLOduration=1.331965553 podStartE2EDuration="3.641650409s" totalImagesPullingTime="2.309684856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:54.64096704 +0000 UTC m=+304.703918469" watchObservedRunningTime="2026-07-08 17:43:54.641650409 +0000 UTC m=+304.704601815" Jul 08 17:43:57.635206 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:57.635163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" event={"ID":"1ed586ec-9a9b-48b4-852d-826f77053c7f","Type":"ContainerStarted","Data":"d705420d0d5ead0e29abe7ce1e6654b48e527e489472bc0acba4b5f087bec4e3"} Jul 08 17:43:58.640061 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:58.640021 2559 generic.go:356] "Generic (PLEG): container finished" podID="1ed586ec-9a9b-48b4-852d-826f77053c7f" containerID="d705420d0d5ead0e29abe7ce1e6654b48e527e489472bc0acba4b5f087bec4e3" exitCode=0 Jul 08 17:43:58.640485 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:58.640140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" event={"ID":"1ed586ec-9a9b-48b4-852d-826f77053c7f","Type":"ContainerDied","Data":"d705420d0d5ead0e29abe7ce1e6654b48e527e489472bc0acba4b5f087bec4e3"} Jul 08 17:43:59.645700 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:59.645656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" event={"ID":"1ed586ec-9a9b-48b4-852d-826f77053c7f","Type":"ContainerStarted","Data":"700309e79ef7ca45e1bf4b3c3c22a73dab3b786ce295e4b28ba65c12f7ebc3ca"} Jul 08 17:43:59.646215 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:59.645780 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:43:59.669150 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:43:59.669090 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" podStartSLOduration=3.48489855 podStartE2EDuration="7.669070601s" totalImagesPullingTime="3.177591526s" totalInitContainerRuntime="1.006580525s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:59.666837718 +0000 UTC m=+309.729789181" watchObservedRunningTime="2026-07-08 17:43:59.669070601 +0000 UTC m=+309.732022013" Jul 08 17:44:05.628513 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:05.628474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fbcbf7958-78xvt" Jul 08 17:44:10.653142 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:10.653113 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dcf78d495-8hlvd" Jul 08 17:44:21.968829 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.968786 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v"] Jul 08 17:44:21.979146 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.979116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:21.982422 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.982398 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 17:44:21.982585 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.982436 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 17:44:21.983663 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.983619 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 17:44:21.983742 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.983667 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9dth5\"" Jul 08 17:44:21.988062 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:21.988039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v"] Jul 08 17:44:22.091412 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091412 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvcgx\" (UniqueName: \"kubernetes.io/projected/2bf42a54-f70e-48c6-b488-ef81f81cc471-kube-api-access-dvcgx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bf42a54-f70e-48c6-b488-ef81f81cc471-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.091725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.091723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.192819 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bf42a54-f70e-48c6-b488-ef81f81cc471-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.192970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193036 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.193014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193385 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.193037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvcgx\" (UniqueName: \"kubernetes.io/projected/2bf42a54-f70e-48c6-b488-ef81f81cc471-kube-api-access-dvcgx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193385 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.193326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193527 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.193505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193669 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.193648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.193725 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.193713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.194049 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.194024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bf42a54-f70e-48c6-b488-ef81f81cc471-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.195560 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.195540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.195673 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.195559 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.208315 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.208277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf42a54-f70e-48c6-b488-ef81f81cc471-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.208465 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.208444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvcgx\" (UniqueName: \"kubernetes.io/projected/2bf42a54-f70e-48c6-b488-ef81f81cc471-kube-api-access-dvcgx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t6h9v\" (UID: \"2bf42a54-f70e-48c6-b488-ef81f81cc471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.291592 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.291489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:22.441892 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.441862 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v"] Jul 08 17:44:22.449578 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:44:22.449534 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf42a54_f70e_48c6_b488_ef81f81cc471.slice/crio-781a2d4cdfb704a611ee2d72d56007881e59e7305b17c450a3f347a12d6ec15d WatchSource:0}: Error finding container 781a2d4cdfb704a611ee2d72d56007881e59e7305b17c450a3f347a12d6ec15d: Status 404 returned error can't find the container with id 781a2d4cdfb704a611ee2d72d56007881e59e7305b17c450a3f347a12d6ec15d Jul 08 17:44:22.732740 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:22.732708 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" event={"ID":"2bf42a54-f70e-48c6-b488-ef81f81cc471","Type":"ContainerStarted","Data":"781a2d4cdfb704a611ee2d72d56007881e59e7305b17c450a3f347a12d6ec15d"} Jul 08 17:44:24.595917 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.595882 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x"] Jul 08 17:44:24.599177 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.599156 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.602071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.602042 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 17:44:24.603043 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.603012 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-shwpq\"" Jul 08 17:44:24.603098 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.603016 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 17:44:24.603332 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.603313 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 17:44:24.613802 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.613770 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x"] Jul 08 17:44:24.716357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.716539 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.716539 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.716539 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.716539 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljl9z\" (UniqueName: \"kubernetes.io/projected/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-kube-api-access-ljl9z\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.716539 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.716742 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.716560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.817821 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.817821 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.818081 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817841 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.818081 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljl9z\" (UniqueName: \"kubernetes.io/projected/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-kube-api-access-ljl9z\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.818081 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.818081 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.818081 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.817965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.818713 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.818682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.820489 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.820457 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.820489 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.820478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.820673 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.820558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.820673 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.820604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.828185 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.828137 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.828606 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.828585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljl9z\" (UniqueName: \"kubernetes.io/projected/5279eed3-5e03-4b22-b6d3-d1eec5770b8e-kube-api-access-ljl9z\") pod \"istiod-openshift-gateway-94bb8fbfd-55n5x\" (UID: \"5279eed3-5e03-4b22-b6d3-d1eec5770b8e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:24.908984 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:24.908883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:25.061987 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:25.061961 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x"] Jul 08 17:44:26.084355 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:44:26.084310 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5279eed3_5e03_4b22_b6d3_d1eec5770b8e.slice/crio-1bafb8e5d6d19ebe46f9d472b2bd7cceec42ec4d35bbb4a41fcbb5f453714687 WatchSource:0}: Error finding container 1bafb8e5d6d19ebe46f9d472b2bd7cceec42ec4d35bbb4a41fcbb5f453714687: Status 404 returned error can't find the container with id 1bafb8e5d6d19ebe46f9d472b2bd7cceec42ec4d35bbb4a41fcbb5f453714687 Jul 08 17:44:26.147046 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:26.146999 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:44:26.147144 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:26.147078 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:44:26.147144 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:26.147110 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:44:26.751167 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:26.751123 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" event={"ID":"2bf42a54-f70e-48c6-b488-ef81f81cc471","Type":"ContainerStarted","Data":"01f2793d2fb7c64ec9f27c4c22afc9433485a3646c2b28e8efa7e970a54c0556"} Jul 08 17:44:26.752566 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:26.752532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" event={"ID":"5279eed3-5e03-4b22-b6d3-d1eec5770b8e","Type":"ContainerStarted","Data":"1bafb8e5d6d19ebe46f9d472b2bd7cceec42ec4d35bbb4a41fcbb5f453714687"} Jul 08 17:44:26.774922 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:26.774871 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" podStartSLOduration=2.076024068 podStartE2EDuration="5.774853297s" totalImagesPullingTime="3.698829229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:26.773704511 +0000 UTC m=+336.836655926" watchObservedRunningTime="2026-07-08 17:44:26.774853297 +0000 UTC m=+336.837804710" Jul 08 17:44:27.292362 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:27.292319 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:27.297926 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:27.297894 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:27.755778 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:27.755744 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:27.756773 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:27.756752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t6h9v" Jul 08 17:44:29.268879 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:29.268839 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:44:29.269217 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:29.268906 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:44:29.765647 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:29.765592 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" event={"ID":"5279eed3-5e03-4b22-b6d3-d1eec5770b8e","Type":"ContainerStarted","Data":"0d11c98718fbade4296813666e57b3965d645eb6e4acf9ec32f1ebb39591c481"} Jul 08 17:44:29.765843 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:29.765683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:44:29.792037 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:29.791981 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" podStartSLOduration=2.611260917 podStartE2EDuration="5.791962345s" totalImagesPullingTime="3.180701428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:29.790084823 +0000 UTC m=+339.853036241" watchObservedRunningTime="2026-07-08 17:44:29.791962345 +0000 UTC m=+339.854913758" Jul 08 17:44:30.770887 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:44:30.770860 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-55n5x" Jul 08 17:46:50.284066 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.284031 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl"] Jul 08 17:46:50.287336 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.287315 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.290218 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.290197 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9j64h\"" Jul 08 17:46:50.299041 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.299008 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl"] Jul 08 17:46:50.405588 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.405588 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.405890 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.405890 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.405890 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.405890 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.405890 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.406117 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5r7v\" (UniqueName: \"kubernetes.io/projected/ee537f86-dacb-4e45-aaf5-3e1ec220561c-kube-api-access-r5r7v\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.406117 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.405964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507084 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5r7v\" (UniqueName: \"kubernetes.io/projected/ee537f86-dacb-4e45-aaf5-3e1ec220561c-kube-api-access-r5r7v\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507084 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507339 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507722 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507779 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.507998 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.507964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.508080 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.508003 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.508319 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.508285 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.510166 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.510141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.510334 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.510254 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.517205 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.517170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee537f86-dacb-4e45-aaf5-3e1ec220561c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.517880 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.517842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5r7v\" (UniqueName: \"kubernetes.io/projected/ee537f86-dacb-4e45-aaf5-3e1ec220561c-kube-api-access-r5r7v\") pod \"maas-default-gateway-openshift-default-56654dcf7-f49gl\" (UID: \"ee537f86-dacb-4e45-aaf5-3e1ec220561c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.597839 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.597755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:50.758042 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.758014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl"] Jul 08 17:46:50.760779 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:46:50.760739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee537f86_dacb_4e45_aaf5_3e1ec220561c.slice/crio-14cef08c5891cbd9e4ce1e786933cb6e86a2d40b81c52b7aa7586a5a1c627222 WatchSource:0}: Error finding container 14cef08c5891cbd9e4ce1e786933cb6e86a2d40b81c52b7aa7586a5a1c627222: Status 404 returned error can't find the container with id 14cef08c5891cbd9e4ce1e786933cb6e86a2d40b81c52b7aa7586a5a1c627222 Jul 08 17:46:50.763055 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.763021 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:50.763173 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.763095 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:50.763173 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:50.763132 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:51.291134 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:51.291094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" event={"ID":"ee537f86-dacb-4e45-aaf5-3e1ec220561c","Type":"ContainerStarted","Data":"6c73be2ec5062c715c10a0c5af3b4b3539ef6f6b50b66d3b3ebad9d677d72138"} Jul 08 17:46:51.291531 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:51.291162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" event={"ID":"ee537f86-dacb-4e45-aaf5-3e1ec220561c","Type":"ContainerStarted","Data":"14cef08c5891cbd9e4ce1e786933cb6e86a2d40b81c52b7aa7586a5a1c627222"} Jul 08 17:46:51.315949 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:51.315871 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" podStartSLOduration=1.315847987 podStartE2EDuration="1.315847987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:51.313907632 +0000 UTC m=+481.376859058" watchObservedRunningTime="2026-07-08 17:46:51.315847987 +0000 UTC m=+481.378799400" Jul 08 17:46:51.597967 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:51.597867 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:51.603738 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:51.603705 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:52.295761 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:52.295726 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:46:52.296709 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:46:52.296688 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:48:33.702879 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:33.702787 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee537f86-dacb-4e45-aaf5-3e1ec220561c" containerID="6c73be2ec5062c715c10a0c5af3b4b3539ef6f6b50b66d3b3ebad9d677d72138" exitCode=0 Jul 08 17:48:33.702879 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:33.702859 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" event={"ID":"ee537f86-dacb-4e45-aaf5-3e1ec220561c","Type":"ContainerDied","Data":"6c73be2ec5062c715c10a0c5af3b4b3539ef6f6b50b66d3b3ebad9d677d72138"} Jul 08 17:48:33.703381 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:33.703255 2559 scope.go:117] "RemoveContainer" containerID="6c73be2ec5062c715c10a0c5af3b4b3539ef6f6b50b66d3b3ebad9d677d72138" Jul 08 17:48:33.704287 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:33.704258 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:48:33.704363 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:33.704333 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:48:33.704400 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:33.704373 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:48:34.709274 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:34.709236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" event={"ID":"ee537f86-dacb-4e45-aaf5-3e1ec220561c","Type":"ContainerStarted","Data":"724cafae10db95bb5ca72fd81a3260a0fb154de5bdeeb3f83d8a9014f7a62fad"} Jul 08 17:48:35.598334 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:35.598293 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:48:35.599542 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:35.599514 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-f49gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 08 17:48:35.599662 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:35.599580 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" podUID="ee537f86-dacb-4e45-aaf5-3e1ec220561c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 08 17:48:36.599104 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:36.599064 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-f49gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 08 17:48:36.599534 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:36.599133 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" podUID="ee537f86-dacb-4e45-aaf5-3e1ec220561c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 08 17:48:37.296416 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:37.296381 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:48:37.598257 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:37.598161 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-f49gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 08 17:48:37.598257 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:37.598225 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" podUID="ee537f86-dacb-4e45-aaf5-3e1ec220561c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 08 17:48:38.599079 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:38.599042 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-f49gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 08 17:48:38.599481 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:38.599097 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" podUID="ee537f86-dacb-4e45-aaf5-3e1ec220561c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 08 17:48:39.602150 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:39.602118 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:48:39.603243 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:39.603219 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-f49gl" Jul 08 17:48:56.886580 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.886543 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q"] Jul 08 17:48:56.889180 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.889156 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:56.891924 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.891892 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w5cfc\"" Jul 08 17:48:56.892179 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.891932 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 17:48:56.892179 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.891990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 17:48:56.892179 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.892006 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 17:48:56.900694 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.900663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q"] Jul 08 17:48:56.912671 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.912642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:56.912837 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.912694 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:56.912837 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.912753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:56.912837 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.912818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:56.912956 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.912865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tbt4\" (UniqueName: \"kubernetes.io/projected/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-kube-api-access-6tbt4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:56.912956 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:56.912893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014164 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014164 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014395 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014395 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014395 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014395 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tbt4\" (UniqueName: \"kubernetes.io/projected/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-kube-api-access-6tbt4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014785 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014913 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.014913 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.014820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.016722 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.016698 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.016854 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.016836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.025278 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.025248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tbt4\" (UniqueName: \"kubernetes.io/projected/c8cc00d2-af85-43a7-b8a7-e14c89fc6d93-kube-api-access-6tbt4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hk77q\" (UID: \"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.200205 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.200174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:48:57.340553 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.340520 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q"] Jul 08 17:48:57.343042 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:48:57.343010 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cc00d2_af85_43a7_b8a7_e14c89fc6d93.slice/crio-3b2849d7f7d22eccdb074b6cee38f442c3640602976b4a3ee92ff62122d87912 WatchSource:0}: Error finding container 3b2849d7f7d22eccdb074b6cee38f442c3640602976b4a3ee92ff62122d87912: Status 404 returned error can't find the container with id 3b2849d7f7d22eccdb074b6cee38f442c3640602976b4a3ee92ff62122d87912 Jul 08 17:48:57.344357 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.344339 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:48:57.803829 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:57.803791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" event={"ID":"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93","Type":"ContainerStarted","Data":"3b2849d7f7d22eccdb074b6cee38f442c3640602976b4a3ee92ff62122d87912"} Jul 08 17:48:58.809803 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:58.809762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" event={"ID":"c8cc00d2-af85-43a7-b8a7-e14c89fc6d93","Type":"ContainerStarted","Data":"1ce451319856bfe2f30602459e136a3b04ecf2f63f0c88805a4b7df45e831782"} Jul 08 17:48:58.831008 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:48:58.830948 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" podStartSLOduration=1.83750196 podStartE2EDuration="2.830925546s" totalImagesPullingTime="993.423586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:58.829338576 +0000 UTC m=+608.892290026" watchObservedRunningTime="2026-07-08 17:48:58.830925546 +0000 UTC m=+608.893876958" Jul 08 17:49:07.200574 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:07.200515 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:49:07.201217 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:07.200608 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:49:07.213147 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:07.213119 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:49:07.857113 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:07.857077 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hk77q" Jul 08 17:49:34.793108 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.793071 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt"] Jul 08 17:49:34.798763 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.798736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.801556 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.801537 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 17:49:34.806656 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.806614 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt"] Jul 08 17:49:34.840814 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.840776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.841020 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.840821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.841020 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.840884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.841020 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.840936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvwm\" (UniqueName: \"kubernetes.io/projected/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-kube-api-access-ctvwm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.841020 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.840972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.841205 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.841031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942074 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvwm\" (UniqueName: \"kubernetes.io/projected/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-kube-api-access-ctvwm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942074 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942333 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942333 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942333 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942333 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942558 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942616 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.942616 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.942586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.944512 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.944489 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.944709 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.944691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:34.951908 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:34.951880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvwm\" (UniqueName: \"kubernetes.io/projected/93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93-kube-api-access-ctvwm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt\" (UID: \"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:35.109663 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:35.109527 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:35.251618 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:35.251552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt"] Jul 08 17:49:35.254494 ip-10-0-136-203 kubenswrapper[2559]: W0708 17:49:35.254464 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cdaa8a_4a1a_4bdf_9731_7ab722fe4a93.slice/crio-2ab7a5cb90b0a5cacd56c5897be66e489ab533d7e421641bbb2ad3d2987cb923 WatchSource:0}: Error finding container 2ab7a5cb90b0a5cacd56c5897be66e489ab533d7e421641bbb2ad3d2987cb923: Status 404 returned error can't find the container with id 2ab7a5cb90b0a5cacd56c5897be66e489ab533d7e421641bbb2ad3d2987cb923 Jul 08 17:49:35.960075 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:35.960034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" event={"ID":"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93","Type":"ContainerStarted","Data":"a73d9e4631cf4c608282aa7b8089ae590a9021428e65cfe345910966cac64e8c"} Jul 08 17:49:35.960492 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:35.960102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" event={"ID":"93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93","Type":"ContainerStarted","Data":"2ab7a5cb90b0a5cacd56c5897be66e489ab533d7e421641bbb2ad3d2987cb923"} Jul 08 17:49:35.980759 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:35.980702 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" podStartSLOduration=1.7953235699999999 podStartE2EDuration="1.980684107s" totalImagesPullingTime="185.360537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:49:35.978818483 +0000 UTC m=+646.041769898" watchObservedRunningTime="2026-07-08 17:49:35.980684107 +0000 UTC m=+646.043635517" Jul 08 17:49:45.110562 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:45.110496 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:45.111220 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:45.110592 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:45.123702 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:45.123674 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 17:49:46.014071 ip-10-0-136-203 kubenswrapper[2559]: I0708 17:49:46.014041 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt" Jul 08 18:04:58.732788 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.732750 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572"] Jul 08 18:04:58.736212 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.736188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.739126 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.739105 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a114503a-openshift-default-dockercfg-p2ngx\"" Jul 08 18:04:58.760996 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.760960 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572"] Jul 08 18:04:58.818773 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.818732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-credential-socket\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.818964 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.818814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-data\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.818964 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.818878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-token\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.818964 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.818895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-envoy\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.819133 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.818989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9065b58b-29c1-4290-84c7-bc1fcbea327a-istiod-ca-cert\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.819133 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.819033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-socket\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.819133 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.819059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-certs\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.819133 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.819092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78tfm\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-kube-api-access-78tfm\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.819297 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.819148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-podinfo\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920322 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-token\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920322 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-envoy\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920586 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9065b58b-29c1-4290-84c7-bc1fcbea327a-istiod-ca-cert\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920586 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-socket\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920586 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-certs\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920863 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78tfm\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-kube-api-access-78tfm\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920863 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-podinfo\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920863 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-credential-socket\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.920863 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-data\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.921069 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.920881 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-socket\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.921251 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.921227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-credential-socket\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.921386 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.921251 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9065b58b-29c1-4290-84c7-bc1fcbea327a-istiod-ca-cert\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.921386 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.921279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-certs\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.921386 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.921310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-data\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.922665 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.922644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-envoy\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.923244 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.923227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-podinfo\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.932043 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.932016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-token\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:58.932170 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:58.932062 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78tfm\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-kube-api-access-78tfm\") pod \"e2e-ait-a114503a-openshift-default-7f795769d7-2j572\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:59.047131 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.047048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:04:59.194615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.194584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572"] Jul 08 18:04:59.197363 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:04:59.197333 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9065b58b_29c1_4290_84c7_bc1fcbea327a.slice/crio-a330dae20f56ced72ae93c3d06dd7d38f2a14a638aae024755dc979c6a7f8bc9 WatchSource:0}: Error finding container a330dae20f56ced72ae93c3d06dd7d38f2a14a638aae024755dc979c6a7f8bc9: Status 404 returned error can't find the container with id a330dae20f56ced72ae93c3d06dd7d38f2a14a638aae024755dc979c6a7f8bc9 Jul 08 18:04:59.199574 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.199535 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:04:59.199717 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.199608 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:04:59.199717 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.199704 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:04:59.757418 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.757380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" event={"ID":"9065b58b-29c1-4290-84c7-bc1fcbea327a","Type":"ContainerStarted","Data":"4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394"} Jul 08 18:04:59.758055 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.757435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" event={"ID":"9065b58b-29c1-4290-84c7-bc1fcbea327a","Type":"ContainerStarted","Data":"a330dae20f56ced72ae93c3d06dd7d38f2a14a638aae024755dc979c6a7f8bc9"} Jul 08 18:04:59.781737 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:04:59.781685 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" podStartSLOduration=1.781667726 podStartE2EDuration="1.781667726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:59.780027787 +0000 UTC m=+1569.842979221" watchObservedRunningTime="2026-07-08 18:04:59.781667726 +0000 UTC m=+1569.844619195" Jul 08 18:05:00.047782 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:00.047690 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:05:00.053279 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:00.053249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:05:00.762284 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:00.762246 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:05:00.763404 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:00.763382 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:05:05.297017 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:05.296977 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572"] Jul 08 18:05:05.297525 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:05.297179 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" podUID="9065b58b-29c1-4290-84c7-bc1fcbea327a" containerName="istio-proxy" containerID="cri-o://4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394" gracePeriod=30 Jul 08 18:05:10.552703 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.552668 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:05:10.631784 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631684 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9065b58b-29c1-4290-84c7-bc1fcbea327a-istiod-ca-cert\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.631784 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631732 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-podinfo\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.631784 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631787 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-data\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631813 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-token\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631879 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-credential-socket\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631907 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-socket\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631931 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-certs\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631959 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78tfm\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-kube-api-access-78tfm\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.631987 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-envoy\") pod \"9065b58b-29c1-4290-84c7-bc1fcbea327a\" (UID: \"9065b58b-29c1-4290-84c7-bc1fcbea327a\") " Jul 08 18:05:10.632347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632137 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:10.632347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632213 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:10.632347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632213 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9065b58b-29c1-4290-84c7-bc1fcbea327a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:10.632489 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632360 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:10.632489 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632372 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.632489 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632420 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.632597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.632522 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:10.634251 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.634223 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:10.634340 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.634326 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-kube-api-access-78tfm" (OuterVolumeSpecName: "kube-api-access-78tfm") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "kube-api-access-78tfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:10.634472 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.634445 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:10.634472 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.634451 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9065b58b-29c1-4290-84c7-bc1fcbea327a" (UID: "9065b58b-29c1-4290-84c7-bc1fcbea327a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:10.733569 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733523 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9065b58b-29c1-4290-84c7-bc1fcbea327a-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.733569 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733556 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.733569 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733567 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.733569 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733576 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.733873 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733587 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.733873 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733598 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78tfm\" (UniqueName: \"kubernetes.io/projected/9065b58b-29c1-4290-84c7-bc1fcbea327a-kube-api-access-78tfm\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.733873 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.733608 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9065b58b-29c1-4290-84c7-bc1fcbea327a-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:10.804617 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.804584 2559 generic.go:356] "Generic (PLEG): container finished" podID="9065b58b-29c1-4290-84c7-bc1fcbea327a" containerID="4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394" exitCode=0 Jul 08 18:05:10.804808 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.804649 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" Jul 08 18:05:10.804808 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.804665 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" event={"ID":"9065b58b-29c1-4290-84c7-bc1fcbea327a","Type":"ContainerDied","Data":"4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394"} Jul 08 18:05:10.804808 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.804725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572" event={"ID":"9065b58b-29c1-4290-84c7-bc1fcbea327a","Type":"ContainerDied","Data":"a330dae20f56ced72ae93c3d06dd7d38f2a14a638aae024755dc979c6a7f8bc9"} Jul 08 18:05:10.804808 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.804757 2559 scope.go:117] "RemoveContainer" containerID="4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394" Jul 08 18:05:10.815675 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.815648 2559 scope.go:117] "RemoveContainer" containerID="4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394" Jul 08 18:05:10.816020 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:05:10.815997 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394\": container with ID starting with 4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394 not found: ID does not exist" containerID="4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394" Jul 08 18:05:10.816102 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.816027 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394"} err="failed to get container status \"4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394\": rpc error: code = NotFound desc = could not find container \"4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394\": container with ID starting with 4a2f0b61a810f86225fbc73a53891ebc3235fa59ad47079a937949efabd17394 not found: ID does not exist" Jul 08 18:05:10.830308 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.830273 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572"] Jul 08 18:05:10.836000 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:10.835970 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a114503a-openshift-default-7f795769d7-2j572"] Jul 08 18:05:12.132615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.132572 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq"] Jul 08 18:05:12.133086 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.133064 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9065b58b-29c1-4290-84c7-bc1fcbea327a" containerName="istio-proxy" Jul 08 18:05:12.133194 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.133092 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9065b58b-29c1-4290-84c7-bc1fcbea327a" containerName="istio-proxy" Jul 08 18:05:12.133194 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.133166 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9065b58b-29c1-4290-84c7-bc1fcbea327a" containerName="istio-proxy" Jul 08 18:05:12.138287 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.138258 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.141084 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.141055 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9c953ff5-openshift-default-dockercfg-6d29d\"" Jul 08 18:05:12.150942 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.150903 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq"] Jul 08 18:05:12.247591 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-data\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.247591 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-socket\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.247843 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76030189-9470-47c5-92b3-f7fb6efcfddc-istiod-ca-cert\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.247843 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-credential-socket\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.247843 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfg88\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-kube-api-access-dfg88\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.247843 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-token\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.248030 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-envoy\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.248030 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-podinfo\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.248030 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.247955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-certs\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-data\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-socket\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76030189-9470-47c5-92b3-f7fb6efcfddc-istiod-ca-cert\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-credential-socket\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfg88\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-kube-api-access-dfg88\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-token\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-envoy\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-podinfo\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.349742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-certs\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.350049 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.349887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-socket\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.350049 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.350025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-credential-socket\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.350155 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.350074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-certs\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.350155 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.350136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-data\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.350248 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.350235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76030189-9470-47c5-92b3-f7fb6efcfddc-istiod-ca-cert\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.351984 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.351956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-envoy\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.352158 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.352140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-podinfo\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.362362 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.362316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfg88\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-kube-api-access-dfg88\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.362484 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.362362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-token\") pod \"e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.458843 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.458802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:12.465556 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.465527 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9065b58b-29c1-4290-84c7-bc1fcbea327a" path="/var/lib/kubelet/pods/9065b58b-29c1-4290-84c7-bc1fcbea327a/volumes" Jul 08 18:05:12.607462 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.607435 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq"] Jul 08 18:05:12.610275 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:05:12.610250 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76030189_9470_47c5_92b3_f7fb6efcfddc.slice/crio-b391591052f215cceff5a8091a5dd6af00d6005abe34d095521962dbde5b85c7 WatchSource:0}: Error finding container b391591052f215cceff5a8091a5dd6af00d6005abe34d095521962dbde5b85c7: Status 404 returned error can't find the container with id b391591052f215cceff5a8091a5dd6af00d6005abe34d095521962dbde5b85c7 Jul 08 18:05:12.612343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.612311 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:05:12.612414 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.612379 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:05:12.612414 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.612408 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:05:12.817188 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.817084 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" event={"ID":"76030189-9470-47c5-92b3-f7fb6efcfddc","Type":"ContainerStarted","Data":"8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173"} Jul 08 18:05:12.817188 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.817145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" event={"ID":"76030189-9470-47c5-92b3-f7fb6efcfddc","Type":"ContainerStarted","Data":"b391591052f215cceff5a8091a5dd6af00d6005abe34d095521962dbde5b85c7"} Jul 08 18:05:12.839707 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:12.839652 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" podStartSLOduration=0.839602169 podStartE2EDuration="839.602169ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:12.838343505 +0000 UTC m=+1582.901294921" watchObservedRunningTime="2026-07-08 18:05:12.839602169 +0000 UTC m=+1582.902553583" Jul 08 18:05:13.459471 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:13.459428 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:13.465211 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:13.465176 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:13.821381 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:13.821283 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:13.822289 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:13.822263 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:24.699474 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.699430 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq"] Jul 08 18:05:24.700191 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.699705 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" podUID="76030189-9470-47c5-92b3-f7fb6efcfddc" containerName="istio-proxy" containerID="cri-o://8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173" gracePeriod=30 Jul 08 18:05:24.848434 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.848406 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:24.875398 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875368 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-socket\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875398 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875402 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-credential-socket\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875652 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875420 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfg88\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-kube-api-access-dfg88\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875652 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875446 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-podinfo\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875652 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875483 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-data\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875652 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875535 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-token\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875652 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875557 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-envoy\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.875652 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875612 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76030189-9470-47c5-92b3-f7fb6efcfddc-istiod-ca-cert\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.877179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875672 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-certs\") pod \"76030189-9470-47c5-92b3-f7fb6efcfddc\" (UID: \"76030189-9470-47c5-92b3-f7fb6efcfddc\") " Jul 08 18:05:24.877179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.875842 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:24.877179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.876394 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.877179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.876456 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:24.877179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.876538 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:24.877179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.876799 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76030189-9470-47c5-92b3-f7fb6efcfddc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:24.878419 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.877276 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-data" (OuterVolumeSpecName: "istio-data") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:24.879069 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.879019 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-token" (OuterVolumeSpecName: "istio-token") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:24.879618 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.879574 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-kube-api-access-dfg88" (OuterVolumeSpecName: "kube-api-access-dfg88") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "kube-api-access-dfg88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:24.879870 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.879780 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:24.880172 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.880141 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76030189-9470-47c5-92b3-f7fb6efcfddc" (UID: "76030189-9470-47c5-92b3-f7fb6efcfddc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:24.881810 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.881781 2559 generic.go:356] "Generic (PLEG): container finished" podID="76030189-9470-47c5-92b3-f7fb6efcfddc" containerID="8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173" exitCode=0 Jul 08 18:05:24.881929 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.881837 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" Jul 08 18:05:24.881929 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.881897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" event={"ID":"76030189-9470-47c5-92b3-f7fb6efcfddc","Type":"ContainerDied","Data":"8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173"} Jul 08 18:05:24.882034 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.881942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq" event={"ID":"76030189-9470-47c5-92b3-f7fb6efcfddc","Type":"ContainerDied","Data":"b391591052f215cceff5a8091a5dd6af00d6005abe34d095521962dbde5b85c7"} Jul 08 18:05:24.882034 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.881971 2559 scope.go:117] "RemoveContainer" containerID="8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173" Jul 08 18:05:24.904370 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.904347 2559 scope.go:117] "RemoveContainer" containerID="8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173" Jul 08 18:05:24.904748 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:05:24.904722 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173\": container with ID starting with 8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173 not found: ID does not exist" containerID="8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173" Jul 08 18:05:24.904866 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.904756 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173"} err="failed to get container status \"8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173\": rpc error: code = NotFound desc = could not find container \"8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173\": container with ID starting with 8e5e97c858271aba5b7883a3d03c5a8b638c0c032e74d60742aed1e5dac17173 not found: ID does not exist" Jul 08 18:05:24.918963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.918922 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq"] Jul 08 18:05:24.922398 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.922365 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9c953ff5-openshift-default-5586df97c9-hrtgq"] Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976866 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976900 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976913 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfg88\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-kube-api-access-dfg88\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976925 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976934 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976942 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976949 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76030189-9470-47c5-92b3-f7fb6efcfddc-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:24.976963 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:24.976957 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76030189-9470-47c5-92b3-f7fb6efcfddc-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:26.465151 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:26.465117 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76030189-9470-47c5-92b3-f7fb6efcfddc" path="/var/lib/kubelet/pods/76030189-9470-47c5-92b3-f7fb6efcfddc/volumes" Jul 08 18:05:31.734849 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.734811 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z"] Jul 08 18:05:31.735303 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.735287 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76030189-9470-47c5-92b3-f7fb6efcfddc" containerName="istio-proxy" Jul 08 18:05:31.735343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.735306 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="76030189-9470-47c5-92b3-f7fb6efcfddc" containerName="istio-proxy" Jul 08 18:05:31.735385 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.735373 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="76030189-9470-47c5-92b3-f7fb6efcfddc" containerName="istio-proxy" Jul 08 18:05:31.738756 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.738725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.741289 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.741260 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-95e2b8a6-openshift-default-dockercfg-mjz44\"" Jul 08 18:05:31.751354 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.751322 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z"] Jul 08 18:05:31.852098 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-credential-socket\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852098 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8baee44d-0ede-41c4-871d-25ce3385fb14-istiod-ca-cert\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-socket\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc295\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-kube-api-access-dc295\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-podinfo\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-token\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-envoy\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-certs\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.852360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.852333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-data\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.953792 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-credential-socket\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.953792 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8baee44d-0ede-41c4-871d-25ce3385fb14-istiod-ca-cert\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-socket\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc295\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-kube-api-access-dc295\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-podinfo\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-token\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-envoy\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-certs\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954067 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.953981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-data\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954446 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.954234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-credential-socket\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954446 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.954330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-socket\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954554 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.954479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-data\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954606 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.954567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-certs\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.954823 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.954805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8baee44d-0ede-41c4-871d-25ce3385fb14-istiod-ca-cert\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.956395 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.956370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-envoy\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.956533 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.956515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-podinfo\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.970071 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.970033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc295\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-kube-api-access-dc295\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:31.970071 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:31.970050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-token\") pod \"e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:32.052199 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.052103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:32.194463 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.194424 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z"] Jul 08 18:05:32.197662 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:05:32.197606 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baee44d_0ede_41c4_871d_25ce3385fb14.slice/crio-39e8e539db0b5961f03587cf663d0bebac7f84477db78bd14dd68bcdfdcca493 WatchSource:0}: Error finding container 39e8e539db0b5961f03587cf663d0bebac7f84477db78bd14dd68bcdfdcca493: Status 404 returned error can't find the container with id 39e8e539db0b5961f03587cf663d0bebac7f84477db78bd14dd68bcdfdcca493 Jul 08 18:05:32.199878 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.199838 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:05:32.199981 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.199914 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:05:32.199981 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.199943 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:05:32.920496 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.920459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" event={"ID":"8baee44d-0ede-41c4-871d-25ce3385fb14","Type":"ContainerStarted","Data":"0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25"} Jul 08 18:05:32.920903 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.920528 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" event={"ID":"8baee44d-0ede-41c4-871d-25ce3385fb14","Type":"ContainerStarted","Data":"39e8e539db0b5961f03587cf663d0bebac7f84477db78bd14dd68bcdfdcca493"} Jul 08 18:05:32.955824 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:32.955769 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" podStartSLOduration=1.9557500669999999 podStartE2EDuration="1.955750067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:32.954392098 +0000 UTC m=+1603.017343512" watchObservedRunningTime="2026-07-08 18:05:32.955750067 +0000 UTC m=+1603.018701480" Jul 08 18:05:33.052809 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:33.052768 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:33.057810 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:33.057780 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:33.926443 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:33.926374 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:33.927512 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:33.927486 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:37.605741 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:37.605694 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z"] Jul 08 18:05:37.606249 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:37.605924 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" podUID="8baee44d-0ede-41c4-871d-25ce3385fb14" containerName="istio-proxy" containerID="cri-o://0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25" gracePeriod=30 Jul 08 18:05:42.864672 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.864619 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:42.953667 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953607 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc295\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-kube-api-access-dc295\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.953850 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953677 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-certs\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.953850 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953709 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-token\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.953850 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953726 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-data\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.953850 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953766 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-podinfo\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.953850 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953815 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-socket\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.953850 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953845 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-credential-socket\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.954155 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953940 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8baee44d-0ede-41c4-871d-25ce3385fb14-istiod-ca-cert\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.954155 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.953964 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-envoy\") pod \"8baee44d-0ede-41c4-871d-25ce3385fb14\" (UID: \"8baee44d-0ede-41c4-871d-25ce3385fb14\") " Jul 08 18:05:42.954155 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.954033 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:42.954309 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.954256 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:42.954309 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.954257 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:42.954551 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.954485 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8baee44d-0ede-41c4-871d-25ce3385fb14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:42.954668 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.954565 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:42.954735 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.954703 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-data" (OuterVolumeSpecName: "istio-data") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:42.956670 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.956615 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:42.956780 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.956681 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:42.956780 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.956688 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-token" (OuterVolumeSpecName: "istio-token") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:42.956866 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.956772 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-kube-api-access-dc295" (OuterVolumeSpecName: "kube-api-access-dc295") pod "8baee44d-0ede-41c4-871d-25ce3385fb14" (UID: "8baee44d-0ede-41c4-871d-25ce3385fb14"). InnerVolumeSpecName "kube-api-access-dc295". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:42.979001 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.978966 2559 generic.go:356] "Generic (PLEG): container finished" podID="8baee44d-0ede-41c4-871d-25ce3385fb14" containerID="0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25" exitCode=0 Jul 08 18:05:42.979185 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.979010 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" event={"ID":"8baee44d-0ede-41c4-871d-25ce3385fb14","Type":"ContainerDied","Data":"0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25"} Jul 08 18:05:42.979185 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.979050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" event={"ID":"8baee44d-0ede-41c4-871d-25ce3385fb14","Type":"ContainerDied","Data":"39e8e539db0b5961f03587cf663d0bebac7f84477db78bd14dd68bcdfdcca493"} Jul 08 18:05:42.979185 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.979071 2559 scope.go:117] "RemoveContainer" containerID="0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25" Jul 08 18:05:42.979185 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.979013 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z" Jul 08 18:05:42.988428 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.988397 2559 scope.go:117] "RemoveContainer" containerID="0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25" Jul 08 18:05:42.988796 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:05:42.988774 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25\": container with ID starting with 0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25 not found: ID does not exist" containerID="0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25" Jul 08 18:05:42.988866 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:42.988805 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25"} err="failed to get container status \"0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25\": rpc error: code = NotFound desc = could not find container \"0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25\": container with ID starting with 0700d17b307830db121f26977246321cd53b934c32b05461262bdb46d4d80b25 not found: ID does not exist" Jul 08 18:05:43.004259 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.004210 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z"] Jul 08 18:05:43.008760 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.008729 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-95e2b8a6-openshift-default-bfbd9d5dc-l6f6z"] Jul 08 18:05:43.055257 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055222 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055257 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055253 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055257 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055264 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8baee44d-0ede-41c4-871d-25ce3385fb14-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055461 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055273 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055461 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055281 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc295\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-kube-api-access-dc295\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055461 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055290 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055461 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055299 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:43.055461 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:43.055307 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8baee44d-0ede-41c4-871d-25ce3385fb14-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:05:44.467005 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:05:44.466966 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8baee44d-0ede-41c4-871d-25ce3385fb14" path="/var/lib/kubelet/pods/8baee44d-0ede-41c4-871d-25ce3385fb14/volumes" Jul 08 18:07:25.349668 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.349560 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw"] Jul 08 18:07:25.350116 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.349937 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8baee44d-0ede-41c4-871d-25ce3385fb14" containerName="istio-proxy" Jul 08 18:07:25.350116 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.349951 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8baee44d-0ede-41c4-871d-25ce3385fb14" containerName="istio-proxy" Jul 08 18:07:25.350116 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.350001 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8baee44d-0ede-41c4-871d-25ce3385fb14" containerName="istio-proxy" Jul 08 18:07:25.352999 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.352975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.357973 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.357949 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e894b595-openshift-default-dockercfg-fkdh7\"" Jul 08 18:07:25.408260 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.408221 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw"] Jul 08 18:07:25.459175 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-certs\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459394 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-credential-socket\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459394 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istiod-ca-cert\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459394 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-envoy\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459565 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ff9\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-kube-api-access-q9ff9\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459565 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459497 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-token\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459735 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-data\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459735 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-socket\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.459735 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.459655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-podinfo\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560207 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-token\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560207 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-data\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-socket\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-podinfo\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560299 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-certs\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-credential-socket\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istiod-ca-cert\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-envoy\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ff9\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-kube-api-access-q9ff9\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560911 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-data\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560911 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-socket\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.560911 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.560812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-credential-socket\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.561038 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.561018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-certs\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.561272 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.561247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istiod-ca-cert\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.562848 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.562827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-envoy\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.563034 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.563015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-podinfo\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.571315 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.571281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-token\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.571706 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.571681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ff9\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-kube-api-access-q9ff9\") pod \"e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.663849 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.663753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:25.812017 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.811989 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw"] Jul 08 18:07:25.814657 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:07:25.814601 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33d3365_8ac7_40d8_bc6f_6e520e199bb6.slice/crio-c6a799315969bde51075035a90c70b2f38bacacb0ab1212f82521a01be039633 WatchSource:0}: Error finding container c6a799315969bde51075035a90c70b2f38bacacb0ab1212f82521a01be039633: Status 404 returned error can't find the container with id c6a799315969bde51075035a90c70b2f38bacacb0ab1212f82521a01be039633 Jul 08 18:07:25.816869 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.816832 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:07:25.816955 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.816920 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:07:25.816998 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:25.816961 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:07:26.415157 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:26.415118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" event={"ID":"c33d3365-8ac7-40d8-bc6f-6e520e199bb6","Type":"ContainerStarted","Data":"406177cdee1e4e49d74897a9177e837fa9a36d31cdd470e69932d9261aaf2c64"} Jul 08 18:07:26.415571 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:26.415183 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" event={"ID":"c33d3365-8ac7-40d8-bc6f-6e520e199bb6","Type":"ContainerStarted","Data":"c6a799315969bde51075035a90c70b2f38bacacb0ab1212f82521a01be039633"} Jul 08 18:07:26.444016 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:26.443951 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" podStartSLOduration=1.4439294999999999 podStartE2EDuration="1.4439295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:07:26.44244782 +0000 UTC m=+1716.505399233" watchObservedRunningTime="2026-07-08 18:07:26.4439295 +0000 UTC m=+1716.506880913" Jul 08 18:07:26.664037 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:26.663996 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:26.669388 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:26.669304 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:27.419542 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:27.419515 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:27.420747 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:27.420724 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:43.461841 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:43.461790 2559 patch_prober.go:28] interesting pod/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 18:07:43.462281 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:43.461877 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 18:07:44.495741 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:44.495703 2559 generic.go:356] "Generic (PLEG): container finished" podID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerID="406177cdee1e4e49d74897a9177e837fa9a36d31cdd470e69932d9261aaf2c64" exitCode=0 Jul 08 18:07:44.496169 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:44.495774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" event={"ID":"c33d3365-8ac7-40d8-bc6f-6e520e199bb6","Type":"ContainerDied","Data":"406177cdee1e4e49d74897a9177e837fa9a36d31cdd470e69932d9261aaf2c64"} Jul 08 18:07:44.496231 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:44.496211 2559 scope.go:117] "RemoveContainer" containerID="406177cdee1e4e49d74897a9177e837fa9a36d31cdd470e69932d9261aaf2c64" Jul 08 18:07:44.497381 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:44.497348 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:07:44.497477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:44.497419 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:07:44.497477 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:44.497453 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:07:45.501598 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:45.501558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" event={"ID":"c33d3365-8ac7-40d8-bc6f-6e520e199bb6","Type":"ContainerStarted","Data":"cbd6aa0b9660d614996ed6a9acca113028b8a3bc711c28616fec8f5d46c2d27f"} Jul 08 18:07:45.664556 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:45.664517 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:45.668148 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:45.668117 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:46.506676 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:46.506641 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:46.507704 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:46.507686 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:50.303146 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:50.303101 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw"] Jul 08 18:07:50.303580 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:50.303307 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" containerID="cri-o://cbd6aa0b9660d614996ed6a9acca113028b8a3bc711c28616fec8f5d46c2d27f" gracePeriod=30 Jul 08 18:07:55.546733 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.546695 2559 generic.go:356] "Generic (PLEG): container finished" podID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerID="cbd6aa0b9660d614996ed6a9acca113028b8a3bc711c28616fec8f5d46c2d27f" exitCode=0 Jul 08 18:07:55.546733 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.546742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" event={"ID":"c33d3365-8ac7-40d8-bc6f-6e520e199bb6","Type":"ContainerDied","Data":"cbd6aa0b9660d614996ed6a9acca113028b8a3bc711c28616fec8f5d46c2d27f"} Jul 08 18:07:55.547204 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.546790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" event={"ID":"c33d3365-8ac7-40d8-bc6f-6e520e199bb6","Type":"ContainerDied","Data":"c6a799315969bde51075035a90c70b2f38bacacb0ab1212f82521a01be039633"} Jul 08 18:07:55.547204 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.546806 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6a799315969bde51075035a90c70b2f38bacacb0ab1212f82521a01be039633" Jul 08 18:07:55.547204 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.546820 2559 scope.go:117] "RemoveContainer" containerID="406177cdee1e4e49d74897a9177e837fa9a36d31cdd470e69932d9261aaf2c64" Jul 08 18:07:55.559041 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.559021 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:55.634965 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.634857 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-podinfo\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.634965 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.634898 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-socket\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.634965 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.634920 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-certs\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.634965 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.634938 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9ff9\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-kube-api-access-q9ff9\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635000 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-credential-socket\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635035 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-envoy\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635076 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-data\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635134 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istiod-ca-cert\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635165 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-token\") pod \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\" (UID: \"c33d3365-8ac7-40d8-bc6f-6e520e199bb6\") " Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635244 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:55.635290 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635258 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:55.635656 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635293 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:55.635656 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635490 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.635656 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635513 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.635656 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635529 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.635656 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.635583 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:07:55.636087 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.636066 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:55.637396 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.637366 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:55.637396 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.637370 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:07:55.637638 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.637601 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-kube-api-access-q9ff9" (OuterVolumeSpecName: "kube-api-access-q9ff9") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "kube-api-access-q9ff9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:07:55.637748 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.637611 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c33d3365-8ac7-40d8-bc6f-6e520e199bb6" (UID: "c33d3365-8ac7-40d8-bc6f-6e520e199bb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:07:55.736459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.736415 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.736459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.736448 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.736459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.736460 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.736459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.736467 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.736807 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.736475 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:55.736807 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:55.736483 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9ff9\" (UniqueName: \"kubernetes.io/projected/c33d3365-8ac7-40d8-bc6f-6e520e199bb6-kube-api-access-q9ff9\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:07:56.552383 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:56.552350 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw" Jul 08 18:07:56.597964 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:56.597927 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw"] Jul 08 18:07:56.609490 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:56.609453 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e894b595-openshift-default-79dbcc4f79-hjlkw"] Jul 08 18:07:58.466467 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:07:58.466422 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" path="/var/lib/kubelet/pods/c33d3365-8ac7-40d8-bc6f-6e520e199bb6/volumes" Jul 08 18:08:14.119040 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.119007 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr"] Jul 08 18:08:14.119533 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.119289 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" Jul 08 18:08:14.119533 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.119300 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" Jul 08 18:08:14.119533 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.119313 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" Jul 08 18:08:14.119533 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.119319 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" Jul 08 18:08:14.119533 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.119374 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" Jul 08 18:08:14.123878 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.123854 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.131302 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.131273 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-40518b0a-openshift-default-dockercfg-vz7b5\"" Jul 08 18:08:14.165137 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.165101 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr"] Jul 08 18:08:14.197189 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-data\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197189 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-token\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197465 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-podinfo\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197465 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-envoy\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197465 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-socket\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197465 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl68j\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-kube-api-access-bl68j\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197465 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-credential-socket\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197465 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a25fac0-1999-4eb1-b54c-658e3050f891-istiod-ca-cert\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.197712 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.197486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-certs\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.298731 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-socket\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.298876 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl68j\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-kube-api-access-bl68j\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.298876 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-credential-socket\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.298876 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a25fac0-1999-4eb1-b54c-658e3050f891-istiod-ca-cert\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.298876 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-certs\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.298876 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-data\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299124 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.298881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-token\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299124 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-podinfo\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299230 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-envoy\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299230 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299163 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-socket\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299354 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299222 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-credential-socket\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299354 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-certs\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299354 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-data\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.299605 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.299580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a25fac0-1999-4eb1-b54c-658e3050f891-istiod-ca-cert\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.301448 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.301422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-envoy\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.301711 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.301689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-podinfo\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.329230 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.329191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-token\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.341415 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.341374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl68j\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-kube-api-access-bl68j\") pod \"e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.434142 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.434099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:14.622771 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:08:14.622733 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a25fac0_1999_4eb1_b54c_658e3050f891.slice/crio-add0f0b45b643438718aaec2858b1f628da67b89f0a7ab3228c77db4b2541919 WatchSource:0}: Error finding container add0f0b45b643438718aaec2858b1f628da67b89f0a7ab3228c77db4b2541919: Status 404 returned error can't find the container with id add0f0b45b643438718aaec2858b1f628da67b89f0a7ab3228c77db4b2541919 Jul 08 18:08:14.624990 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.624955 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:08:14.625083 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.625032 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:08:14.625083 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.625062 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:08:14.637735 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:14.637702 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr"] Jul 08 18:08:15.632017 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:15.631983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" event={"ID":"6a25fac0-1999-4eb1-b54c-658e3050f891","Type":"ContainerStarted","Data":"c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0"} Jul 08 18:08:15.632454 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:15.632062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" event={"ID":"6a25fac0-1999-4eb1-b54c-658e3050f891","Type":"ContainerStarted","Data":"add0f0b45b643438718aaec2858b1f628da67b89f0a7ab3228c77db4b2541919"} Jul 08 18:08:15.693177 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:15.693120 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podStartSLOduration=1.693102454 podStartE2EDuration="1.693102454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:08:15.692186464 +0000 UTC m=+1765.755137877" watchObservedRunningTime="2026-07-08 18:08:15.693102454 +0000 UTC m=+1765.756053866" Jul 08 18:08:16.435104 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:16.435061 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:16.440244 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:16.440214 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:16.636582 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:16.636547 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:16.637594 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:16.637568 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:29.695996 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:29.695958 2559 generic.go:356] "Generic (PLEG): container finished" podID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerID="c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0" exitCode=0 Jul 08 18:08:29.696431 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:29.696031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" event={"ID":"6a25fac0-1999-4eb1-b54c-658e3050f891","Type":"ContainerDied","Data":"c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0"} Jul 08 18:08:29.696476 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:29.696458 2559 scope.go:117] "RemoveContainer" containerID="c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0" Jul 08 18:08:29.697513 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:29.697484 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:08:29.697589 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:29.697573 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:08:29.697662 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:29.697645 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:08:30.702040 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:30.702006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" event={"ID":"6a25fac0-1999-4eb1-b54c-658e3050f891","Type":"ContainerStarted","Data":"31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f"} Jul 08 18:08:31.435419 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:31.435382 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:31.436738 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:31.436694 2559 patch_prober.go:28] interesting pod/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 08 18:08:31.436899 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:31.436770 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 08 18:08:31.636827 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:31.636771 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:32.435502 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:32.435457 2559 patch_prober.go:28] interesting pod/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 08 18:08:32.436607 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:32.436144 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 08 18:08:33.435450 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:33.435409 2559 patch_prober.go:28] interesting pod/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 08 18:08:33.435830 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:33.435795 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 08 18:08:34.435084 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:34.435044 2559 patch_prober.go:28] interesting pod/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 08 18:08:34.435381 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:34.435351 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 08 18:08:35.438939 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:35.438908 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:08:35.439930 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:08:35.439911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:10:02.441805 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:02.441764 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr"] Jul 08 18:10:02.442387 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:02.441995 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" containerID="cri-o://31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f" gracePeriod=30 Jul 08 18:10:05.442024 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:05.441977 2559 patch_prober.go:28] interesting pod/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 18:10:05.442419 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:05.442046 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:10:07.689643 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.689605 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:10:07.798311 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798215 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-data\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798311 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798261 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-credential-socket\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798311 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798289 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl68j\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-kube-api-access-bl68j\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798311 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798308 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-socket\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798680 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798330 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-token\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798680 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798345 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a25fac0-1999-4eb1-b54c-658e3050f891-istiod-ca-cert\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798680 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798387 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-podinfo\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798680 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798409 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-certs\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798680 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798440 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-envoy\") pod \"6a25fac0-1999-4eb1-b54c-658e3050f891\" (UID: \"6a25fac0-1999-4eb1-b54c-658e3050f891\") " Jul 08 18:10:07.798680 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798595 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:10:07.799039 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798664 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:10:07.799039 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798784 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.799039 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798793 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:10:07.799039 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798805 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.799039 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.798897 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a25fac0-1999-4eb1-b54c-658e3050f891-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:10:07.799289 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.799263 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:10:07.800726 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.800698 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:10:07.800832 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.800806 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:10:07.801210 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.801190 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:10:07.801275 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.801255 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-kube-api-access-bl68j" (OuterVolumeSpecName: "kube-api-access-bl68j") pod "6a25fac0-1999-4eb1-b54c-658e3050f891" (UID: "6a25fac0-1999-4eb1-b54c-658e3050f891"). InnerVolumeSpecName "kube-api-access-bl68j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:10:07.899459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899417 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.899459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899455 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a25fac0-1999-4eb1-b54c-658e3050f891-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.899459 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899468 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.899764 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899480 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.899764 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899493 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.899764 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899503 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a25fac0-1999-4eb1-b54c-658e3050f891-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:07.899764 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:07.899514 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl68j\" (UniqueName: \"kubernetes.io/projected/6a25fac0-1999-4eb1-b54c-658e3050f891-kube-api-access-bl68j\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:10:08.118051 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.117947 2559 generic.go:356] "Generic (PLEG): container finished" podID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerID="31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f" exitCode=0 Jul 08 18:10:08.118051 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.118001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" event={"ID":"6a25fac0-1999-4eb1-b54c-658e3050f891","Type":"ContainerDied","Data":"31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f"} Jul 08 18:10:08.118051 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.118011 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" Jul 08 18:10:08.118051 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.118042 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr" event={"ID":"6a25fac0-1999-4eb1-b54c-658e3050f891","Type":"ContainerDied","Data":"add0f0b45b643438718aaec2858b1f628da67b89f0a7ab3228c77db4b2541919"} Jul 08 18:10:08.118473 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.118064 2559 scope.go:117] "RemoveContainer" containerID="31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f" Jul 08 18:10:08.127612 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.127590 2559 scope.go:117] "RemoveContainer" containerID="c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0" Jul 08 18:10:08.135758 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.135736 2559 scope.go:117] "RemoveContainer" containerID="31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f" Jul 08 18:10:08.136075 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:10:08.136055 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f\": container with ID starting with 31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f not found: ID does not exist" containerID="31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f" Jul 08 18:10:08.136132 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.136085 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f"} err="failed to get container status \"31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f\": rpc error: code = NotFound desc = could not find container \"31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f\": container with ID starting with 31970959ce8cce67f2bfea9e519413d0e84cbc9ee1315b35a4f053c1be5d141f not found: ID does not exist" Jul 08 18:10:08.136132 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.136106 2559 scope.go:117] "RemoveContainer" containerID="c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0" Jul 08 18:10:08.136348 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:10:08.136335 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0\": container with ID starting with c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0 not found: ID does not exist" containerID="c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0" Jul 08 18:10:08.136391 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.136352 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0"} err="failed to get container status \"c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0\": rpc error: code = NotFound desc = could not find container \"c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0\": container with ID starting with c0d08391964f6b75f12203270c57e1694d4c7abcd895953fa394acd0e585c0f0 not found: ID does not exist" Jul 08 18:10:08.150314 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.150281 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr"] Jul 08 18:10:08.153287 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.153256 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-40518b0a-openshift-default-66d7998795-cfbcr"] Jul 08 18:10:08.465698 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:10:08.465665 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" path="/var/lib/kubelet/pods/6a25fac0-1999-4eb1-b54c-658e3050f891/volumes" Jul 08 18:11:02.490763 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.490723 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb"] Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491190 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491212 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491239 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491251 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491336 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491347 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33d3365-8ac7-40d8-bc6f-6e520e199bb6" containerName="istio-proxy" Jul 08 18:11:02.491543 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.491358 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a25fac0-1999-4eb1-b54c-658e3050f891" containerName="istio-proxy" Jul 08 18:11:02.494458 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.494434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.497526 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.497500 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-bd74c9-openshift-default-dockercfg-sgdt2\"" Jul 08 18:11:02.510133 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.510095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb"] Jul 08 18:11:02.675096 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-token\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675277 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675110 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-podinfo\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675277 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffkrw\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-kube-api-access-ffkrw\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675277 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-credential-socket\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675277 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-data\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675413 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-socket\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675413 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-certs\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675413 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-envoy\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.675413 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.675362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1fd529c-e2f1-477e-aab0-aa371d02043a-istiod-ca-cert\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776318 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-token\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776318 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-podinfo\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776318 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffkrw\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-kube-api-access-ffkrw\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-credential-socket\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-data\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-socket\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-certs\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-envoy\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1fd529c-e2f1-477e-aab0-aa371d02043a-istiod-ca-cert\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776960 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776859 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-credential-socket\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.776960 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.776909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-socket\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.777043 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.777023 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-certs\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.777085 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.777046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-data\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.777241 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.777226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1fd529c-e2f1-477e-aab0-aa371d02043a-istiod-ca-cert\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.778783 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.778764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-envoy\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.779060 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.779039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-podinfo\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.795072 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.795033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-token\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.795800 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.795779 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffkrw\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-kube-api-access-ffkrw\") pod \"e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.806424 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.806392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:02.957049 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.957021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb"] Jul 08 18:11:02.959208 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:11:02.959185 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1fd529c_e2f1_477e_aab0_aa371d02043a.slice/crio-640161ef7981a5d2569321c1925e43ae3185df90978554f616136eb87fcc2306 WatchSource:0}: Error finding container 640161ef7981a5d2569321c1925e43ae3185df90978554f616136eb87fcc2306: Status 404 returned error can't find the container with id 640161ef7981a5d2569321c1925e43ae3185df90978554f616136eb87fcc2306 Jul 08 18:11:02.961293 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.961258 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:02.961392 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.961339 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:02.961392 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:02.961385 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:03.358502 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:03.358467 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" event={"ID":"e1fd529c-e2f1-477e-aab0-aa371d02043a","Type":"ContainerStarted","Data":"848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8"} Jul 08 18:11:03.358683 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:03.358526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" event={"ID":"e1fd529c-e2f1-477e-aab0-aa371d02043a","Type":"ContainerStarted","Data":"640161ef7981a5d2569321c1925e43ae3185df90978554f616136eb87fcc2306"} Jul 08 18:11:03.384183 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:03.384115 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podStartSLOduration=1.384091752 podStartE2EDuration="1.384091752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:11:03.383864849 +0000 UTC m=+1933.446816303" watchObservedRunningTime="2026-07-08 18:11:03.384091752 +0000 UTC m=+1933.447043166" Jul 08 18:11:03.806524 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:03.806480 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:04.812285 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:04.812240 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:05.367888 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:05.367859 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:05.368867 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:05.368842 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:10.717833 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.717793 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d"] Jul 08 18:11:10.721186 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.721158 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.725966 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.725936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-97d4b9-openshift-default-dockercfg-w7nrv\"" Jul 08 18:11:10.739650 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.739591 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d"] Jul 08 18:11:10.744824 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.744784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-credential-socket\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745011 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.744864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-certs\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745011 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.744903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a916a94f-3864-4f7a-a9f5-8e8752235d43-istiod-ca-cert\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745011 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.744925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx444\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-kube-api-access-gx444\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745011 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.744967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-podinfo\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745227 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.745021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-data\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745227 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.745052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-socket\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745227 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.745067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-envoy\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.745227 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.745088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-token\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.845764 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.845723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-data\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.845956 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.845779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-socket\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.845956 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.845894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-envoy\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.845956 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.845936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-token\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846127 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-credential-socket\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846127 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-certs\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846127 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a916a94f-3864-4f7a-a9f5-8e8752235d43-istiod-ca-cert\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846127 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx444\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-kube-api-access-gx444\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-podinfo\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846172 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-data\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-socket\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846478 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-certs\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846637 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-credential-socket\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.846946 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.846923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a916a94f-3864-4f7a-a9f5-8e8752235d43-istiod-ca-cert\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.848293 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.848264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-envoy\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.848583 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.848562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-podinfo\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.857311 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.857277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-token\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:10.858380 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:10.858358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx444\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-kube-api-access-gx444\") pod \"e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:11.032724 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.032585 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:11.213811 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.213782 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d"] Jul 08 18:11:11.215286 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:11:11.215259 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda916a94f_3864_4f7a_a9f5_8e8752235d43.slice/crio-4731b3ebb16e6a86c819e88eadcd9860994c54cef9917834a1b510ccaaf764cd WatchSource:0}: Error finding container 4731b3ebb16e6a86c819e88eadcd9860994c54cef9917834a1b510ccaaf764cd: Status 404 returned error can't find the container with id 4731b3ebb16e6a86c819e88eadcd9860994c54cef9917834a1b510ccaaf764cd Jul 08 18:11:11.217370 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.217340 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:11.217435 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.217405 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:11.217478 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.217441 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:11.395437 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.395268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" event={"ID":"a916a94f-3864-4f7a-a9f5-8e8752235d43","Type":"ContainerStarted","Data":"02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452"} Jul 08 18:11:11.395437 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.395351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" event={"ID":"a916a94f-3864-4f7a-a9f5-8e8752235d43","Type":"ContainerStarted","Data":"4731b3ebb16e6a86c819e88eadcd9860994c54cef9917834a1b510ccaaf764cd"} Jul 08 18:11:11.421206 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:11.421153 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podStartSLOduration=1.421132122 podStartE2EDuration="1.421132122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:11:11.419019989 +0000 UTC m=+1941.481971414" watchObservedRunningTime="2026-07-08 18:11:11.421132122 +0000 UTC m=+1941.484083535" Jul 08 18:11:12.032836 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:12.032793 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:12.038015 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:12.037985 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:12.400748 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:12.400662 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:12.401773 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:12.401751 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:21.409836 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:21.409785 2559 patch_prober.go:28] interesting pod/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 18:11:21.410292 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:21.409865 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 18:11:22.448127 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:22.448086 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerID="848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8" exitCode=0 Jul 08 18:11:22.448823 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:22.448164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" event={"ID":"e1fd529c-e2f1-477e-aab0-aa371d02043a","Type":"ContainerDied","Data":"848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8"} Jul 08 18:11:22.449505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:22.449485 2559 scope.go:117] "RemoveContainer" containerID="848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8" Jul 08 18:11:22.451583 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:22.451545 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:22.451819 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:22.451796 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:22.451952 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:22.451935 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:23.460158 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:23.459162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" event={"ID":"e1fd529c-e2f1-477e-aab0-aa371d02043a","Type":"ContainerStarted","Data":"6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40"} Jul 08 18:11:23.806853 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:23.806755 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:23.807040 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:23.807018 2559 patch_prober.go:28] interesting pod/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 18:11:23.807092 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:23.807070 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 18:11:24.807491 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:24.807453 2559 patch_prober.go:28] interesting pod/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 18:11:24.807941 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:24.807513 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 18:11:25.806911 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:25.806864 2559 patch_prober.go:28] interesting pod/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 18:11:25.807114 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:25.806926 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 18:11:26.806937 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:26.806887 2559 patch_prober.go:28] interesting pod/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 08 18:11:26.807429 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:26.806955 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 08 18:11:27.810422 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:27.810389 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:27.810838 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:27.810751 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:27.811712 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:27.811690 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:11:28.442828 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:28.442786 2559 patch_prober.go:28] interesting pod/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 18:11:28.443019 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:28.442858 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 18:11:29.492853 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:29.492772 2559 generic.go:356] "Generic (PLEG): container finished" podID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerID="02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452" exitCode=0 Jul 08 18:11:29.492853 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:29.492840 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" event={"ID":"a916a94f-3864-4f7a-a9f5-8e8752235d43","Type":"ContainerDied","Data":"02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452"} Jul 08 18:11:29.493303 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:29.493269 2559 scope.go:117] "RemoveContainer" containerID="02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452" Jul 08 18:11:29.494285 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:29.494253 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:29.494395 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:29.494337 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:29.494443 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:29.494416 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:11:30.504435 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:30.504395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" event={"ID":"a916a94f-3864-4f7a-a9f5-8e8752235d43","Type":"ContainerStarted","Data":"9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf"} Jul 08 18:11:31.033729 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:31.033689 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:31.033912 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:31.033884 2559 patch_prober.go:28] interesting pod/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 08 18:11:31.033955 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:31.033936 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 08 18:11:32.033491 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:32.033445 2559 patch_prober.go:28] interesting pod/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 08 18:11:32.033924 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:32.033506 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 08 18:11:33.033145 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:33.033108 2559 patch_prober.go:28] interesting pod/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 08 18:11:33.033330 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:33.033167 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 08 18:11:34.033903 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:34.033864 2559 patch_prober.go:28] interesting pod/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 08 18:11:34.034382 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:34.033928 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 08 18:11:35.037010 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:35.036981 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:35.037396 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:35.037260 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:11:35.038157 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:11:35.038140 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:13:17.246038 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:17.245995 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb"] Jul 08 18:13:17.246524 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:17.246211 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" containerID="cri-o://6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40" gracePeriod=30 Jul 08 18:13:22.507260 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.507181 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:13:22.542499 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542458 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-credential-socket\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542708 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542510 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffkrw\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-kube-api-access-ffkrw\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542708 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542553 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1fd529c-e2f1-477e-aab0-aa371d02043a-istiod-ca-cert\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542708 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542582 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-data\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542708 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542603 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-envoy\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542708 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542672 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-socket\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542978 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542716 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-podinfo\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542978 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542766 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-certs\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542978 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542794 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-token\") pod \"e1fd529c-e2f1-477e-aab0-aa371d02043a\" (UID: \"e1fd529c-e2f1-477e-aab0-aa371d02043a\") " Jul 08 18:13:22.542978 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.542827 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:22.543179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.543056 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1fd529c-e2f1-477e-aab0-aa371d02043a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:13:22.543179 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.543122 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.543366 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.543317 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:22.543451 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.543381 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:22.543671 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.543617 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:22.545061 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.545025 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:22.545191 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.545165 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:22.545241 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.545226 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:13:22.545385 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.545367 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-kube-api-access-ffkrw" (OuterVolumeSpecName: "kube-api-access-ffkrw") pod "e1fd529c-e2f1-477e-aab0-aa371d02043a" (UID: "e1fd529c-e2f1-477e-aab0-aa371d02043a"). InnerVolumeSpecName "kube-api-access-ffkrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:22.644525 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644483 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffkrw\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-kube-api-access-ffkrw\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644525 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644520 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1fd529c-e2f1-477e-aab0-aa371d02043a-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644525 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644530 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644525 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644539 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644851 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644546 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644851 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644555 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644851 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644563 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1fd529c-e2f1-477e-aab0-aa371d02043a-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.644851 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.644571 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1fd529c-e2f1-477e-aab0-aa371d02043a-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:22.989882 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.989842 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerID="6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40" exitCode=0 Jul 08 18:13:22.990068 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.989904 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" Jul 08 18:13:22.990068 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.989903 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" event={"ID":"e1fd529c-e2f1-477e-aab0-aa371d02043a","Type":"ContainerDied","Data":"6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40"} Jul 08 18:13:22.990068 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.989962 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb" event={"ID":"e1fd529c-e2f1-477e-aab0-aa371d02043a","Type":"ContainerDied","Data":"640161ef7981a5d2569321c1925e43ae3185df90978554f616136eb87fcc2306"} Jul 08 18:13:22.990068 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.989993 2559 scope.go:117] "RemoveContainer" containerID="6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40" Jul 08 18:13:22.999747 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:22.999605 2559 scope.go:117] "RemoveContainer" containerID="848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8" Jul 08 18:13:23.008175 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:23.008152 2559 scope.go:117] "RemoveContainer" containerID="6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40" Jul 08 18:13:23.008538 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:13:23.008517 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40\": container with ID starting with 6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40 not found: ID does not exist" containerID="6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40" Jul 08 18:13:23.008593 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:23.008552 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40"} err="failed to get container status \"6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40\": rpc error: code = NotFound desc = could not find container \"6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40\": container with ID starting with 6d66ec952194dd6e5a796baec643f594a6976dfaad53134df4ff36c22a14db40 not found: ID does not exist" Jul 08 18:13:23.008593 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:23.008573 2559 scope.go:117] "RemoveContainer" containerID="848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8" Jul 08 18:13:23.008918 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:13:23.008893 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8\": container with ID starting with 848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8 not found: ID does not exist" containerID="848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8" Jul 08 18:13:23.008962 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:23.008929 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8"} err="failed to get container status \"848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8\": rpc error: code = NotFound desc = could not find container \"848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8\": container with ID starting with 848211fe1b1a88b304ee645e0ce4f735ff72b3e146f07ae0e3e39de17cafd1b8 not found: ID does not exist" Jul 08 18:13:23.018011 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:23.017977 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb"] Jul 08 18:13:23.029327 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:23.029291 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-bd74c9-openshift-default-59f7d67747-ftqjb"] Jul 08 18:13:24.465715 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:24.465679 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" path="/var/lib/kubelet/pods/e1fd529c-e2f1-477e-aab0-aa371d02043a/volumes" Jul 08 18:13:25.035899 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:25.035860 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d"] Jul 08 18:13:25.036175 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:25.036151 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" containerID="cri-o://9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf" gracePeriod=30 Jul 08 18:13:30.291757 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.291727 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:13:30.419485 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419383 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-certs\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419485 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419436 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a916a94f-3864-4f7a-a9f5-8e8752235d43-istiod-ca-cert\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419485 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419460 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-token\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419485 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419477 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-socket\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419857 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419497 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-credential-socket\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419857 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419513 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-data\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419857 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419535 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-envoy\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419857 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419614 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx444\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-kube-api-access-gx444\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.419857 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419677 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-podinfo\") pod \"a916a94f-3864-4f7a-a9f5-8e8752235d43\" (UID: \"a916a94f-3864-4f7a-a9f5-8e8752235d43\") " Jul 08 18:13:30.420105 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.419935 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:30.420105 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.420048 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a916a94f-3864-4f7a-a9f5-8e8752235d43-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:13:30.420209 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.420145 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:30.420273 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.420231 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:30.420549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.420512 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-data" (OuterVolumeSpecName: "istio-data") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:30.421902 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.421880 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-token" (OuterVolumeSpecName: "istio-token") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:30.422004 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.421966 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-kube-api-access-gx444" (OuterVolumeSpecName: "kube-api-access-gx444") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "kube-api-access-gx444". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:30.422303 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.422283 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:30.422352 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.422310 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a916a94f-3864-4f7a-a9f5-8e8752235d43" (UID: "a916a94f-3864-4f7a-a9f5-8e8752235d43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:13:30.521346 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521296 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx444\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-kube-api-access-gx444\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521346 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521334 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521346 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521347 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521359 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a916a94f-3864-4f7a-a9f5-8e8752235d43-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521372 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521382 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521393 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521403 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:30.521597 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:30.521414 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a916a94f-3864-4f7a-a9f5-8e8752235d43-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:13:31.025564 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.025527 2559 generic.go:356] "Generic (PLEG): container finished" podID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerID="9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf" exitCode=0 Jul 08 18:13:31.025799 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.025578 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" event={"ID":"a916a94f-3864-4f7a-a9f5-8e8752235d43","Type":"ContainerDied","Data":"9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf"} Jul 08 18:13:31.025799 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.025581 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" Jul 08 18:13:31.025799 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.025650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d" event={"ID":"a916a94f-3864-4f7a-a9f5-8e8752235d43","Type":"ContainerDied","Data":"4731b3ebb16e6a86c819e88eadcd9860994c54cef9917834a1b510ccaaf764cd"} Jul 08 18:13:31.025799 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.025674 2559 scope.go:117] "RemoveContainer" containerID="9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf" Jul 08 18:13:31.034679 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.034657 2559 scope.go:117] "RemoveContainer" containerID="02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452" Jul 08 18:13:31.043147 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.043123 2559 scope.go:117] "RemoveContainer" containerID="9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf" Jul 08 18:13:31.043479 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:13:31.043453 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf\": container with ID starting with 9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf not found: ID does not exist" containerID="9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf" Jul 08 18:13:31.043555 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.043494 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf"} err="failed to get container status \"9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf\": rpc error: code = NotFound desc = could not find container \"9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf\": container with ID starting with 9104e922844d2bc33e402120716c6010041cf99740dc4309ee79c5deaca61caf not found: ID does not exist" Jul 08 18:13:31.043555 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.043524 2559 scope.go:117] "RemoveContainer" containerID="02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452" Jul 08 18:13:31.043837 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:13:31.043816 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452\": container with ID starting with 02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452 not found: ID does not exist" containerID="02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452" Jul 08 18:13:31.043880 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.043849 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452"} err="failed to get container status \"02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452\": rpc error: code = NotFound desc = could not find container \"02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452\": container with ID starting with 02f18800644d11d8c5c1202595bef6cc6003d6a37d896583e31bd07d133fc452 not found: ID does not exist" Jul 08 18:13:31.050806 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.050772 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d"] Jul 08 18:13:31.055813 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:31.055778 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-97d4b9-openshift-default-947978bb9-n977d"] Jul 08 18:13:32.466018 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:32.465980 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" path="/var/lib/kubelet/pods/a916a94f-3864-4f7a-a9f5-8e8752235d43/volumes" Jul 08 18:13:36.802011 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.801966 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x"] Jul 08 18:13:36.802505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802421 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" Jul 08 18:13:36.802505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802440 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" Jul 08 18:13:36.802505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802463 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" Jul 08 18:13:36.802505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802472 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" Jul 08 18:13:36.802505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802489 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" Jul 08 18:13:36.802505 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802500 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" Jul 08 18:13:36.802846 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802513 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" Jul 08 18:13:36.802846 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802522 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" Jul 08 18:13:36.802846 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802595 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" Jul 08 18:13:36.802846 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802607 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1fd529c-e2f1-477e-aab0-aa371d02043a" containerName="istio-proxy" Jul 08 18:13:36.802846 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.802618 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" Jul 08 18:13:36.807496 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.807469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.811910 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.811882 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1dc085-openshift-default-dockercfg-mcqlf\"" Jul 08 18:13:36.817239 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.817211 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x"] Jul 08 18:13:36.879412 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-credential-socket\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879412 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-envoy\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879687 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-data\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879687 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-istio-token\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879687 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73193c39-029b-4517-9190-d49dd73bfa70-istiod-ca-cert\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879687 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swzkw\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-kube-api-access-swzkw\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879687 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-socket\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879893 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73193c39-029b-4517-9190-d49dd73bfa70-istio-podinfo\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.879893 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.879718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-certs\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980199 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73193c39-029b-4517-9190-d49dd73bfa70-istiod-ca-cert\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980406 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzkw\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-kube-api-access-swzkw\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980406 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-socket\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980406 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73193c39-029b-4517-9190-d49dd73bfa70-istio-podinfo\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980406 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-certs\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980406 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-credential-socket\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980406 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-envoy\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980756 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-data\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980756 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-istio-token\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980862 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980800 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-certs\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980862 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-socket\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.980967 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.980928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-credential-socket\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.981069 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.981046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73193c39-029b-4517-9190-d49dd73bfa70-istiod-ca-cert\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.981133 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.981103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-data\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.982875 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.982846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-envoy\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.983068 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.983047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73193c39-029b-4517-9190-d49dd73bfa70-istio-podinfo\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.991347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.991314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-istio-token\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:36.991475 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:36.991431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzkw\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-kube-api-access-swzkw\") pod \"e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:37.120976 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:37.120868 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:37.270969 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:37.270934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x"] Jul 08 18:13:37.273302 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:13:37.273269 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73193c39_029b_4517_9190_d49dd73bfa70.slice/crio-3a2fb6c60c727b7d2401afac12194d7e095ce7a63b7632e228bee1a31c97500d WatchSource:0}: Error finding container 3a2fb6c60c727b7d2401afac12194d7e095ce7a63b7632e228bee1a31c97500d: Status 404 returned error can't find the container with id 3a2fb6c60c727b7d2401afac12194d7e095ce7a63b7632e228bee1a31c97500d Jul 08 18:13:37.275530 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:37.275490 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:13:37.275612 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:37.275574 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:13:37.275612 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:37.275607 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:13:38.058835 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:38.058794 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" event={"ID":"73193c39-029b-4517-9190-d49dd73bfa70","Type":"ContainerStarted","Data":"adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49"} Jul 08 18:13:38.059225 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:38.058848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" event={"ID":"73193c39-029b-4517-9190-d49dd73bfa70","Type":"ContainerStarted","Data":"3a2fb6c60c727b7d2401afac12194d7e095ce7a63b7632e228bee1a31c97500d"} Jul 08 18:13:38.084219 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:38.084168 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podStartSLOduration=2.084150184 podStartE2EDuration="2.084150184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:38.081855296 +0000 UTC m=+2088.144806710" watchObservedRunningTime="2026-07-08 18:13:38.084150184 +0000 UTC m=+2088.147101597" Jul 08 18:13:38.121780 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:38.121744 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:38.126900 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:38.126861 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:39.063777 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:39.063741 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:39.064892 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:39.064867 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:50.519835 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:50.519796 2559 scope.go:117] "RemoveContainer" containerID="cbd6aa0b9660d614996ed6a9acca113028b8a3bc711c28616fec8f5d46c2d27f" Jul 08 18:13:54.065079 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.065032 2559 patch_prober.go:28] interesting pod/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 08 18:13:54.065499 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.065096 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 08 18:13:54.135247 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.135215 2559 generic.go:356] "Generic (PLEG): container finished" podID="73193c39-029b-4517-9190-d49dd73bfa70" containerID="adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49" exitCode=0 Jul 08 18:13:54.135415 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.135265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" event={"ID":"73193c39-029b-4517-9190-d49dd73bfa70","Type":"ContainerDied","Data":"adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49"} Jul 08 18:13:54.135706 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.135691 2559 scope.go:117] "RemoveContainer" containerID="adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49" Jul 08 18:13:54.136804 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.136772 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:13:54.136924 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.136844 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:13:54.136924 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:54.136878 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:13:55.146298 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:55.145278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" event={"ID":"73193c39-029b-4517-9190-d49dd73bfa70","Type":"ContainerStarted","Data":"df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093"} Jul 08 18:13:56.121213 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:56.121179 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:13:56.121501 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:56.121476 2559 patch_prober.go:28] interesting pod/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 08 18:13:56.121601 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:56.121534 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 08 18:13:57.121553 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:57.121513 2559 patch_prober.go:28] interesting pod/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 08 18:13:57.121989 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:57.121574 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 08 18:13:58.122023 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:58.121981 2559 patch_prober.go:28] interesting pod/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 08 18:13:58.122439 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:58.122057 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 08 18:13:59.121742 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:59.121704 2559 patch_prober.go:28] interesting pod/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 08 18:13:59.121936 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:13:59.121760 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 08 18:14:00.125944 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:00.125906 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:14:00.126357 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:00.126319 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:14:00.127100 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:00.127079 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:14:07.463326 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:07.463287 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x"] Jul 08 18:14:07.463736 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:07.463542 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" containerID="cri-o://df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093" gracePeriod=30 Jul 08 18:14:08.325348 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.325313 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm"] Jul 08 18:14:08.325856 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.325842 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a916a94f-3864-4f7a-a9f5-8e8752235d43" containerName="istio-proxy" Jul 08 18:14:08.328304 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.328282 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.330779 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.330754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1c14cf-openshift-default-dockercfg-h2j5s\"" Jul 08 18:14:08.340335 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.340304 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm"] Jul 08 18:14:08.464071 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-socket\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-podinfo\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmhh\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-kube-api-access-8wmhh\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-credential-socket\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istiod-ca-cert\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-envoy\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-certs\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-data\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.464549 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.464472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-token\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565262 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istiod-ca-cert\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565442 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-envoy\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565442 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-certs\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565442 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-data\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565610 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-token\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565610 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-socket\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565610 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-podinfo\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565805 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmhh\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-kube-api-access-8wmhh\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565805 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-credential-socket\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565913 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-certs\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.565913 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.565867 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-data\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.566142 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.566118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-socket\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.566142 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.566133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istiod-ca-cert\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.566238 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.566208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-credential-socket\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.568078 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.568052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-envoy\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.568529 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.568510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-podinfo\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.576646 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.576560 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-token\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.576803 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.576599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmhh\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-kube-api-access-8wmhh\") pod \"e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.639995 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.639962 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:08.788352 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.788325 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm"] Jul 08 18:14:08.790638 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:14:08.790578 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43e6e1f_3bc6_4e4e_b0a8_94cfdfca8f3b.slice/crio-c2166f274456f4fd1608e07990dbd6b526aabdbbc61af40387a0fedca2d9221f WatchSource:0}: Error finding container c2166f274456f4fd1608e07990dbd6b526aabdbbc61af40387a0fedca2d9221f: Status 404 returned error can't find the container with id c2166f274456f4fd1608e07990dbd6b526aabdbbc61af40387a0fedca2d9221f Jul 08 18:14:08.792949 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.792914 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:14:08.793038 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.792996 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:14:08.793038 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:08.793027 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:14:09.213260 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:09.213225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" event={"ID":"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b","Type":"ContainerStarted","Data":"da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd"} Jul 08 18:14:09.213438 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:09.213280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" event={"ID":"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b","Type":"ContainerStarted","Data":"c2166f274456f4fd1608e07990dbd6b526aabdbbc61af40387a0fedca2d9221f"} Jul 08 18:14:09.236161 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:09.236098 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podStartSLOduration=1.236080276 podStartE2EDuration="1.236080276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:14:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:14:09.235102149 +0000 UTC m=+2119.298053564" watchObservedRunningTime="2026-07-08 18:14:09.236080276 +0000 UTC m=+2119.299031690" Jul 08 18:14:09.640799 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:09.640705 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:09.646161 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:09.646128 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:10.217645 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:10.217583 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:10.218493 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:10.218472 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:12.717603 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.717571 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:14:12.805347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805239 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-data\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805288 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-istio-token\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805347 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805317 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-envoy\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805619 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805376 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swzkw\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-kube-api-access-swzkw\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805619 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805441 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-socket\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805619 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805476 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73193c39-029b-4517-9190-d49dd73bfa70-istiod-ca-cert\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805619 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805503 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-certs\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805619 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805537 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-credential-socket\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805619 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805605 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73193c39-029b-4517-9190-d49dd73bfa70-istio-podinfo\") pod \"73193c39-029b-4517-9190-d49dd73bfa70\" (UID: \"73193c39-029b-4517-9190-d49dd73bfa70\") " Jul 08 18:14:12.805959 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805827 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:14:12.805959 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805882 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73193c39-029b-4517-9190-d49dd73bfa70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:14:12.805959 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.805939 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.806114 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.806028 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:14:12.806114 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.806071 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:14:12.806230 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.806203 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-data" (OuterVolumeSpecName: "istio-data") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:14:12.807762 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.807733 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-istio-token" (OuterVolumeSpecName: "istio-token") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:14:12.807902 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.807737 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:14:12.807902 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.807844 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-kube-api-access-swzkw" (OuterVolumeSpecName: "kube-api-access-swzkw") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "kube-api-access-swzkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:14:12.807979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.807904 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73193c39-029b-4517-9190-d49dd73bfa70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73193c39-029b-4517-9190-d49dd73bfa70" (UID: "73193c39-029b-4517-9190-d49dd73bfa70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:14:12.907211 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907166 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907211 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907202 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907211 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907212 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907211 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907222 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swzkw\" (UniqueName: \"kubernetes.io/projected/73193c39-029b-4517-9190-d49dd73bfa70-kube-api-access-swzkw\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907487 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907232 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907487 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907241 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73193c39-029b-4517-9190-d49dd73bfa70-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907487 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907250 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73193c39-029b-4517-9190-d49dd73bfa70-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:12.907487 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:12.907258 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73193c39-029b-4517-9190-d49dd73bfa70-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:14:13.232357 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.232320 2559 generic.go:356] "Generic (PLEG): container finished" podID="73193c39-029b-4517-9190-d49dd73bfa70" containerID="df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093" exitCode=0 Jul 08 18:14:13.232565 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.232374 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" Jul 08 18:14:13.232565 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.232405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" event={"ID":"73193c39-029b-4517-9190-d49dd73bfa70","Type":"ContainerDied","Data":"df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093"} Jul 08 18:14:13.232565 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.232470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x" event={"ID":"73193c39-029b-4517-9190-d49dd73bfa70","Type":"ContainerDied","Data":"3a2fb6c60c727b7d2401afac12194d7e095ce7a63b7632e228bee1a31c97500d"} Jul 08 18:14:13.232565 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.232502 2559 scope.go:117] "RemoveContainer" containerID="df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093" Jul 08 18:14:13.241681 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.241657 2559 scope.go:117] "RemoveContainer" containerID="adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49" Jul 08 18:14:13.249780 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.249758 2559 scope.go:117] "RemoveContainer" containerID="df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093" Jul 08 18:14:13.250106 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:14:13.250086 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093\": container with ID starting with df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093 not found: ID does not exist" containerID="df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093" Jul 08 18:14:13.250204 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.250116 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093"} err="failed to get container status \"df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093\": rpc error: code = NotFound desc = could not find container \"df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093\": container with ID starting with df2a65240c447a4a7fd5fe05c9d9e9065aeac627635f8c0c80cdf47e154a5093 not found: ID does not exist" Jul 08 18:14:13.250204 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.250134 2559 scope.go:117] "RemoveContainer" containerID="adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49" Jul 08 18:14:13.250393 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:14:13.250373 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49\": container with ID starting with adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49 not found: ID does not exist" containerID="adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49" Jul 08 18:14:13.250442 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.250403 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49"} err="failed to get container status \"adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49\": rpc error: code = NotFound desc = could not find container \"adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49\": container with ID starting with adfd4523475762e3779e137fcd0326708a5ece14431274ae8e061e19b830da49 not found: ID does not exist" Jul 08 18:14:13.274689 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.274648 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x"] Jul 08 18:14:13.283132 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:13.283101 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1dc085-openshift-default-67bdc847ff-8qp6x"] Jul 08 18:14:14.466242 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:14.466207 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73193c39-029b-4517-9190-d49dd73bfa70" path="/var/lib/kubelet/pods/73193c39-029b-4517-9190-d49dd73bfa70/volumes" Jul 08 18:14:25.219527 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.219492 2559 patch_prober.go:28] interesting pod/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 08 18:14:25.219958 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.219548 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 08 18:14:25.290821 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.290786 2559 generic.go:356] "Generic (PLEG): container finished" podID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerID="da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd" exitCode=0 Jul 08 18:14:25.290995 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.290829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" event={"ID":"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b","Type":"ContainerDied","Data":"da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd"} Jul 08 18:14:25.291212 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.291197 2559 scope.go:117] "RemoveContainer" containerID="da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd" Jul 08 18:14:25.292241 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.292214 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:14:25.292303 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.292291 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:14:25.292337 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:25.292326 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:14:26.296892 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:26.296847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" event={"ID":"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b","Type":"ContainerStarted","Data":"08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74"} Jul 08 18:14:26.640528 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:26.640425 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:26.640888 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:26.640863 2559 patch_prober.go:28] interesting pod/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 08 18:14:26.641039 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:26.641014 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 08 18:14:27.641470 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:27.641430 2559 patch_prober.go:28] interesting pod/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 08 18:14:27.642551 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:27.642107 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 08 18:14:28.646444 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:28.645915 2559 patch_prober.go:28] interesting pod/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 08 18:14:28.646444 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:28.645985 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 08 18:14:29.640848 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:29.640796 2559 patch_prober.go:28] interesting pod/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 08 18:14:29.641090 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:29.640891 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 08 18:14:30.646038 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:30.646004 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:30.646413 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:30.646291 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:14:30.646920 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:14:30.646902 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:17:36.492060 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:36.492021 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm"] Jul 08 18:17:36.492644 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:36.492237 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" containerID="cri-o://08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74" gracePeriod=30 Jul 08 18:17:41.754672 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.754577 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:17:41.845157 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845115 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-certs\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845364 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845182 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-envoy\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845364 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845239 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-socket\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845364 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845258 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istiod-ca-cert\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845364 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845290 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-credential-socket\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845364 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845317 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-data\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845364 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845348 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-podinfo\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845715 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845371 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-token\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845715 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845400 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wmhh\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-kube-api-access-8wmhh\") pod \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\" (UID: \"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b\") " Jul 08 18:17:41.845715 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845556 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:41.845884 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845714 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.845884 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845795 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:41.845884 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845829 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:17:41.846037 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.845889 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:41.846280 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.846249 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:41.847491 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.847462 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:41.847651 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.847617 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:17:41.847728 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.847703 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-kube-api-access-8wmhh" (OuterVolumeSpecName: "kube-api-access-8wmhh") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "kube-api-access-8wmhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:17:41.847728 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.847709 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" (UID: "e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:17:41.947110 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947057 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wmhh\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-kube-api-access-8wmhh\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947110 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947097 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-workload-certs\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947110 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947108 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-envoy\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947110 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947116 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istiod-ca-cert\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947110 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947124 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-credential-socket\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947575 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947134 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-data\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947575 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947142 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-podinfo\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:41.947575 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:41.947150 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b-istio-token\") on node \"ip-10-0-136-203.ec2.internal\" DevicePath \"\"" Jul 08 18:17:42.131387 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.131296 2559 generic.go:356] "Generic (PLEG): container finished" podID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerID="08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74" exitCode=0 Jul 08 18:17:42.131387 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.131352 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" Jul 08 18:17:42.131579 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.131381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" event={"ID":"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b","Type":"ContainerDied","Data":"08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74"} Jul 08 18:17:42.131579 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.131466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm" event={"ID":"e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b","Type":"ContainerDied","Data":"c2166f274456f4fd1608e07990dbd6b526aabdbbc61af40387a0fedca2d9221f"} Jul 08 18:17:42.131579 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.131490 2559 scope.go:117] "RemoveContainer" containerID="08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74" Jul 08 18:17:42.141490 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.141465 2559 scope.go:117] "RemoveContainer" containerID="da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd" Jul 08 18:17:42.149584 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.149562 2559 scope.go:117] "RemoveContainer" containerID="08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74" Jul 08 18:17:42.149940 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:17:42.149920 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74\": container with ID starting with 08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74 not found: ID does not exist" containerID="08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74" Jul 08 18:17:42.149997 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.149952 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74"} err="failed to get container status \"08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74\": rpc error: code = NotFound desc = could not find container \"08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74\": container with ID starting with 08542e3413eb2437f5b213865478f21c3f5a72422e406baf676e1f8e79c05c74 not found: ID does not exist" Jul 08 18:17:42.149997 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.149972 2559 scope.go:117] "RemoveContainer" containerID="da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd" Jul 08 18:17:42.150264 ip-10-0-136-203 kubenswrapper[2559]: E0708 18:17:42.150239 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd\": container with ID starting with da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd not found: ID does not exist" containerID="da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd" Jul 08 18:17:42.150323 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.150269 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd"} err="failed to get container status \"da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd\": rpc error: code = NotFound desc = could not find container \"da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd\": container with ID starting with da5e737fe21980decaff62bc911552caaf715a38cf2be57b24fdb9b21d8f1edd not found: ID does not exist" Jul 08 18:17:42.160615 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.160577 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm"] Jul 08 18:17:42.169454 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.169421 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1c14cf-openshift-default-74f8cd5dcf-dqvxm"] Jul 08 18:17:42.466258 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:42.466221 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" path="/var/lib/kubelet/pods/e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b/volumes" Jul 08 18:17:51.128315 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:51.128285 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dcf78d495-8hlvd_1ed586ec-9a9b-48b4-852d-826f77053c7f/copy-manifests/0.log" Jul 08 18:17:51.137336 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:51.137302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dcf78d495-8hlvd_1ed586ec-9a9b-48b4-852d-826f77053c7f/manager/0.log" Jul 08 18:17:53.597673 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:53.597609 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t6h9v_2bf42a54-f70e-48c6-b488-ef81f81cc471/istio-proxy/0.log" Jul 08 18:17:53.723261 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:53.723219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-55n5x_5279eed3-5e03-4b22-b6d3-d1eec5770b8e/discovery/0.log" Jul 08 18:17:54.055319 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:54.055279 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/1.log" Jul 08 18:17:54.859930 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:54.859903 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hk77q_c8cc00d2-af85-43a7-b8a7-e14c89fc6d93/main/0.log" Jul 08 18:17:55.083948 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:17:55.083920 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm5crt_93cdaa8a-4a1a-4bdf-9731-7ab722fe4a93/main/0.log" Jul 08 18:18:02.930977 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:02.930926 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lk652_deb22042-8c30-44e7-829d-a905c9957d53/global-pull-secret-syncer/0.log" Jul 08 18:18:03.041691 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:03.041653 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-klt62_84c3138a-3638-4230-ac62-62ff579b23e3/konnectivity-agent/0.log" Jul 08 18:18:03.183343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:03.183315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-203.ec2.internal_c0ce9e9a292ed52094c87bbcba5cc0e4/haproxy/0.log" Jul 08 18:18:11.594244 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:11.594208 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rwlx_088550d3-f091-42f8-9b19-fcb6667b40bf/node-exporter/0.log" Jul 08 18:18:11.638343 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:11.638295 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rwlx_088550d3-f091-42f8-9b19-fcb6667b40bf/kube-rbac-proxy/0.log" Jul 08 18:18:11.673723 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:11.673692 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rwlx_088550d3-f091-42f8-9b19-fcb6667b40bf/init-textfile/0.log" Jul 08 18:18:12.680450 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680410 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb"] Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680855 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680874 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680887 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680895 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680907 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680937 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680948 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" Jul 08 18:18:12.680979 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.680956 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" Jul 08 18:18:12.681356 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.681060 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" Jul 08 18:18:12.681356 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.681071 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="73193c39-029b-4517-9190-d49dd73bfa70" containerName="istio-proxy" Jul 08 18:18:12.681356 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.681080 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" Jul 08 18:18:12.681356 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.681089 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43e6e1f-3bc6-4e4e-b0a8-94cfdfca8f3b" containerName="istio-proxy" Jul 08 18:18:12.684442 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.684416 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.687360 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.687332 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdpqb\"/\"kube-root-ca.crt\"" Jul 08 18:18:12.688219 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.688188 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gdpqb\"/\"default-dockercfg-tn67x\"" Jul 08 18:18:12.688531 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.688512 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdpqb\"/\"openshift-service-ca.crt\"" Jul 08 18:18:12.696372 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.696324 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb"] Jul 08 18:18:12.712604 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.712569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-podres\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.712810 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.712643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-lib-modules\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.712810 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.712665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cggmh\" (UniqueName: \"kubernetes.io/projected/aa24e055-a9be-4060-83f1-6d9f06b16f3e-kube-api-access-cggmh\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.712810 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.712688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-proc\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.712810 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.712762 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-sys\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813688 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-lib-modules\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813688 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cggmh\" (UniqueName: \"kubernetes.io/projected/aa24e055-a9be-4060-83f1-6d9f06b16f3e-kube-api-access-cggmh\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813954 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-proc\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813954 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-sys\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813954 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-podres\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813954 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813844 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-lib-modules\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813954 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813920 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-proc\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.813954 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-sys\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.814149 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.813961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa24e055-a9be-4060-83f1-6d9f06b16f3e-podres\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.823381 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.823348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cggmh\" (UniqueName: \"kubernetes.io/projected/aa24e055-a9be-4060-83f1-6d9f06b16f3e-kube-api-access-cggmh\") pod \"perf-node-gather-daemonset-tc5kb\" (UID: \"aa24e055-a9be-4060-83f1-6d9f06b16f3e\") " pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:12.998788 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:12.998747 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:13.150310 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:13.150272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb"] Jul 08 18:18:13.155143 ip-10-0-136-203 kubenswrapper[2559]: W0708 18:18:13.155108 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa24e055_a9be_4060_83f1_6d9f06b16f3e.slice/crio-a5340865ce6c904b2a7a87f223938df744b925862285142adbb81cf852652ab5 WatchSource:0}: Error finding container a5340865ce6c904b2a7a87f223938df744b925862285142adbb81cf852652ab5: Status 404 returned error can't find the container with id a5340865ce6c904b2a7a87f223938df744b925862285142adbb81cf852652ab5 Jul 08 18:18:13.275376 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:13.275273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" event={"ID":"aa24e055-a9be-4060-83f1-6d9f06b16f3e","Type":"ContainerStarted","Data":"81737e658b92bfdd395d3b61e029c6f26bb184e192eb034ed4bed38426fc2dce"} Jul 08 18:18:13.275376 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:13.275341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" event={"ID":"aa24e055-a9be-4060-83f1-6d9f06b16f3e","Type":"ContainerStarted","Data":"a5340865ce6c904b2a7a87f223938df744b925862285142adbb81cf852652ab5"} Jul 08 18:18:13.275571 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:13.275382 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:13.299145 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:13.299083 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" podStartSLOduration=1.299065723 podStartE2EDuration="1.299065723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:13.297278472 +0000 UTC m=+2363.360229916" watchObservedRunningTime="2026-07-08 18:18:13.299065723 +0000 UTC m=+2363.362017135" Jul 08 18:18:13.815317 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:13.815269 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-2nlqf_af30f307-3c91-4cda-b6b7-74e2972db207/networking-console-plugin/0.log" Jul 08 18:18:17.335247 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:17.335217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tspzj_aa8a9333-0484-40e1-b0ce-26ab57fc8848/dns/0.log" Jul 08 18:18:17.370268 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:17.370241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tspzj_aa8a9333-0484-40e1-b0ce-26ab57fc8848/kube-rbac-proxy/0.log" Jul 08 18:18:17.438879 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:17.438847 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44qjc_72c39a38-4a03-4003-b332-83717330276a/dns-node-resolver/0.log" Jul 08 18:18:18.153301 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:18.153265 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59f9cc9f-p752f_771fdf55-2329-4670-b2c4-ca5022ab37d0/registry/0.log" Jul 08 18:18:18.240999 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:18.240966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t44lb_0a67156a-9db7-4747-ad82-b2e8e98b9fc3/node-ca/0.log" Jul 08 18:18:19.289089 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:19.289054 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gdpqb/perf-node-gather-daemonset-tc5kb" Jul 08 18:18:19.416087 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:19.416042 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t6h9v_2bf42a54-f70e-48c6-b488-ef81f81cc471/istio-proxy/0.log" Jul 08 18:18:19.538396 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:19.538352 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-55n5x_5279eed3-5e03-4b22-b6d3-d1eec5770b8e/discovery/0.log" Jul 08 18:18:19.641998 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:19.641912 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/0.log" Jul 08 18:18:19.670988 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:19.670953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/1.log" Jul 08 18:18:20.633618 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:20.633586 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dv6gz_746d1e81-4e5c-48bc-9a98-455bc671e8b9/serve-healthcheck-canary/0.log" Jul 08 18:18:21.648016 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:21.647988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fm2m7_c26cb933-469c-4e86-8f97-11ff7da58cd8/kube-rbac-proxy/0.log" Jul 08 18:18:21.695582 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:21.695549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fm2m7_c26cb933-469c-4e86-8f97-11ff7da58cd8/exporter/0.log" Jul 08 18:18:21.731188 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:21.731161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fm2m7_c26cb933-469c-4e86-8f97-11ff7da58cd8/extractor/0.log" Jul 08 18:18:23.299604 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:23.299566 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t6h9v_2bf42a54-f70e-48c6-b488-ef81f81cc471/istio-proxy/0.log" Jul 08 18:18:23.401675 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:23.401644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-55n5x_5279eed3-5e03-4b22-b6d3-d1eec5770b8e/discovery/0.log" Jul 08 18:18:23.465130 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:23.465096 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/0.log" Jul 08 18:18:23.492726 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:23.492689 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/1.log" Jul 08 18:18:24.959831 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:24.959795 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t6h9v_2bf42a54-f70e-48c6-b488-ef81f81cc471/istio-proxy/0.log" Jul 08 18:18:25.062394 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:25.062350 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-55n5x_5279eed3-5e03-4b22-b6d3-d1eec5770b8e/discovery/0.log" Jul 08 18:18:25.126449 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:25.126400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/0.log" Jul 08 18:18:25.144558 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:25.144501 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dcf78d495-8hlvd_1ed586ec-9a9b-48b4-852d-826f77053c7f/manager/0.log" Jul 08 18:18:25.156361 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:25.156316 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-f49gl_ee537f86-dacb-4e45-aaf5-3e1ec220561c/istio-proxy/1.log" Jul 08 18:18:25.173874 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:25.173844 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dcf78d495-8hlvd_1ed586ec-9a9b-48b4-852d-826f77053c7f/copy-manifests/0.log" Jul 08 18:18:26.458398 ip-10-0-136-203 kubenswrapper[2559]: I0708 18:18:26.458361 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fbcbf7958-78xvt_a1bdefe2-8f37-438d-b65a-251562a1e994/manager/0.log"