Jul 23 14:52:34.868146 ip-10-0-143-139 systemd[1]: Starting Kubernetes Kubelet... Jul 23 14:52:35.203454 ip-10-0-143-139 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 14:52:35.203454 ip-10-0-143-139 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 14:52:35.203454 ip-10-0-143-139 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 14:52:35.203454 ip-10-0-143-139 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 14:52:35.203454 ip-10-0-143-139 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 14:52:35.205111 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.204997 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 14:52:35.209112 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209099 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:52:35.209112 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209113 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209116 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209119 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209122 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209125 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209127 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209130 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209133 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209136 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209139 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209141 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209144 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209146 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209149 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209151 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209154 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209157 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209166 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209170 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209173 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:52:35.209169 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209176 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209179 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209182 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209185 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209189 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209192 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209195 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209198 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209200 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209203 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209205 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209209 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209212 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209215 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209219 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209222 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209225 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209227 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209230 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:52:35.209636 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209232 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209234 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209237 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209239 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209241 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209244 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209246 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209249 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209251 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209253 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209256 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209259 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209261 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209263 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209266 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209269 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209272 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209274 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209277 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209280 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:52:35.210096 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209283 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209285 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209288 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209290 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209293 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209295 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209297 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209300 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209302 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209305 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209308 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209310 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209312 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209315 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209317 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209319 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209322 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209324 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209327 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209329 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:52:35.210662 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209332 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209334 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209337 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209342 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209345 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209347 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209350 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209353 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209355 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209358 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209360 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209362 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209365 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209367 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209370 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209372 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209375 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209377 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.209380 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:52:35.211157 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210749 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210757 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210762 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210766 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210778 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210781 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210784 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210787 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210789 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210792 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210795 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210799 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210803 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210805 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210808 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210811 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210814 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210817 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:52:35.211605 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210822 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210825 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210827 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210830 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210832 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210835 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210837 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210840 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210842 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210845 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210847 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210851 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210854 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210857 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210860 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210862 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210865 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210868 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210886 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:52:35.212079 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210889 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210892 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210895 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210898 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210901 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210905 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210908 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210911 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210914 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210916 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210919 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210921 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210924 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210927 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210929 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210931 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210934 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210936 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210939 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210941 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:52:35.212541 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210943 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210946 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210948 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210951 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210953 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210956 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210958 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210960 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210963 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210965 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210968 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210970 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210972 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210974 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210977 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210979 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210982 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210984 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210987 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210990 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:52:35.213029 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210993 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210995 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.210998 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211001 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211003 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211006 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211009 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211011 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211013 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211016 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211018 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211021 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211023 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211025 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211027 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211030 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211032 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211035 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211037 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211039 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:52:35.213526 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211042 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211418 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211423 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211426 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211428 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211431 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211433 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211436 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211438 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211441 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211444 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211446 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211449 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211452 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211455 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211457 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211459 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211464 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211467 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:52:35.214031 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211470 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211473 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211475 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211478 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211480 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211482 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211485 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211487 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211490 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211492 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211495 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211497 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211499 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211502 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211504 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211507 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211509 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211511 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211514 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211516 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:52:35.214509 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211518 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211521 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211523 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211526 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211529 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211531 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211534 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211536 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211538 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211541 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211545 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211547 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211552 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211555 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211557 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211560 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211563 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211565 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211568 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211570 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:52:35.215004 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211572 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211575 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211577 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211579 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211582 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211584 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211587 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211589 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211591 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211594 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211596 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211598 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211602 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211604 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211607 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211610 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211612 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211615 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211617 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211620 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:52:35.215469 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211622 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211625 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211627 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211629 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211632 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211636 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211638 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211640 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211643 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211645 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211648 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211650 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211652 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211655 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211657 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211660 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211662 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211665 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211668 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211670 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:52:35.215995 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.211673 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211743 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211750 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211756 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211761 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211765 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211768 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211772 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211776 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211779 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211782 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211785 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211788 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211791 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211794 2576 flags.go:64] FLAG: --cgroup-root="" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211797 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211800 2576 flags.go:64] FLAG: --client-ca-file="" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211803 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211806 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211810 2576 flags.go:64] FLAG: --cluster-domain="" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211813 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211816 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211819 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211822 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 14:52:35.216470 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211825 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211828 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211831 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211834 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211837 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211840 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211843 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211846 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211849 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211852 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211855 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211857 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211860 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211863 2576 flags.go:64] FLAG: --enable-server="true" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211866 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211883 2576 flags.go:64] FLAG: --event-burst="100" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211887 2576 flags.go:64] FLAG: --event-qps="50" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211889 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211892 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211895 2576 flags.go:64] FLAG: --eviction-hard="" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211899 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211901 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211904 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211907 2576 flags.go:64] FLAG: --eviction-soft="" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211910 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 14:52:35.217054 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211913 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211916 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211919 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211926 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211929 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211931 2576 flags.go:64] FLAG: --feature-gates="" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211937 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211940 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211943 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211946 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211949 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211952 2576 flags.go:64] FLAG: --help="false" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211955 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211958 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211961 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211963 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211966 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211970 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211972 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211975 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211978 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211980 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211985 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211988 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 14:52:35.217719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211991 2576 flags.go:64] FLAG: --kube-reserved="" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211994 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211996 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.211999 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212002 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212004 2576 flags.go:64] FLAG: --lock-file="" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212007 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212010 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212012 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212017 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212021 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212024 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212027 2576 flags.go:64] FLAG: --logging-format="text" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212029 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212033 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212035 2576 flags.go:64] FLAG: --manifest-url="" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212038 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212042 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212044 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212048 2576 flags.go:64] FLAG: --max-pods="110" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212051 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212054 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212056 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212059 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212061 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 14:52:35.218327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212064 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212067 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212073 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212076 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212079 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212086 2576 flags.go:64] FLAG: --pod-cidr="" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212089 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212094 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212097 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212099 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212102 2576 flags.go:64] FLAG: --port="10250" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212105 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212108 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-055485532bd9e8497" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212110 2576 flags.go:64] FLAG: --qos-reserved="" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212113 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212116 2576 flags.go:64] FLAG: --register-node="true" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212119 2576 flags.go:64] FLAG: --register-with-taints="" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212122 2576 flags.go:64] FLAG: --registry-burst="10" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212125 2576 flags.go:64] FLAG: --registry-qps="5" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212128 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212130 2576 flags.go:64] FLAG: --reserved-memory="" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212134 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212137 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212140 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212142 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 14:52:35.219287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212145 2576 flags.go:64] FLAG: --runonce="false" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212147 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212150 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212153 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212155 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212158 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212161 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212164 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212166 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212171 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212174 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212177 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212180 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212183 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212186 2576 flags.go:64] FLAG: --system-cgroups="" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212188 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212194 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212196 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212199 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212203 2576 flags.go:64] FLAG: --tls-min-version="" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212205 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212208 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212210 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212213 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212216 2576 flags.go:64] FLAG: --v="2" Jul 23 14:52:35.220235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212219 2576 flags.go:64] FLAG: --version="false" Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212224 2576 flags.go:64] FLAG: --vmodule="" Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212227 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212230 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212340 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212344 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212348 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212351 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212354 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212357 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212359 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212362 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212364 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212367 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212369 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212372 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212375 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212378 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212380 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212384 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:52:35.221135 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212386 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212389 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212391 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212394 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212396 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212398 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212401 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212403 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212406 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212408 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212410 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212413 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212415 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212418 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212420 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212423 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212426 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212428 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212430 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212433 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:52:35.221632 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212435 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212437 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212440 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212442 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212445 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212447 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212450 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212452 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212456 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212458 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212461 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212465 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212467 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212471 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212474 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212477 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212480 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212482 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212485 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212488 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:52:35.222588 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212490 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212493 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212496 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212498 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212501 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212504 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212507 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212510 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212512 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212514 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212517 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212519 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212521 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212524 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212526 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212528 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212531 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212533 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212536 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212538 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:52:35.223374 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212541 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212544 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212548 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212552 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212555 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212558 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212560 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212563 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212565 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212568 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212570 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212573 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212575 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212578 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212580 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212582 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212585 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212587 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212590 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:52:35.223961 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212592 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212595 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212598 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.212600 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.212605 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.220801 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.220821 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.221739 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.221754 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221843 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221851 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221858 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221863 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221868 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221891 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:52:35.224415 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221896 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221901 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221905 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221909 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221912 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221916 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221920 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221925 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221929 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221932 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221936 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221941 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221944 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221948 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221954 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221959 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221964 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221967 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221972 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:52:35.224800 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221975 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221981 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221987 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221991 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.221998 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222003 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222007 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222012 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222016 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222020 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222024 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222028 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222033 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222037 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222041 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222045 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222049 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222053 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222057 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:52:35.225432 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222062 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222066 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222070 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222075 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222079 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222083 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222087 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222091 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222097 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222103 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222108 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222112 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222116 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222121 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222125 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222129 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222133 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222137 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222141 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:52:35.225939 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222146 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222150 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222154 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222158 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222161 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222166 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222170 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222173 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222177 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222181 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222185 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222190 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222194 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222198 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222202 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222207 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222213 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222217 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222221 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222225 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:52:35.226641 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222229 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222234 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222238 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222242 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222246 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222249 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222254 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222257 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222261 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222266 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222270 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222274 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222277 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222282 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222286 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:52:35.227430 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222290 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.222298 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222478 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222487 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222492 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222497 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222501 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222507 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222511 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222516 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222520 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222524 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222531 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222537 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:52:35.227891 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222545 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222549 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222554 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222559 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222564 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222568 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222573 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222577 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222582 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222585 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222589 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222593 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222599 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222603 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222607 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222611 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222615 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222620 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222624 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:52:35.228282 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222629 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222633 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222637 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222641 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222645 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222649 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222653 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222657 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222661 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222666 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222670 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222675 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222679 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222683 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222689 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222693 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222697 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222701 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222706 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222710 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:52:35.228757 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222714 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222718 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222722 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222726 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222730 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222734 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222738 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222742 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222746 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222750 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222755 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222759 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222763 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222767 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222779 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222783 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222787 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222791 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222795 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222799 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:52:35.229316 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222803 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222807 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222811 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222815 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222819 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222823 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222827 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222832 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222836 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222841 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222845 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222849 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222852 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222856 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222860 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222864 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222868 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222889 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222893 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222897 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:52:35.229798 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222901 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222905 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222909 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222913 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222917 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222921 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222925 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:35.222929 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.222937 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.223096 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.227761 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.229036 2576 server.go:1019] "Starting client certificate rotation" Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.229141 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 14:52:35.230324 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.229181 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 14:52:35.231460 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.231443 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 14:52:35.236540 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.236521 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 14:52:35.245323 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.245304 2576 log.go:25] "Validated CRI v1 runtime API" Jul 23 14:52:35.247868 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.247856 2576 log.go:25] "Validated CRI v1 image API" Jul 23 14:52:35.248678 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.248660 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 14:52:35.250791 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.250756 2576 fs.go:135] Filesystem UUIDs: map[2c869ecd-7e69-4f0e-b7c8-fb90f57205dd:/dev/nvme0n1p3 5eee6544-609a-4367-a9fb-3c06df9b69f6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 23 14:52:35.250856 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.250790 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 14:52:35.254753 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.254732 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 14:52:35.256400 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.256299 2576 manager.go:216] Machine: {Timestamp:2026-07-23 14:52:35.255771848 +0000 UTC m=+0.277461084 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100250 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec275f864440bc3ba62461a32784b4e7 SystemUUID:ec275f86-4440-bc3b-a624-61a32784b4e7 BootID:1406778d-bb79-4f69-88af-c1a38566542c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:bc:7f:70:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:bc:7f:70:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:cb:92:06:1b:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 14:52:35.256400 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.256399 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 14:52:35.256506 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.256474 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 14:52:35.257487 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.257462 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 14:52:35.257633 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.257490 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 14:52:35.258154 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.258144 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 14:52:35.258186 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.258156 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 14:52:35.258186 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.258163 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 14:52:35.259346 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.259336 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 14:52:35.260736 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.260727 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 14:52:35.264564 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264552 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 23 14:52:35.264757 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264747 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 14:52:35.264790 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264786 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 23 14:52:35.264816 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264799 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 14:52:35.264816 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264813 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 14:52:35.264886 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264822 2576 kubelet.go:398] "Adding apiserver pod source" Jul 23 14:52:35.264886 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.264862 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 14:52:35.265640 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.265618 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 14:52:35.265725 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.265657 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 14:52:35.269171 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.269147 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 14:52:35.270567 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.270553 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 14:52:35.270625 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.270584 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 14:52:35.271242 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271230 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 14:52:35.271285 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271251 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 14:52:35.271285 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271258 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 14:52:35.271285 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271263 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 14:52:35.271285 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271272 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 14:52:35.271285 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271278 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 14:52:35.271285 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271287 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 14:52:35.271437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271294 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 14:52:35.271437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271300 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 14:52:35.271437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271306 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 14:52:35.271437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271314 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 14:52:35.271437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271319 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 14:52:35.271994 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271985 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 14:52:35.271994 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.271994 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 14:52:35.274768 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.274744 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 14:52:35.274865 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.274818 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 14:52:35.274865 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.274818 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 14:52:35.275504 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.275488 2576 server.go:1268] "Started kubelet" Jul 23 14:52:35.275598 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.275533 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 14:52:35.275654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.275616 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 14:52:35.275707 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.275672 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 14:52:35.276747 ip-10-0-143-139 systemd[1]: Started Kubernetes Kubelet. Jul 23 14:52:35.277090 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.277075 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 23 14:52:35.279478 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.279459 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 14:52:35.279746 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.279725 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 14:52:35.282974 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.282231 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-139.ec2.internal.18c4f2d676ca717b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-139.ec2.internal,UID:ip-10-0-143-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-139.ec2.internal,},FirstTimestamp:2026-07-23 14:52:35.275460987 +0000 UTC m=+0.297150223,LastTimestamp:2026-07-23 14:52:35.275460987 +0000 UTC m=+0.297150223,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-139.ec2.internal,}" Jul 23 14:52:35.284858 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.284845 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 14:52:35.284937 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.284852 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 14:52:35.285044 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.285028 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.285513 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285492 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 14:52:35.285637 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285602 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 14:52:35.285716 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285639 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 14:52:35.285777 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285756 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 23 14:52:35.285777 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285767 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 23 14:52:35.285934 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285913 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zktxs" Jul 23 14:52:35.285986 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285977 2576 factory.go:55] Registering systemd factory Jul 23 14:52:35.286027 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.285993 2576 factory.go:223] Registration of the systemd container factory successfully Jul 23 14:52:35.286198 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.286184 2576 factory.go:153] Registering CRI-O factory Jul 23 14:52:35.286245 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.286203 2576 factory.go:223] Registration of the crio container factory successfully Jul 23 14:52:35.286277 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.286254 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 14:52:35.286317 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.286279 2576 factory.go:103] Registering Raw factory Jul 23 14:52:35.286317 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.286297 2576 manager.go:1196] Started watching for new ooms in manager Jul 23 14:52:35.286669 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.286650 2576 manager.go:349] Starting recovery of all containers Jul 23 14:52:35.288643 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.288617 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 14:52:35.288774 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.288751 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 14:52:35.295492 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.295466 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zktxs" Jul 23 14:52:35.296718 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.296687 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 14:52:35.298272 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.298254 2576 manager.go:354] Recovery completed Jul 23 14:52:35.302985 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.302972 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.304844 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.304829 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.304923 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.304857 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.304923 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.304867 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.305468 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.305455 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 14:52:35.305468 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.305465 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.305468 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.305468 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 14:52:35.305590 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.305482 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 23 14:52:35.306109 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.306094 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.306175 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.306119 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.306175 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.306129 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.307516 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.307502 2576 policy_none.go:49] "None policy: Start" Jul 23 14:52:35.307572 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.307521 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 14:52:35.307572 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.307531 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 14:52:35.309520 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.309509 2576 policy_none.go:47] "Start" Jul 23 14:52:35.347593 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.347431 2576 manager.go:337] "Starting Device Plugin manager" Jul 23 14:52:35.347691 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.347598 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 14:52:35.347691 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.347608 2576 server.go:87] "Starting device plugin registration server" Jul 23 14:52:35.347830 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.347820 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 14:52:35.347867 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.347833 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 14:52:35.347972 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.347947 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 14:52:35.348043 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.348031 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 14:52:35.348043 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.348041 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 14:52:35.348596 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.348575 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 14:52:35.348665 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.348634 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.416793 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.416774 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 14:52:35.418819 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.416815 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 14:52:35.418819 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.416833 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 14:52:35.418819 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.416860 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 14:52:35.419150 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.419137 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:52:35.448849 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.448831 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.449640 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.449627 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.449702 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.449657 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.449702 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.449667 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.449702 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.449687 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.457688 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.457643 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.457688 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.457665 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-139.ec2.internal\": node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.472420 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.472401 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.517138 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.517118 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"] Jul 23 14:52:35.517235 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.517199 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.518563 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.518544 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.518640 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.518569 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.518640 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.518580 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.520787 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.520775 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.520919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.520905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.520979 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.520935 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.521830 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.521803 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.521919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.521804 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.521919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.521853 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.521919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.521863 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.521919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.521832 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.521919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.521906 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.524216 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.524197 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.524306 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.524228 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:52:35.524984 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.524971 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:52:35.525070 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.525002 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:52:35.525070 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.525016 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:52:35.549425 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.549410 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.553684 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.553670 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.573148 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.573127 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.587494 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.587469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c6fb58be842f0782f7cef6c5ad9f1f72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"c6fb58be842f0782f7cef6c5ad9f1f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.587577 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.587497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6fb58be842f0782f7cef6c5ad9f1f72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"c6fb58be842f0782f7cef6c5ad9f1f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.587577 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.587514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e0a0dfd9afe87f2fe9fb1dd4357d8df-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"0e0a0dfd9afe87f2fe9fb1dd4357d8df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.673450 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.673425 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.687679 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.687654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6fb58be842f0782f7cef6c5ad9f1f72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"c6fb58be842f0782f7cef6c5ad9f1f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.687785 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.687684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e0a0dfd9afe87f2fe9fb1dd4357d8df-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"0e0a0dfd9afe87f2fe9fb1dd4357d8df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.687785 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.687708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c6fb58be842f0782f7cef6c5ad9f1f72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"c6fb58be842f0782f7cef6c5ad9f1f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.687785 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.687746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e0a0dfd9afe87f2fe9fb1dd4357d8df-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"0e0a0dfd9afe87f2fe9fb1dd4357d8df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.687785 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.687751 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6fb58be842f0782f7cef6c5ad9f1f72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"c6fb58be842f0782f7cef6c5ad9f1f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.687785 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.687780 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c6fb58be842f0782f7cef6c5ad9f1f72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"c6fb58be842f0782f7cef6c5ad9f1f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.774114 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.774052 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.851584 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.851565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.857533 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:35.857519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jul 23 14:52:35.875169 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.875139 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:35.975639 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:35.975614 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.076135 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:36.076073 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.176717 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:36.176697 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.208621 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.208599 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:52:36.228190 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.228165 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 14:52:36.228299 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.228279 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 14:52:36.228358 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.228314 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 14:52:36.277200 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:36.277177 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.301260 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.301231 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 14:47:35 +0000 UTC" deadline="2028-02-23 22:53:31.169962143 +0000 UTC" Jul 23 14:52:36.301260 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.301253 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13928h0m54.868711988s" Jul 23 14:52:36.377695 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:36.377676 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.477371 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:36.477332 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0a0dfd9afe87f2fe9fb1dd4357d8df.slice/crio-bd000f65671efe1564b8f86608e57a3e743ef4dc11f9b94551356b73c99b8361 WatchSource:0}: Error finding container bd000f65671efe1564b8f86608e57a3e743ef4dc11f9b94551356b73c99b8361: Status 404 returned error can't find the container with id bd000f65671efe1564b8f86608e57a3e743ef4dc11f9b94551356b73c99b8361 Jul 23 14:52:36.478436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:36.478412 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.485023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.485006 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 14:52:36.489801 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:36.489780 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fb58be842f0782f7cef6c5ad9f1f72.slice/crio-dd631a29423c8f5a21dbe2b5812791ff1725107208197331c222464952ec8b29 WatchSource:0}: Error finding container dd631a29423c8f5a21dbe2b5812791ff1725107208197331c222464952ec8b29: Status 404 returned error can't find the container with id dd631a29423c8f5a21dbe2b5812791ff1725107208197331c222464952ec8b29 Jul 23 14:52:36.513409 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.513388 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:52:36.582994 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:36.582970 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found" Jul 23 14:52:36.627256 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.627206 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:52:36.685072 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.685046 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" Jul 23 14:52:36.698487 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.698465 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 14:52:36.699390 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.699376 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" Jul 23 14:52:36.709260 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:36.709240 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 14:52:37.266574 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.266542 2576 apiserver.go:52] "Watching apiserver" Jul 23 14:52:37.279169 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.278772 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 14:52:37.280346 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.280000 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-nmv9p","openshift-ovn-kubernetes/ovnkube-node-mb4z4","kube-system/konnectivity-agent-54tvk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5","openshift-image-registry/node-ca-92mv7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal","openshift-multus/multus-additional-cni-plugins-tbdqk","openshift-multus/network-metrics-daemon-z4b8d","openshift-network-diagnostics/network-check-target-7lwgz","openshift-network-operator/iptables-alerter-l4kwg","kube-system/global-pull-secret-syncer-rgx2d","kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9cwh5","openshift-dns/node-resolver-5mqcc"] Jul 23 14:52:37.283644 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.282582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.285990 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.285404 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 14:52:37.285990 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.285548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.287978 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.287859 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.288134 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.288436 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9rbqv\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.288630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.288811 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.288826 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jdfqr\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.289049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.289093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.289283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 14:52:37.289654 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.289052 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 14:52:37.290279 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.290262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.292015 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.291918 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 14:52:37.292656 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.292463 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gbr2c\"" Jul 23 14:52:37.292656 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.292567 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 14:52:37.293032 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.292851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.293780 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293100 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.293780 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wd46w\"" Jul 23 14:52:37.293780 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 14:52:37.293780 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-os-release\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-modprobe-d\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysctl-d\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-var-lib-kubelet\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-kubernetes\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-cnibin\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.293988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsf7g\" (UniqueName: \"kubernetes.io/projected/65dc477b-a2a8-422b-be42-89291a8247b0-kube-api-access-zsf7g\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysconfig\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-systemd\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-run\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-lib-modules\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-host\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-tuned\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207e5d6a-64da-4485-9baf-24febb3e1c08-tmp\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdm9x\" (UniqueName: \"kubernetes.io/projected/207e5d6a-64da-4485-9baf-24febb3e1c08-kube-api-access-fdm9x\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-system-cni-dir\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysctl-conf\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.294448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-sys\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.295197 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b-agent-certs\") pod \"konnectivity-agent-54tvk\" (UID: \"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b\") " pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.295197 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.294503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b-konnectivity-ca\") pod \"konnectivity-agent-54tvk\" (UID: \"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b\") " pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.295448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.295413 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.296733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.296286 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 14:52:37.296733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.296310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x8f5b\"" Jul 23 14:52:37.296733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.296374 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.296733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.296420 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.297738 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.297714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:37.297831 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.297783 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:37.298421 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.298177 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.298421 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.298200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-npssl\"" Jul 23 14:52:37.298421 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.298262 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.306207 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.303797 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.306207 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.303804 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 14:52:37.306207 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.305210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.308170 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.307361 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 14:52:37.308170 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.307481 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d2tcz\"" Jul 23 14:52:37.308170 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.307980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.308549 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.308521 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.308856 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.308840 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4m8j4\"" Jul 23 14:52:37.308964 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.308882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 14:52:37.308964 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.308928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 14:52:37.309078 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.308997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.309206 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.309191 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 14:52:37.309262 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.309220 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 14:52:37.310530 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.310510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.310614 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.310586 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:37.311193 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.311174 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:52:37.312128 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.312106 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 14:52:37.312218 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.312154 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q94wp\"" Jul 23 14:52:37.312431 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.312383 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 14:52:37.314030 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.314010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:37.314108 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.314077 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:37.324167 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.324145 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cks7" Jul 23 14:52:37.335116 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.335069 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cks7" Jul 23 14:52:37.387872 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.387850 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 14:52:37.395223 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/422b5e09-2b02-4079-b8aa-6a63ac6efb21-serviceca\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.395351 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-device-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.395351 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlwf\" (UniqueName: \"kubernetes.io/projected/7d03f826-75df-4581-9466-53365b7d93f8-kube-api-access-mjlwf\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.395351 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-slash\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395351 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-run-netns\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-cni-netd\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-run\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-lib-modules\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-tuned\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/422b5e09-2b02-4079-b8aa-6a63ac6efb21-host\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-cni-bin\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-daemon-config\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.395556 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98zgl\" (UniqueName: \"kubernetes.io/projected/92c8e82b-75bf-4aad-8415-16cb3074b738-kube-api-access-98zgl\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d03f826-75df-4581-9466-53365b7d93f8-tmp-dir\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-kubelet\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-cni-bin\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-sys\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55z6k\" (UniqueName: \"kubernetes.io/projected/422b5e09-2b02-4079-b8aa-6a63ac6efb21-kube-api-access-55z6k\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-systemd-units\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-systemd\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-registration-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdm9x\" (UniqueName: \"kubernetes.io/projected/207e5d6a-64da-4485-9baf-24febb3e1c08-kube-api-access-fdm9x\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-cnibin\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.395892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-etc-kubernetes\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b-agent-certs\") pod \"konnectivity-agent-54tvk\" (UID: \"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b\") " pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.395967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-system-cni-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-cnibin\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396139 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-run\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-lib-modules\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396273 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-sys\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.396329 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-system-cni-dir\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-cni-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6bcd55a-87d2-4bab-9056-75e18b6349ff-cni-binary-copy\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396453 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396491 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-system-cni-dir\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-multus-certs\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-var-lib-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92c8e82b-75bf-4aad-8415-16cb3074b738-ovn-node-metrics-cert\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.396617 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-var-lib-kubelet\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jslz8\" (UniqueName: \"kubernetes.io/projected/94826632-c984-4231-8f6b-ecf5051463d5-kube-api-access-jslz8\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-os-release\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-kubelet\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-var-lib-kubelet\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-etc-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-node-log\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-host\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-host\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.396974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-systemd\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fa47093-216b-4aad-810c-269169988018-iptables-alerter-script\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.397077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-systemd\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-log-socket\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207e5d6a-64da-4485-9baf-24febb3e1c08-tmp\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b-konnectivity-ca\") pod \"konnectivity-agent-54tvk\" (UID: \"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b\") " pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-ovnkube-config\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysctl-conf\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397431 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmwm\" (UniqueName: \"kubernetes.io/projected/1fa47093-216b-4aad-810c-269169988018-kube-api-access-hmmwm\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-socket-dir-parent\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-env-overrides\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-os-release\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-modprobe-d\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysctl-d\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fa47093-216b-4aad-810c-269169988018-host-slash\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.397783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397664 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397815 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysctl-d\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.397973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysctl-conf\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b-konnectivity-ca\") pod \"konnectivity-agent-54tvk\" (UID: \"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b\") " pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-k8s-cni-cncf-io\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-ovnkube-script-lib\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-netns\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-kubernetes\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65dc477b-a2a8-422b-be42-89291a8247b0-os-release\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-kubernetes\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398399 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-modprobe-d\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsf7g\" (UniqueName: \"kubernetes.io/projected/65dc477b-a2a8-422b-be42-89291a8247b0-kube-api-access-zsf7g\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysconfig\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48lds\" (UniqueName: \"kubernetes.io/projected/b2e85229-b5e7-41ba-a710-969494798b89-kube-api-access-48lds\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398523 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-sysconfig\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.398673 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-socket-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d03f826-75df-4581-9466-53365b7d93f8-hosts-file\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-hostroot\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h5x7\" (UniqueName: \"kubernetes.io/projected/f6bcd55a-87d2-4bab-9056-75e18b6349ff-kube-api-access-6h5x7\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-run-ovn-kubernetes\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-sys-fs\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-cnibin\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.398971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-cni-multus\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.399009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-conf-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.399044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-ovn\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.399075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d33a5fd4-6211-4249-a57e-79d4d352690a-kubelet-config\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.399142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d33a5fd4-6211-4249-a57e-79d4d352690a-dbus\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.399519 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.399158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65dc477b-a2a8-422b-be42-89291a8247b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.403035 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.403012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207e5d6a-64da-4485-9baf-24febb3e1c08-etc-tuned\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.404147 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.403831 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207e5d6a-64da-4485-9baf-24febb3e1c08-tmp\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.407023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.406565 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b-agent-certs\") pod \"konnectivity-agent-54tvk\" (UID: \"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b\") " pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.409248 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.409066 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdm9x\" (UniqueName: \"kubernetes.io/projected/207e5d6a-64da-4485-9baf-24febb3e1c08-kube-api-access-fdm9x\") pod \"tuned-9cwh5\" (UID: \"207e5d6a-64da-4485-9baf-24febb3e1c08\") " pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.418666 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.418620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsf7g\" (UniqueName: \"kubernetes.io/projected/65dc477b-a2a8-422b-be42-89291a8247b0-kube-api-access-zsf7g\") pod \"multus-additional-cni-plugins-tbdqk\" (UID: \"65dc477b-a2a8-422b-be42-89291a8247b0\") " pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.423808 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.423738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"c6fb58be842f0782f7cef6c5ad9f1f72","Type":"ContainerStarted","Data":"dd631a29423c8f5a21dbe2b5812791ff1725107208197331c222464952ec8b29"} Jul 23 14:52:37.425316 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.425289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" event={"ID":"0e0a0dfd9afe87f2fe9fb1dd4357d8df","Type":"ContainerStarted","Data":"bd000f65671efe1564b8f86608e57a3e743ef4dc11f9b94551356b73c99b8361"} Jul 23 14:52:37.500811 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-cni-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.500811 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6bcd55a-87d2-4bab-9056-75e18b6349ff-cni-binary-copy\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-multus-certs\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-var-lib-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92c8e82b-75bf-4aad-8415-16cb3074b738-ovn-node-metrics-cert\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jslz8\" (UniqueName: \"kubernetes.io/projected/94826632-c984-4231-8f6b-ecf5051463d5-kube-api-access-jslz8\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-os-release\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.500997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-kubelet\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-etc-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-node-log\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fa47093-216b-4aad-810c-269169988018-iptables-alerter-script\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.501087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-log-socket\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-ovnkube-config\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmwm\" (UniqueName: \"kubernetes.io/projected/1fa47093-216b-4aad-810c-269169988018-kube-api-access-hmmwm\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-socket-dir-parent\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-env-overrides\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fa47093-216b-4aad-810c-269169988018-host-slash\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-k8s-cni-cncf-io\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-ovnkube-script-lib\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-netns\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48lds\" (UniqueName: \"kubernetes.io/projected/b2e85229-b5e7-41ba-a710-969494798b89-kube-api-access-48lds\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-socket-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d03f826-75df-4581-9466-53365b7d93f8-hosts-file\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-hostroot\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h5x7\" (UniqueName: \"kubernetes.io/projected/f6bcd55a-87d2-4bab-9056-75e18b6349ff-kube-api-access-6h5x7\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.501630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-run-ovn-kubernetes\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-sys-fs\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-cnibin\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-cni-multus\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-conf-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-ovn\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d33a5fd4-6211-4249-a57e-79d4d352690a-kubelet-config\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d33a5fd4-6211-4249-a57e-79d4d352690a-dbus\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/422b5e09-2b02-4079-b8aa-6a63ac6efb21-serviceca\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-device-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlwf\" (UniqueName: \"kubernetes.io/projected/7d03f826-75df-4581-9466-53365b7d93f8-kube-api-access-mjlwf\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-slash\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-run-netns\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-cni-netd\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-cni-netd\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.501966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-cni-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.502495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6bcd55a-87d2-4bab-9056-75e18b6349ff-cni-binary-copy\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.502560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.502547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-multus-certs\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.502591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-var-lib-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.502992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/422b5e09-2b02-4079-b8aa-6a63ac6efb21-host\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-cni-bin\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-daemon-config\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98zgl\" (UniqueName: \"kubernetes.io/projected/92c8e82b-75bf-4aad-8415-16cb3074b738-kube-api-access-98zgl\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d03f826-75df-4581-9466-53365b7d93f8-tmp-dir\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-kubelet\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-cni-bin\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55z6k\" (UniqueName: \"kubernetes.io/projected/422b5e09-2b02-4079-b8aa-6a63ac6efb21-kube-api-access-55z6k\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-systemd-units\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-systemd\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-registration-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.503429 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-etc-kubernetes\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-system-cni-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/422b5e09-2b02-4079-b8aa-6a63ac6efb21-host\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.504142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.503785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-cni-bin\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.504552 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.504309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-daemon-config\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.504900 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.504859 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d03f826-75df-4581-9466-53365b7d93f8-tmp-dir\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.505008 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.504933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-kubelet\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.505008 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-cni-bin\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.505266 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-systemd-units\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.505335 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505300 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-systemd\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.505399 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-registration-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.505472 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.505615 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.505615 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505518 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-etc-kubernetes\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.505615 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.505549 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-system-cni-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.506288 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.506261 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:37.506358 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.506341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:52:38.006317967 +0000 UTC m=+3.028007207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:37.506815 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.506793 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-os-release\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.506879 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.506857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-kubelet\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.506948 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.506902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-etc-openvswitch\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.506993 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.506941 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-node-log\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.507053 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-var-lib-cni-multus\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.507348 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-socket-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.507434 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d03f826-75df-4581-9466-53365b7d93f8-hosts-file\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.507487 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-hostroot\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.507594 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507545 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fa47093-216b-4aad-810c-269169988018-iptables-alerter-script\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.507649 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-log-socket\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.507703 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.507752 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-run-ovn-kubernetes\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.507940 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.507905 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-socket-dir-parent\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.508272 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508252 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-ovnkube-config\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.508321 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508286 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-env-overrides\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.508357 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-sys-fs\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.508357 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fa47093-216b-4aad-810c-269169988018-host-slash\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.508418 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-cnibin\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.508453 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.508419 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:37.508486 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.508467 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:38.008450587 +0000 UTC m=+3.030139811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:37.508523 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-k8s-cni-cncf-io\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.508805 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/422b5e09-2b02-4079-b8aa-6a63ac6efb21-serviceca\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.508910 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-multus-conf-dir\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.508954 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.508931 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-run-ovn\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.509018 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d33a5fd4-6211-4249-a57e-79d4d352690a-kubelet-config\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.509064 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509045 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6bcd55a-87d2-4bab-9056-75e18b6349ff-host-run-netns\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.509136 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d33a5fd4-6211-4249-a57e-79d4d352690a-dbus\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:37.509136 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92c8e82b-75bf-4aad-8415-16cb3074b738-ovnkube-script-lib\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.509223 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-slash\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.509374 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94826632-c984-4231-8f6b-ecf5051463d5-device-dir\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.509422 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509408 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92c8e82b-75bf-4aad-8415-16cb3074b738-host-run-netns\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.509975 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.509934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92c8e82b-75bf-4aad-8415-16cb3074b738-ovn-node-metrics-cert\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.515384 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.515054 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:52:37.515384 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.515077 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:52:37.515384 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.515093 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:37.515384 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:37.515180 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:38.015135994 +0000 UTC m=+3.036825241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:37.515384 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.515338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55z6k\" (UniqueName: \"kubernetes.io/projected/422b5e09-2b02-4079-b8aa-6a63ac6efb21-kube-api-access-55z6k\") pod \"node-ca-92mv7\" (UID: \"422b5e09-2b02-4079-b8aa-6a63ac6efb21\") " pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.515824 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.515776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98zgl\" (UniqueName: \"kubernetes.io/projected/92c8e82b-75bf-4aad-8415-16cb3074b738-kube-api-access-98zgl\") pod \"ovnkube-node-mb4z4\" (UID: \"92c8e82b-75bf-4aad-8415-16cb3074b738\") " pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.517694 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.517601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48lds\" (UniqueName: \"kubernetes.io/projected/b2e85229-b5e7-41ba-a710-969494798b89-kube-api-access-48lds\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:37.518352 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.517845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jslz8\" (UniqueName: \"kubernetes.io/projected/94826632-c984-4231-8f6b-ecf5051463d5-kube-api-access-jslz8\") pod \"aws-ebs-csi-driver-node-vv4j5\" (UID: \"94826632-c984-4231-8f6b-ecf5051463d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.518352 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.518298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h5x7\" (UniqueName: \"kubernetes.io/projected/f6bcd55a-87d2-4bab-9056-75e18b6349ff-kube-api-access-6h5x7\") pod \"multus-nmv9p\" (UID: \"f6bcd55a-87d2-4bab-9056-75e18b6349ff\") " pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.519588 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.519563 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlwf\" (UniqueName: \"kubernetes.io/projected/7d03f826-75df-4581-9466-53365b7d93f8-kube-api-access-mjlwf\") pod \"node-resolver-5mqcc\" (UID: \"7d03f826-75df-4581-9466-53365b7d93f8\") " pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.520151 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.520130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmwm\" (UniqueName: \"kubernetes.io/projected/1fa47093-216b-4aad-810c-269169988018-kube-api-access-hmmwm\") pod \"iptables-alerter-l4kwg\" (UID: \"1fa47093-216b-4aad-810c-269169988018\") " pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.604178 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.604145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" Jul 23 14:52:37.611885 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.611840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" Jul 23 14:52:37.623857 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.623833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:37.631022 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.631000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" Jul 23 14:52:37.648939 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.648914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-92mv7" Jul 23 14:52:37.656832 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.656807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mqcc" Jul 23 14:52:37.665735 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.665715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmv9p" Jul 23 14:52:37.675776 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.675751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:52:37.684684 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.684660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l4kwg" Jul 23 14:52:37.711609 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:37.711574 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:52:38.007750 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:38.007719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:38.007937 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.007921 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:38.008006 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.007994 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:52:39.007975756 +0000 UTC m=+4.029664985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:38.108184 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:38.108150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:38.108184 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:38.108191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:38.108436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.108321 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:52:38.108436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.108325 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:38.108436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.108341 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:52:38.108436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.108357 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:38.108436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.108398 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:39.108378723 +0000 UTC m=+4.130067952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:38.108436 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:38.108414 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:39.108407283 +0000 UTC m=+4.130096508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:38.338514 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:38.338473 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:47:37 +0000 UTC" deadline="2028-05-06 20:04:34.470375446 +0000 UTC" Jul 23 14:52:38.338514 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:38.338503 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15677h11m56.131876314s" Jul 23 14:52:38.544717 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.544684 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94826632_c984_4231_8f6b_ecf5051463d5.slice/crio-f7c551a81a17a2ff58d69d1d60a5261df0b20e4c6ac0c99cac712569d7d3556d WatchSource:0}: Error finding container f7c551a81a17a2ff58d69d1d60a5261df0b20e4c6ac0c99cac712569d7d3556d: Status 404 returned error can't find the container with id f7c551a81a17a2ff58d69d1d60a5261df0b20e4c6ac0c99cac712569d7d3556d Jul 23 14:52:38.554002 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.552843 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7dfdf5_05e8_4744_bd43_2bdae8e72e8b.slice/crio-8e98c515fef521630fd4adfd128e03369162af6c54bede2c8ed7d82982f8b9e4 WatchSource:0}: Error finding container 8e98c515fef521630fd4adfd128e03369162af6c54bede2c8ed7d82982f8b9e4: Status 404 returned error can't find the container with id 8e98c515fef521630fd4adfd128e03369162af6c54bede2c8ed7d82982f8b9e4 Jul 23 14:52:38.555228 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.555200 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207e5d6a_64da_4485_9baf_24febb3e1c08.slice/crio-912952aed71412f3b2e490ad2bb8deebfe67b23487fb30c033020d1b8211f86f WatchSource:0}: Error finding container 912952aed71412f3b2e490ad2bb8deebfe67b23487fb30c033020d1b8211f86f: Status 404 returned error can't find the container with id 912952aed71412f3b2e490ad2bb8deebfe67b23487fb30c033020d1b8211f86f Jul 23 14:52:38.556989 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.556951 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c8e82b_75bf_4aad_8415_16cb3074b738.slice/crio-93c32ad86faca297af2e10e1a4ed2b5d2efb4eaa7239311731d608df17db6546 WatchSource:0}: Error finding container 93c32ad86faca297af2e10e1a4ed2b5d2efb4eaa7239311731d608df17db6546: Status 404 returned error can't find the container with id 93c32ad86faca297af2e10e1a4ed2b5d2efb4eaa7239311731d608df17db6546 Jul 23 14:52:38.562548 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.557196 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422b5e09_2b02_4079_b8aa_6a63ac6efb21.slice/crio-58b52a2c5434d58d4be27ddba33de8c6b7ff0f99d0d7b5d9f7a25eac6174056b WatchSource:0}: Error finding container 58b52a2c5434d58d4be27ddba33de8c6b7ff0f99d0d7b5d9f7a25eac6174056b: Status 404 returned error can't find the container with id 58b52a2c5434d58d4be27ddba33de8c6b7ff0f99d0d7b5d9f7a25eac6174056b Jul 23 14:52:38.584748 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.584724 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d03f826_75df_4581_9466_53365b7d93f8.slice/crio-afefba4d112842be8cae396d959f26dd40b7eaeb71c789a739c98e0cab7b5cbb WatchSource:0}: Error finding container afefba4d112842be8cae396d959f26dd40b7eaeb71c789a739c98e0cab7b5cbb: Status 404 returned error can't find the container with id afefba4d112842be8cae396d959f26dd40b7eaeb71c789a739c98e0cab7b5cbb Jul 23 14:52:38.585912 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.585880 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65dc477b_a2a8_422b_be42_89291a8247b0.slice/crio-a1617bae05be37dc309d3fdab8f6c4efa8a19479c0b12b288ad0b0f6fce10468 WatchSource:0}: Error finding container a1617bae05be37dc309d3fdab8f6c4efa8a19479c0b12b288ad0b0f6fce10468: Status 404 returned error can't find the container with id a1617bae05be37dc309d3fdab8f6c4efa8a19479c0b12b288ad0b0f6fce10468 Jul 23 14:52:38.586278 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:52:38.586259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bcd55a_87d2_4bab_9056_75e18b6349ff.slice/crio-8363a4fffc72f17bdeedda2027fa6cc0915637c65eefd2c2c8af3b91e9baede8 WatchSource:0}: Error finding container 8363a4fffc72f17bdeedda2027fa6cc0915637c65eefd2c2c8af3b91e9baede8: Status 404 returned error can't find the container with id 8363a4fffc72f17bdeedda2027fa6cc0915637c65eefd2c2c8af3b91e9baede8 Jul 23 14:52:38.830044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:38.829859 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:52:39.015044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.015013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:39.015195 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.015118 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:39.015195 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.015169 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:52:41.015156032 +0000 UTC m=+6.036845262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:39.116430 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.116340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:39.116430 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.116397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:39.116634 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.116554 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:52:39.116634 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.116572 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:52:39.116634 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.116586 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:39.116745 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.116647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:41.116628019 +0000 UTC m=+6.138317246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:39.117156 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.117131 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:39.117295 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.117200 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:41.117182265 +0000 UTC m=+6.138871492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:39.339290 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.339219 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:47:37 +0000 UTC" deadline="2028-02-28 00:47:39.925383568 +0000 UTC" Jul 23 14:52:39.339290 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.339283 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14025h55m0.58610489s" Jul 23 14:52:39.420020 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.419941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:39.420177 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.420091 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:39.420364 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.420342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:39.420470 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.420447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:39.420535 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.420484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:39.420647 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:39.420622 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:39.431248 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.431211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmv9p" event={"ID":"f6bcd55a-87d2-4bab-9056-75e18b6349ff","Type":"ContainerStarted","Data":"8363a4fffc72f17bdeedda2027fa6cc0915637c65eefd2c2c8af3b91e9baede8"} Jul 23 14:52:39.439735 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.439696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerStarted","Data":"a1617bae05be37dc309d3fdab8f6c4efa8a19479c0b12b288ad0b0f6fce10468"} Jul 23 14:52:39.442461 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.442389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-92mv7" event={"ID":"422b5e09-2b02-4079-b8aa-6a63ac6efb21","Type":"ContainerStarted","Data":"58b52a2c5434d58d4be27ddba33de8c6b7ff0f99d0d7b5d9f7a25eac6174056b"} Jul 23 14:52:39.445843 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.445038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"93c32ad86faca297af2e10e1a4ed2b5d2efb4eaa7239311731d608df17db6546"} Jul 23 14:52:39.446672 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.446613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" event={"ID":"94826632-c984-4231-8f6b-ecf5051463d5","Type":"ContainerStarted","Data":"f7c551a81a17a2ff58d69d1d60a5261df0b20e4c6ac0c99cac712569d7d3556d"} Jul 23 14:52:39.452509 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.452478 2576 generic.go:356] "Generic (PLEG): container finished" podID="c6fb58be842f0782f7cef6c5ad9f1f72" containerID="1738fa4aa0b1d43d0c633f422da40088aa2d869f9c6532d68edb1f15fd1d84ba" exitCode=0 Jul 23 14:52:39.452628 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.452569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"c6fb58be842f0782f7cef6c5ad9f1f72","Type":"ContainerDied","Data":"1738fa4aa0b1d43d0c633f422da40088aa2d869f9c6532d68edb1f15fd1d84ba"} Jul 23 14:52:39.459694 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.459667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" event={"ID":"0e0a0dfd9afe87f2fe9fb1dd4357d8df","Type":"ContainerStarted","Data":"a3008ff58526701d97fc545003640bae47543f13339a6fbc677e4f6f32878dfd"} Jul 23 14:52:39.466797 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.466772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mqcc" event={"ID":"7d03f826-75df-4581-9466-53365b7d93f8","Type":"ContainerStarted","Data":"afefba4d112842be8cae396d959f26dd40b7eaeb71c789a739c98e0cab7b5cbb"} Jul 23 14:52:39.471234 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.471149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l4kwg" event={"ID":"1fa47093-216b-4aad-810c-269169988018","Type":"ContainerStarted","Data":"2069e52c25c2efd9fc80229b551317d7c2786583aea212fdb042a139f50f2320"} Jul 23 14:52:39.473270 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.473243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" event={"ID":"207e5d6a-64da-4485-9baf-24febb3e1c08","Type":"ContainerStarted","Data":"912952aed71412f3b2e490ad2bb8deebfe67b23487fb30c033020d1b8211f86f"} Jul 23 14:52:39.475330 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.475277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54tvk" event={"ID":"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b","Type":"ContainerStarted","Data":"8e98c515fef521630fd4adfd128e03369162af6c54bede2c8ed7d82982f8b9e4"} Jul 23 14:52:39.487284 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:39.487232 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" podStartSLOduration=2.4872133 podStartE2EDuration="2.4872133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:39.486743034 +0000 UTC m=+4.508432283" watchObservedRunningTime="2026-07-23 14:52:39.4872133 +0000 UTC m=+4.508902549" Jul 23 14:52:40.497921 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:40.497510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"c6fb58be842f0782f7cef6c5ad9f1f72","Type":"ContainerStarted","Data":"d1364a7e5306a31e68e63ab2afe10fed7c113d6280709c05397ba8887a763a68"} Jul 23 14:52:40.523916 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:40.523860 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" podStartSLOduration=3.5238379589999997 podStartE2EDuration="3.523837959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:40.523238402 +0000 UTC m=+5.544927650" watchObservedRunningTime="2026-07-23 14:52:40.523837959 +0000 UTC m=+5.545527209" Jul 23 14:52:41.035558 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:41.035501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:41.035742 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.035658 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:41.035742 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.035729 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:52:45.035709266 +0000 UTC m=+10.057398507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:41.136047 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:41.136003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:41.136249 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:41.136138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:41.136314 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.136292 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:41.136372 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.136356 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:45.136336479 +0000 UTC m=+10.158025720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:41.136900 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.136883 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:52:41.136996 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.136907 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:52:41.136996 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.136921 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:41.136996 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.136987 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:45.136970874 +0000 UTC m=+10.158660115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:41.419158 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:41.419075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:41.419158 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:41.419094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:41.419395 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.419215 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:41.419395 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:41.419312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:41.419558 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.419300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:41.419558 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:41.419433 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:43.422095 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:43.422030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:43.422556 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:43.422161 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:43.422602 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:43.422567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:43.422894 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:43.422684 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:43.422894 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:43.422736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:43.422894 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:43.422797 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:45.071030 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:45.070980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:45.071493 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.071209 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:45.071493 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.071272 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:52:53.071254685 +0000 UTC m=+18.092943909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:45.171634 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:45.171569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:45.171634 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:45.171624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:45.171827 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.171780 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:52:45.171827 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.171802 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:52:45.171827 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.171815 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:45.171941 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.171886 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:53.171852783 +0000 UTC m=+18.193542024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:45.172265 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.172221 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:45.172358 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.172271 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:52:53.172255122 +0000 UTC m=+18.193944360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:45.418979 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:45.418476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:45.418979 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:45.418584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:45.418979 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.418592 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:45.418979 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.418692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:45.418979 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:45.418755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:45.418979 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:45.418821 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:47.417254 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:47.417181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:47.417733 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:47.417310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:47.417733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:47.417375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:47.417733 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:47.417444 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:47.417733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:47.417472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:47.417733 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:47.417531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:49.420139 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:49.420115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:49.420424 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:49.420211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:49.420424 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:49.420215 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:49.420424 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:49.420235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:49.420424 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:49.420313 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:49.420424 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:49.420384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:51.417970 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:51.417930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:51.418412 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:51.417930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:51.418412 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:51.418043 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:51.418412 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:51.417942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:51.418412 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:51.418131 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:51.418412 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:51.418223 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:53.132851 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:53.132814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:53.133315 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.132998 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:53.133315 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.133071 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:53:09.13305201 +0000 UTC m=+34.154741240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:52:53.233937 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:53.233906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:53.234126 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:53.233948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:53.234126 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.234080 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:52:53.234126 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.234080 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:53.234126 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.234098 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:52:53.234126 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.234108 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:53.234367 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.234153 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:09.234132703 +0000 UTC m=+34.255821937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:52:53.234367 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.234174 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:09.234164404 +0000 UTC m=+34.255853638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:52:53.418281 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:53.417725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:53.418281 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:53.417726 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:53.418281 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:53.417891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:53.418281 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.417864 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:53.418281 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.417983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:53.418281 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:53.418087 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:55.418488 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:55.418003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:55.418488 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:55.418119 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:55.418488 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:55.418210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:55.418488 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:55.418319 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:55.418488 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:55.418370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:55.418488 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:55.418450 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:57.417383 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:57.417354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:57.417829 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:57.417354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:57.417829 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:57.417449 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:57.417829 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:57.417495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:57.417829 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:57.417641 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:57.417829 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:57.417747 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:58.535939 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.535650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mqcc" event={"ID":"7d03f826-75df-4581-9466-53365b7d93f8","Type":"ContainerStarted","Data":"973a0a5a889c83156335f863016c28465de6d94d3f914ff193a6df36fecb18c1"} Jul 23 14:52:58.537627 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.537593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" event={"ID":"207e5d6a-64da-4485-9baf-24febb3e1c08","Type":"ContainerStarted","Data":"b5fce699cffd9173f0c9b7713723ce187f8c79524671ac3e1a74d10e1ec48c1b"} Jul 23 14:52:58.539412 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.539363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54tvk" event={"ID":"ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b","Type":"ContainerStarted","Data":"05ebbada4160eff503d76c7519dcdc8e98b62c3bcc056e7e2b85bd7535e64f9c"} Jul 23 14:52:58.542848 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.542704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmv9p" event={"ID":"f6bcd55a-87d2-4bab-9056-75e18b6349ff","Type":"ContainerStarted","Data":"ae20b0767bdca4fe4fb13784ccfa476e10135ddb3be85ff0939d60eca83935df"} Jul 23 14:52:58.544241 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.544220 2576 generic.go:356] "Generic (PLEG): container finished" podID="65dc477b-a2a8-422b-be42-89291a8247b0" containerID="40f5bfb59821e7f444fe2cc7bd88a1a29b1aea580f06836fdf4df476bdd58240" exitCode=0 Jul 23 14:52:58.544321 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.544285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerDied","Data":"40f5bfb59821e7f444fe2cc7bd88a1a29b1aea580f06836fdf4df476bdd58240"} Jul 23 14:52:58.545803 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.545779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-92mv7" event={"ID":"422b5e09-2b02-4079-b8aa-6a63ac6efb21","Type":"ContainerStarted","Data":"b917a18d7e460b5b92e87fb60de7ac0a03ca09d1fc2700f8a239af0d09e1374e"} Jul 23 14:52:58.549163 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.549145 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:52:58.549577 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.549553 2576 generic.go:356] "Generic (PLEG): container finished" podID="92c8e82b-75bf-4aad-8415-16cb3074b738" containerID="ab20ec20ca9ecf01dc0ee4c6f7d80adb83d80ee4b7639ac524ecc4c7c1a45326" exitCode=1 Jul 23 14:52:58.549666 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.549629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"0d78d5bfdd7ff11a76cd7d27e2d76ce3719b410a3456b0dbb4fc6640e9035e86"} Jul 23 14:52:58.549727 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.549713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"caf8c6b8d4fd90c375e34bd032965a22d34db0e63fef2386d854f38013152d95"} Jul 23 14:52:58.549780 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.549764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerDied","Data":"ab20ec20ca9ecf01dc0ee4c6f7d80adb83d80ee4b7639ac524ecc4c7c1a45326"} Jul 23 14:52:58.549837 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.549817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"b22aee6f75757ff51ac8f04f3b803448c23dbe72e788b9cf1aab14589201850b"} Jul 23 14:52:58.552118 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.552084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" event={"ID":"94826632-c984-4231-8f6b-ecf5051463d5","Type":"ContainerStarted","Data":"e5717c6b2833a488f7ceb64ca3318312d9124627b4b93d74a0cbea4d2fe27b72"} Jul 23 14:52:58.558984 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.558809 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mqcc" podStartSLOduration=3.296405435 podStartE2EDuration="22.558791817s" totalImagesPullingTime="19.262386382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:58.552397407 +0000 UTC m=+23.574086664" watchObservedRunningTime="2026-07-23 14:52:58.558791817 +0000 UTC m=+23.580481063" Jul 23 14:52:58.598164 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.598112 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9cwh5" podStartSLOduration=3.305676087 podStartE2EDuration="22.598094616s" totalImagesPullingTime="19.292418529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:58.597505952 +0000 UTC m=+23.619195198" watchObservedRunningTime="2026-07-23 14:52:58.598094616 +0000 UTC m=+23.619783863" Jul 23 14:52:58.613002 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.612958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-54tvk" podStartSLOduration=3.427618862 podStartE2EDuration="22.612944341s" totalImagesPullingTime="19.185325479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:58.612667105 +0000 UTC m=+23.634356345" watchObservedRunningTime="2026-07-23 14:52:58.612944341 +0000 UTC m=+23.634633586" Jul 23 14:52:58.644607 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.644549 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-92mv7" podStartSLOduration=3.463480295 podStartE2EDuration="22.644530415s" totalImagesPullingTime="19.18105012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:58.627310542 +0000 UTC m=+23.648999798" watchObservedRunningTime="2026-07-23 14:52:58.644530415 +0000 UTC m=+23.666219658" Jul 23 14:52:58.645191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:58.645147 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nmv9p" podStartSLOduration=3.150124614 podStartE2EDuration="22.645136325s" totalImagesPullingTime="19.495011711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:58.644631896 +0000 UTC m=+23.666321143" watchObservedRunningTime="2026-07-23 14:52:58.645136325 +0000 UTC m=+23.666825571" Jul 23 14:52:59.188343 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.188313 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 14:52:59.361386 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.361271 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T14:52:59.188340845Z","UUID":"3f5dfa3a-5594-4a10-b1b3-1c34f28fbfd5","Handler":null,"Name":"","Endpoint":""} Jul 23 14:52:59.363014 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.362991 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 14:52:59.363139 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.363035 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 14:52:59.417898 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.417857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:52:59.418011 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:59.417987 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:52:59.418087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.418062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:52:59.418830 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:59.418783 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:52:59.419087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.419068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:52:59.419424 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:52:59.419397 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:52:59.550888 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.550842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:59.551551 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.551532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:52:59.556009 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.555974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l4kwg" event={"ID":"1fa47093-216b-4aad-810c-269169988018","Type":"ContainerStarted","Data":"e1a193e90a62b58407fff0682e3279f5db02abac555a5fcef2b412c6adba18f8"} Jul 23 14:52:59.559083 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.559065 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:52:59.559494 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.559470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"7d717e7f0f5fef8afa69b3b37cbce7c9ab679536212eea1666c41c1ba7e448aa"} Jul 23 14:52:59.559593 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.559530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"2ac3e79ddf8848b3b97e97bad90f08a78c0ccb5ea933a694288bbaa7d63bff3f"} Jul 23 14:52:59.561505 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.561461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" event={"ID":"94826632-c984-4231-8f6b-ecf5051463d5","Type":"ContainerStarted","Data":"39ede0f61be5d0e10ceb37d2cb46fa936ec066beca015efc43856ce7195370b0"} Jul 23 14:52:59.588398 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:52:59.588351 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l4kwg" podStartSLOduration=4.316607577 podStartE2EDuration="23.588328075s" totalImagesPullingTime="19.271720498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:52:59.588329954 +0000 UTC m=+24.610019200" watchObservedRunningTime="2026-07-23 14:52:59.588328075 +0000 UTC m=+24.610017324" Jul 23 14:53:00.566366 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:00.565937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" event={"ID":"94826632-c984-4231-8f6b-ecf5051463d5","Type":"ContainerStarted","Data":"6385eecef914849dc46b94ba70da8672c50f293d4e13a9a53e5ce342dc915282"} Jul 23 14:53:00.566366 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:00.565995 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 23 14:53:00.586599 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:00.586541 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv4j5" podStartSLOduration=3.538754522 podStartE2EDuration="24.586519315s" totalImagesPullingTime="21.047764793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:53:00.586121566 +0000 UTC m=+25.607810817" watchObservedRunningTime="2026-07-23 14:53:00.586519315 +0000 UTC m=+25.608208560" Jul 23 14:53:01.417448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:01.417417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:01.417628 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:01.417417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:01.417628 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:01.417528 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:53:01.417628 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:01.417418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:01.417628 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:01.417616 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:53:01.417807 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:01.417711 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:53:01.572588 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:01.572559 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:53:01.573062 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:01.573033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"8f1eb6b15435ddfd08602443ad743fd50e340cbc17a29e0a5e012454bdc78147"} Jul 23 14:53:03.417217 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.417043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:03.417846 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.417043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:03.417846 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:03.417288 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:53:03.417846 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.417044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:03.417846 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:03.417407 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:53:03.417846 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:03.417449 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:53:03.578544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.578508 2576 generic.go:356] "Generic (PLEG): container finished" podID="65dc477b-a2a8-422b-be42-89291a8247b0" containerID="74de97633a43199411e2e22b549183b202bdb0ded177a6efc8873130b2cc7672" exitCode=0 Jul 23 14:53:03.578904 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.578558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerDied","Data":"74de97633a43199411e2e22b549183b202bdb0ded177a6efc8873130b2cc7672"} Jul 23 14:53:03.582322 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.582305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:53:03.582694 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.582674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"f1d1e76ce5a76f9db4cd0afdcfe0d1f7e8796e6ab19dc365d024d06dab7d60b9"} Jul 23 14:53:03.582914 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.582901 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:53:03.583092 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.583071 2576 scope.go:117] "RemoveContainer" containerID="ab20ec20ca9ecf01dc0ee4c6f7d80adb83d80ee4b7639ac524ecc4c7c1a45326" Jul 23 14:53:03.599733 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.599715 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:53:03.661008 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:03.660834 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:53:04.587163 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.587119 2576 generic.go:356] "Generic (PLEG): container finished" podID="65dc477b-a2a8-422b-be42-89291a8247b0" containerID="e29e8017d23db4df447cbeba939f007150c53eb08c22578ee3226593af13ad59" exitCode=0 Jul 23 14:53:04.587590 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.587222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerDied","Data":"e29e8017d23db4df447cbeba939f007150c53eb08c22578ee3226593af13ad59"} Jul 23 14:53:04.593967 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.593950 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:53:04.594294 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.594276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" event={"ID":"92c8e82b-75bf-4aad-8415-16cb3074b738","Type":"ContainerStarted","Data":"6a56be02487d9bcb792594952b063af280a09a761d24624c7c6f971bf2fb0e93"} Jul 23 14:53:04.594606 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.594584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:53:04.609278 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.609258 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:53:04.654671 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.654622 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" podStartSLOduration=9.360426571 podStartE2EDuration="28.654604237s" totalImagesPullingTime="19.294177666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:53:04.654200266 +0000 UTC m=+29.675889534" watchObservedRunningTime="2026-07-23 14:53:04.654604237 +0000 UTC m=+29.676293482" Jul 23 14:53:04.947794 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.947714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rgx2d"] Jul 23 14:53:04.947944 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.947899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:04.948042 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:04.948017 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:53:04.950550 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.950524 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z4b8d"] Jul 23 14:53:04.950706 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.950623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:04.950785 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:04.950710 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:53:04.951408 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.951383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lwgz"] Jul 23 14:53:04.951506 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:04.951485 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:04.951601 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:04.951575 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:53:05.389700 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:05.389677 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65dc477b_a2a8_422b_be42_89291a8247b0.slice/crio-fac194d8accf9b8d706ecaa12a5fde1a68607dad106c981c7ece43232a77c73a.scope\": RecentStats: unable to find data in memory cache]" Jul 23 14:53:05.598478 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:05.598402 2576 generic.go:356] "Generic (PLEG): container finished" podID="65dc477b-a2a8-422b-be42-89291a8247b0" containerID="fac194d8accf9b8d706ecaa12a5fde1a68607dad106c981c7ece43232a77c73a" exitCode=0 Jul 23 14:53:05.598798 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:05.598478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerDied","Data":"fac194d8accf9b8d706ecaa12a5fde1a68607dad106c981c7ece43232a77c73a"} Jul 23 14:53:06.417584 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:06.417550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:06.417756 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:06.417662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:06.417756 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:06.417665 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:53:06.417756 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:06.417692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:06.417891 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:06.417775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:53:06.417891 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:06.417850 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:53:07.360537 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:07.360301 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:53:07.360984 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:07.360672 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 23 14:53:07.360984 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:07.360943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-54tvk" Jul 23 14:53:08.417795 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:08.417762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:08.418259 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:08.417762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:08.418259 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:08.417925 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:53:08.418259 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:08.417762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:08.418259 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:08.417993 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:53:08.418259 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:08.418059 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:53:09.156149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:09.156112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:09.156353 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.156291 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:53:09.156403 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.156371 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret podName:d33a5fd4-6211-4249-a57e-79d4d352690a nodeName:}" failed. No retries permitted until 2026-07-23 14:53:41.156351586 +0000 UTC m=+66.178040816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret") pod "global-pull-secret-syncer-rgx2d" (UID: "d33a5fd4-6211-4249-a57e-79d4d352690a") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:53:09.257209 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:09.257128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:09.257209 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:09.257169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:09.257447 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.257309 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:53:09.257447 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.257322 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:53:09.257447 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.257335 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:53:09.257447 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.257352 2576 projected.go:196] Error preparing data for projected volume kube-api-access-46ssb for pod openshift-network-diagnostics/network-check-target-7lwgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:53:09.257447 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.257397 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:41.257377417 +0000 UTC m=+66.279066640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:53:09.257447 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:09.257417 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb podName:f80299fc-f1a0-4f4a-8db4-b50a6dd578f2 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:41.257406394 +0000 UTC m=+66.279095617 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-46ssb" (UniqueName: "kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb") pod "network-check-target-7lwgz" (UID: "f80299fc-f1a0-4f4a-8db4-b50a6dd578f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:53:10.417064 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.417037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:10.417546 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.417037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:10.417546 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:10.417139 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:53:10.417546 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:10.417200 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgx2d" podUID="d33a5fd4-6211-4249-a57e-79d4d352690a" Jul 23 14:53:10.417546 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.417037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:10.417546 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:10.417288 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lwgz" podUID="f80299fc-f1a0-4f4a-8db4-b50a6dd578f2" Jul 23 14:53:10.612327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.612298 2576 generic.go:356] "Generic (PLEG): container finished" podID="65dc477b-a2a8-422b-be42-89291a8247b0" containerID="067c1e3501fd9c79620943322a35cb2ab7055aecbb5e86fa10ddcc6ed351dbc1" exitCode=0 Jul 23 14:53:10.612477 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.612367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerDied","Data":"067c1e3501fd9c79620943322a35cb2ab7055aecbb5e86fa10ddcc6ed351dbc1"} Jul 23 14:53:10.783394 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.783375 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeReady" Jul 23 14:53:10.783508 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.783499 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 14:53:10.842153 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.842126 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ppnjm"] Jul 23 14:53:10.846968 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.846953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:10.850207 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.850185 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g6fpr"] Jul 23 14:53:10.852919 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.852902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zzbs4\"" Jul 23 14:53:10.853291 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.853192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 14:53:10.853430 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.853384 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 14:53:10.854747 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.854727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:10.857957 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.857939 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 14:53:10.858055 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.858038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hrh8d\"" Jul 23 14:53:10.858401 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.858382 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 14:53:10.858473 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.858450 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 14:53:10.863606 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.863574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppnjm"] Jul 23 14:53:10.864173 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.864155 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6fpr"] Jul 23 14:53:10.969799 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.969727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqbr\" (UniqueName: \"kubernetes.io/projected/478b56c0-4902-4247-a906-24dc67389619-kube-api-access-skqbr\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:10.969799 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.969771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:10.969799 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.969792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478b56c0-4902-4247-a906-24dc67389619-config-volume\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:10.970012 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.969809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hfdz\" (UniqueName: \"kubernetes.io/projected/8e7721c1-393c-45d9-ab76-413a751ea1ae-kube-api-access-8hfdz\") pod \"ingress-canary-g6fpr\" (UID: \"8e7721c1-393c-45d9-ab76-413a751ea1ae\") " pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:10.970012 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.969859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478b56c0-4902-4247-a906-24dc67389619-tmp-dir\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:10.970012 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:10.969897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e7721c1-393c-45d9-ab76-413a751ea1ae-cert\") pod \"ingress-canary-g6fpr\" (UID: \"8e7721c1-393c-45d9-ab76-413a751ea1ae\") " pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:11.070981 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.070958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478b56c0-4902-4247-a906-24dc67389619-config-volume\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.071105 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.070988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hfdz\" (UniqueName: \"kubernetes.io/projected/8e7721c1-393c-45d9-ab76-413a751ea1ae-kube-api-access-8hfdz\") pod \"ingress-canary-g6fpr\" (UID: \"8e7721c1-393c-45d9-ab76-413a751ea1ae\") " pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:11.071105 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.071021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478b56c0-4902-4247-a906-24dc67389619-tmp-dir\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.071229 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.071207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e7721c1-393c-45d9-ab76-413a751ea1ae-cert\") pod \"ingress-canary-g6fpr\" (UID: \"8e7721c1-393c-45d9-ab76-413a751ea1ae\") " pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:11.071279 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.071253 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478b56c0-4902-4247-a906-24dc67389619-tmp-dir\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.071279 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.071267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqbr\" (UniqueName: \"kubernetes.io/projected/478b56c0-4902-4247-a906-24dc67389619-kube-api-access-skqbr\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.071350 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.071304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.071401 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:11.071389 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:11.071452 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:11.071444 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:11.571431785 +0000 UTC m=+36.593121008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:11.071640 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.071623 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478b56c0-4902-4247-a906-24dc67389619-config-volume\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.075327 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.075311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e7721c1-393c-45d9-ab76-413a751ea1ae-cert\") pod \"ingress-canary-g6fpr\" (UID: \"8e7721c1-393c-45d9-ab76-413a751ea1ae\") " pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:11.083363 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.083332 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqbr\" (UniqueName: \"kubernetes.io/projected/478b56c0-4902-4247-a906-24dc67389619-kube-api-access-skqbr\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.083571 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.083554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hfdz\" (UniqueName: \"kubernetes.io/projected/8e7721c1-393c-45d9-ab76-413a751ea1ae-kube-api-access-8hfdz\") pod \"ingress-canary-g6fpr\" (UID: \"8e7721c1-393c-45d9-ab76-413a751ea1ae\") " pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:11.162634 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.162601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6fpr" Jul 23 14:53:11.395425 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.395397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6fpr"] Jul 23 14:53:11.399552 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:53:11.399529 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7721c1_393c_45d9_ab76_413a751ea1ae.slice/crio-c09c5c1af6fd259a610794e7aa27899fbdd0e35f52f4378c8ca0d837fdd2f08f WatchSource:0}: Error finding container c09c5c1af6fd259a610794e7aa27899fbdd0e35f52f4378c8ca0d837fdd2f08f: Status 404 returned error can't find the container with id c09c5c1af6fd259a610794e7aa27899fbdd0e35f52f4378c8ca0d837fdd2f08f Jul 23 14:53:11.574793 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.574701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:11.575342 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:11.574862 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:11.575342 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:11.574940 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:12.57492357 +0000 UTC m=+37.596612794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:11.617800 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.617766 2576 generic.go:356] "Generic (PLEG): container finished" podID="65dc477b-a2a8-422b-be42-89291a8247b0" containerID="c8969c01ea936c097531e3afaf23c81f7a7b10dc4ea0df73b2875237bc623f90" exitCode=0 Jul 23 14:53:11.617936 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.617842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerDied","Data":"c8969c01ea936c097531e3afaf23c81f7a7b10dc4ea0df73b2875237bc623f90"} Jul 23 14:53:11.619004 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.618987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6fpr" event={"ID":"8e7721c1-393c-45d9-ab76-413a751ea1ae","Type":"ContainerStarted","Data":"c09c5c1af6fd259a610794e7aa27899fbdd0e35f52f4378c8ca0d837fdd2f08f"} Jul 23 14:53:11.832096 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.832035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:11.929833 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:11.929808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:12.030528 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.030494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:12.417611 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.417579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:12.417799 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.417621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:12.417799 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.417621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:12.422035 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.422003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-blqvw\"" Jul 23 14:53:12.422167 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.422086 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 14:53:12.422167 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.422097 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 14:53:12.422167 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.422086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 14:53:12.423547 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.423527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 14:53:12.423667 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.423616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brw86\"" Jul 23 14:53:12.582407 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.582369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:12.582909 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:12.582529 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:12.582909 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:12.582589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:14.582570181 +0000 UTC m=+39.604259405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:12.636101 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.636068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" event={"ID":"65dc477b-a2a8-422b-be42-89291a8247b0","Type":"ContainerStarted","Data":"674d730164466c84eb23e728fe737ef2e792b9e5be529fe00a9c67474c38c66c"} Jul 23 14:53:12.709350 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.709250 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tbdqk" podStartSLOduration=7.710530568 podStartE2EDuration="36.70922854s" totalImagesPullingTime="28.998697972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:53:12.707634964 +0000 UTC m=+37.729324210" watchObservedRunningTime="2026-07-23 14:53:12.70922854 +0000 UTC m=+37.730917785" Jul 23 14:53:12.860309 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.860277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:12.960751 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:12.960677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:13.052487 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:13.052451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:13.587568 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:13.587530 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:13.689504 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:13.689470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:14.599098 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:14.599075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:14.599435 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:14.599175 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:14.599435 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:14.599234 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:18.59921295 +0000 UTC m=+43.620902173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:14.641888 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:14.641844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6fpr" event={"ID":"8e7721c1-393c-45d9-ab76-413a751ea1ae","Type":"ContainerStarted","Data":"7054b5449c75965a3227a96653d9e02ba98f42eb5a208d84d40c451bd7d0fe17"} Jul 23 14:53:14.663153 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:14.663101 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g6fpr" podStartSLOduration=2.117763197 podStartE2EDuration="4.66308748s" totalImagesPullingTime="2.545324283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:53:14.662628231 +0000 UTC m=+39.684317476" watchObservedRunningTime="2026-07-23 14:53:14.66308748 +0000 UTC m=+39.684776734" Jul 23 14:53:15.368840 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:15.368662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:15.436918 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:15.436883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:18.625507 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:18.625467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:18.625906 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:18.625575 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:18.625906 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:18.625623 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:26.62561065 +0000 UTC m=+51.647299873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:18.748677 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:18.748650 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:18.878555 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:18.878482 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:26.681643 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:26.681607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:26.682218 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:26.681752 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:26.682218 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:26.681816 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:53:42.6818001 +0000 UTC m=+67.703489323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:31.350911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:31.350859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:31.416253 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:31.416221 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:32.782418 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:32.782389 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:32.888573 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:32.888542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:36.611131 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:36.611104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mb4z4" Jul 23 14:53:36.777730 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:36.777700 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:36.855436 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:36.855410 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:39.380686 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:39.380649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:39.483181 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:39.483150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:41.180583 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.180545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:41.183744 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.183726 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 14:53:41.195153 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.195135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d33a5fd4-6211-4249-a57e-79d4d352690a-original-pull-secret\") pod \"global-pull-secret-syncer-rgx2d\" (UID: \"d33a5fd4-6211-4249-a57e-79d4d352690a\") " pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:41.242648 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.242617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgx2d" Jul 23 14:53:41.281153 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.281135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:53:41.281241 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.281166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:41.284237 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.284220 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 14:53:41.284344 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.284223 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 14:53:41.292242 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:41.292226 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 14:53:41.292317 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:41.292304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:54:45.29228304 +0000 UTC m=+130.313972263 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : secret "metrics-daemon-secret" not found Jul 23 14:53:41.295366 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.295343 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 14:53:41.305072 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.305046 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ssb\" (UniqueName: \"kubernetes.io/projected/f80299fc-f1a0-4f4a-8db4-b50a6dd578f2-kube-api-access-46ssb\") pod \"network-check-target-7lwgz\" (UID: \"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2\") " pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:41.409677 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.409650 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rgx2d"] Jul 23 14:53:41.413174 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:53:41.413144 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33a5fd4_6211_4249_a57e_79d4d352690a.slice/crio-9c50490bff9a0983d8d5363893c45afacceb3fa24fcdb363cb0d3953fe2d729e WatchSource:0}: Error finding container 9c50490bff9a0983d8d5363893c45afacceb3fa24fcdb363cb0d3953fe2d729e: Status 404 returned error can't find the container with id 9c50490bff9a0983d8d5363893c45afacceb3fa24fcdb363cb0d3953fe2d729e Jul 23 14:53:41.533747 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.533728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-blqvw\"" Jul 23 14:53:41.541342 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.541324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:41.686460 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.686434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lwgz"] Jul 23 14:53:41.701141 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:53:41.701108 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80299fc_f1a0_4f4a_8db4_b50a6dd578f2.slice/crio-2800cfbaa328de4f2d10d480e8c601abdd9dbbc6cc2c99fd1d2f1938babdd240 WatchSource:0}: Error finding container 2800cfbaa328de4f2d10d480e8c601abdd9dbbc6cc2c99fd1d2f1938babdd240: Status 404 returned error can't find the container with id 2800cfbaa328de4f2d10d480e8c601abdd9dbbc6cc2c99fd1d2f1938babdd240 Jul 23 14:53:41.707228 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.707202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lwgz" event={"ID":"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2","Type":"ContainerStarted","Data":"2800cfbaa328de4f2d10d480e8c601abdd9dbbc6cc2c99fd1d2f1938babdd240"} Jul 23 14:53:41.708150 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:41.708130 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rgx2d" event={"ID":"d33a5fd4-6211-4249-a57e-79d4d352690a","Type":"ContainerStarted","Data":"9c50490bff9a0983d8d5363893c45afacceb3fa24fcdb363cb0d3953fe2d729e"} Jul 23 14:53:42.691048 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:42.691010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:53:42.691494 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:42.691184 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:53:42.691494 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:53:42.691264 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:54:14.691242056 +0000 UTC m=+99.712931292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:53:46.724110 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:46.724072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lwgz" event={"ID":"f80299fc-f1a0-4f4a-8db4-b50a6dd578f2","Type":"ContainerStarted","Data":"4603a61ebb10b297baed0f76cb9e91cd99547221d4199db6a02cd63eaefae032"} Jul 23 14:53:46.724590 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:46.724164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:53:46.725482 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:46.725459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rgx2d" event={"ID":"d33a5fd4-6211-4249-a57e-79d4d352690a","Type":"ContainerStarted","Data":"a326eded2dff36dcb6f97ac0062d19b5f61eebd061973c786a9aa406a216132c"} Jul 23 14:53:46.742490 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:46.742449 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7lwgz" podStartSLOduration=66.518148784 podStartE2EDuration="1m10.74243654s" totalImagesPullingTime="4.224287756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:53:46.741499755 +0000 UTC m=+71.763189000" watchObservedRunningTime="2026-07-23 14:53:46.74243654 +0000 UTC m=+71.764125763" Jul 23 14:53:46.758932 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:46.758894 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rgx2d" podStartSLOduration=66.24425491 podStartE2EDuration="1m10.758861525s" totalImagesPullingTime="4.514606615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:53:46.758065798 +0000 UTC m=+71.779755043" watchObservedRunningTime="2026-07-23 14:53:46.758861525 +0000 UTC m=+71.780550769" Jul 23 14:53:48.458301 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:48.458272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:48.560684 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:48.560657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:53:59.548080 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.547970 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh"] Jul 23 14:53:59.552035 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.552021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.555551 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.555531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 23 14:53:59.556633 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.556605 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 23 14:53:59.556916 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.556819 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 14:53:59.557077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.556960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 14:53:59.557077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.556993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 14:53:59.557077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.557003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 23 14:53:59.557077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.557033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 23 14:53:59.565559 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.565532 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh"] Jul 23 14:53:59.607776 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.607751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.607891 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.607779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.607891 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.607803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cb2t\" (UniqueName: \"kubernetes.io/projected/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-kube-api-access-7cb2t\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.607967 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.607909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-ca\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.607967 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.607959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-additional-service-ca\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.608027 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.607983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-hub\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709035 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-additional-service-ca\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709144 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-hub\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709144 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709144 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709144 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cb2t\" (UniqueName: \"kubernetes.io/projected/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-kube-api-access-7cb2t\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709291 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-ca\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.709903 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.709798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-additional-service-ca\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.711789 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.711746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-hub\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.711915 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.711854 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.712109 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.712094 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.712152 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.712115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-ca\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.718994 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.718972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cb2t\" (UniqueName: \"kubernetes.io/projected/b96b4752-0a71-4cf9-8a17-d9ac75d8d917-kube-api-access-7cb2t\") pod \"cluster-proxy-proxy-agent-798ff7d7bf-2hsgh\" (UID: \"b96b4752-0a71-4cf9-8a17-d9ac75d8d917\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.874819 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.874737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:53:59.998542 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:53:59.998513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh"] Jul 23 14:54:00.001186 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:54:00.001161 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb96b4752_0a71_4cf9_8a17_d9ac75d8d917.slice/crio-9f5ad63afc915e22f7eef86d58af1de1ace0df8b71303b65b30ede1c8f21dae4 WatchSource:0}: Error finding container 9f5ad63afc915e22f7eef86d58af1de1ace0df8b71303b65b30ede1c8f21dae4: Status 404 returned error can't find the container with id 9f5ad63afc915e22f7eef86d58af1de1ace0df8b71303b65b30ede1c8f21dae4 Jul 23 14:54:00.761964 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:00.761930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" event={"ID":"b96b4752-0a71-4cf9-8a17-d9ac75d8d917","Type":"ContainerStarted","Data":"9f5ad63afc915e22f7eef86d58af1de1ace0df8b71303b65b30ede1c8f21dae4"} Jul 23 14:54:04.775554 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:04.775514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" event={"ID":"b96b4752-0a71-4cf9-8a17-d9ac75d8d917","Type":"ContainerStarted","Data":"e16a62229c1a7faa65b52cf18348e3fd223c92ac6b4fe33d6caaeed0d9f046f0"} Jul 23 14:54:04.775932 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:04.775566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" event={"ID":"b96b4752-0a71-4cf9-8a17-d9ac75d8d917","Type":"ContainerStarted","Data":"717338881ec4fd59e201a753c729d25b8ba35e0fe1ee20d6ce6d72a684265050"} Jul 23 14:54:04.775932 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:04.775591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" event={"ID":"b96b4752-0a71-4cf9-8a17-d9ac75d8d917","Type":"ContainerStarted","Data":"e797ea57b382867075ebf303c25afa46cc4e2e859d2c1901066eb83c24d9e42d"} Jul 23 14:54:04.796340 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:04.796298 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" podStartSLOduration=2.021756448 podStartE2EDuration="5.796285481s" totalImagesPullingTime="3.774529033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:54:04.794485591 +0000 UTC m=+89.816174835" watchObservedRunningTime="2026-07-23 14:54:04.796285481 +0000 UTC m=+89.817974751" Jul 23 14:54:09.944158 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:09.944124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:54:10.005004 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:10.004956 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:54:14.712352 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:14.712305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:54:14.712815 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:54:14.712451 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:54:14.712815 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:54:14.712521 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:55:18.712505384 +0000 UTC m=+163.734194611 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:54:17.729979 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:17.729946 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7lwgz" Jul 23 14:54:45.323921 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:54:45.323864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:54:45.324342 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:54:45.324006 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 14:54:45.324342 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:54:45.324074 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:47.324059662 +0000 UTC m=+252.345748886 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : secret "metrics-daemon-secret" not found Jul 23 14:55:11.642269 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:55:11.642236 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:55:13.855679 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:55:13.855642 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ppnjm" podUID="478b56c0-4902-4247-a906-24dc67389619" Jul 23 14:55:13.964721 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:55:13.964694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppnjm" Jul 23 14:55:15.437655 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:55:15.437619 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:55:18.757548 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:55:18.757502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:55:18.758042 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:55:18.757629 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:55:18.758042 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:55:18.757681 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls podName:478b56c0-4902-4247-a906-24dc67389619 nodeName:}" failed. No retries permitted until 2026-07-23 14:57:20.757666715 +0000 UTC m=+285.779355937 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls") pod "dns-default-ppnjm" (UID: "478b56c0-4902-4247-a906-24dc67389619") : secret "dns-default-metrics-tls" not found Jul 23 14:55:27.417340 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:55:27.417259 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:56:21.953563 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:21.953529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:44.473295 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:44.473252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:44.574902 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:44.574859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:47.270137 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:47.270101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:47.351778 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:47.351724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:56:47.352018 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:47.351889 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 14:56:47.352018 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:47.351961 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs podName:b2e85229-b5e7-41ba-a710-969494798b89 nodeName:}" failed. No retries permitted until 2026-07-23 14:58:49.351944338 +0000 UTC m=+374.373633561 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs") pod "network-metrics-daemon-z4b8d" (UID: "b2e85229-b5e7-41ba-a710-969494798b89") : secret "metrics-daemon-secret" not found Jul 23 14:56:47.371694 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:47.371663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:48.119651 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.119621 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v8mqw"] Jul 23 14:56:48.122613 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.122592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.125161 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.125142 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 14:56:48.125365 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.125348 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 14:56:48.126629 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.126608 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pmdlz\"" Jul 23 14:56:48.126729 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.126647 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 14:56:48.126729 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.126715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 14:56:48.139550 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.139526 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8mqw"] Jul 23 14:56:48.143952 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.143931 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:48.258830 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.258804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.258830 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.258833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.259027 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.258850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvkhk\" (UniqueName: \"kubernetes.io/projected/925f273f-56ff-4442-81be-943ea2f28e69-kube-api-access-bvkhk\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.259027 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.258974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/925f273f-56ff-4442-81be-943ea2f28e69-data-volume\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.259027 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.259026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/925f273f-56ff-4442-81be-943ea2f28e69-crio-socket\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.359761 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.359725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/925f273f-56ff-4442-81be-943ea2f28e69-data-volume\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.359780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/925f273f-56ff-4442-81be-943ea2f28e69-crio-socket\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.359810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.359865 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.359901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/925f273f-56ff-4442-81be-943ea2f28e69-crio-socket\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.359915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.359946 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:48.859929768 +0000 UTC m=+253.881618991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : configmap "kube-rbac-proxy" not found Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.359990 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.360008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvkhk\" (UniqueName: \"kubernetes.io/projected/925f273f-56ff-4442-81be-943ea2f28e69-kube-api-access-bvkhk\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.360040 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:48.860026827 +0000 UTC m=+253.881716051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : secret "insights-runtime-extractor-tls" not found Jul 23 14:56:48.360149 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.360051 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/925f273f-56ff-4442-81be-943ea2f28e69-data-volume\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.371389 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.371334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvkhk\" (UniqueName: \"kubernetes.io/projected/925f273f-56ff-4442-81be-943ea2f28e69-kube-api-access-bvkhk\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.564160 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.564116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:48.620858 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.620834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:48.863625 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.863585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.863625 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:48.863627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:48.863862 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.863736 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:56:48.863862 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.863738 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:56:48.863862 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.863799 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:49.863782208 +0000 UTC m=+254.885471431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : secret "insights-runtime-extractor-tls" not found Jul 23 14:56:48.863862 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:48.863813 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:49.863806275 +0000 UTC m=+254.885495499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : configmap "kube-rbac-proxy" not found Jul 23 14:56:49.012232 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:49.012203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:49.133260 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:49.133194 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:49.871478 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:49.871446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:49.871478 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:49.871479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:49.872095 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:49.871583 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:56:49.872095 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:49.871582 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:56:49.872095 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:49.871635 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:51.871621106 +0000 UTC m=+256.893310331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : secret "insights-runtime-extractor-tls" not found Jul 23 14:56:49.872095 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:49.871649 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:51.871642421 +0000 UTC m=+256.893331643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : configmap "kube-rbac-proxy" not found Jul 23 14:56:49.888626 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:49.888605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mqcc_7d03f826-75df-4581-9466-53365b7d93f8/dns-node-resolver/0.log" Jul 23 14:56:50.667777 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:50.667746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:50.728749 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:50.728710 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:51.089592 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.089563 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-92mv7_422b5e09-2b02-4079-b8aa-6a63ac6efb21/node-ca/0.log" Jul 23 14:56:51.275302 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.275268 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:51.377043 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.376969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:51.634297 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.634217 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:51.735169 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.735139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:51.884739 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.884656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:51.884739 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.884704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:51.884928 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:51.884768 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:56:51.884928 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:51.884826 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:55.884812603 +0000 UTC m=+260.906501827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : configmap "kube-rbac-proxy" not found Jul 23 14:56:51.884928 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:51.884828 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:56:51.884928 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:51.884894 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:56:55.884860058 +0000 UTC m=+260.906549284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : secret "insights-runtime-extractor-tls" not found Jul 23 14:56:51.897361 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.897335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6fpr_8e7721c1-393c-45d9-ab76-413a751ea1ae/serve-healthcheck-canary/0.log" Jul 23 14:56:51.910636 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:51.910606 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.178033 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.177968 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.308438 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.308403 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.408613 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.408584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.568739 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.568712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.634265 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.634241 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.871165 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.871079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:52.971058 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:52.971030 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:53.898176 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:53.898143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:54.276371 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:54.276346 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:54.487064 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:54.487029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:54.674658 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:54.674575 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:54.879199 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:54.879167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:55.480721 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:55.480690 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:55.912775 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:55.912746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:55.912975 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:55.912781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:56:55.912975 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:55.912867 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:56:55.912975 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:55.912909 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:56:55.912975 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:55.912953 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:57:03.912938134 +0000 UTC m=+268.934627357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : configmap "kube-rbac-proxy" not found Jul 23 14:56:55.912975 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:56:55.912966 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls podName:925f273f-56ff-4442-81be-943ea2f28e69 nodeName:}" failed. No retries permitted until 2026-07-23 14:57:03.912960865 +0000 UTC m=+268.934650087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8mqw" (UID: "925f273f-56ff-4442-81be-943ea2f28e69") : secret "insights-runtime-extractor-tls" not found Jul 23 14:56:56.015580 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:56.015549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:56.116310 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:56.116283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:56.175082 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:56.175009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:56.484151 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:56.484057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:56.874107 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:56.874080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:57.279115 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:57.279088 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:57.476890 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:57.476834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:58.076907 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:58.076863 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:58.318267 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:58.318236 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:58.476782 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:58.474245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:58.672373 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:58.672303 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:58.727819 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:58.727792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:59.272543 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:59.272512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:56:59.877041 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:56:59.877013 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:00.072708 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:00.072672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:00.270950 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:00.270921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:00.669383 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:00.669288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:01.273791 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:01.273761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:01.360553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:01.360526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:01.870798 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:01.870772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:02.076496 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:02.076452 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:02.276826 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:02.276798 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:02.728621 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:02.728544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:02.873109 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:02.873076 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:02.974021 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:02.973995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:03.073527 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.073497 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:03.174690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.174657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:03.305890 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.305859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:03.973527 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.973499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:57:03.973527 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.973529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:57:03.974019 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.974002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925f273f-56ff-4442-81be-943ea2f28e69-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:57:03.975841 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:03.975825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925f273f-56ff-4442-81be-943ea2f28e69-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8mqw\" (UID: \"925f273f-56ff-4442-81be-943ea2f28e69\") " pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:57:04.031558 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:04.031532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8mqw" Jul 23 14:57:04.154153 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:04.154125 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8mqw"] Jul 23 14:57:04.157493 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:04.157458 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925f273f_56ff_4442_81be_943ea2f28e69.slice/crio-2c161989fb80160dd27730e22c6adde6dc13dbef8082b6c9411d0e24f99b820c WatchSource:0}: Error finding container 2c161989fb80160dd27730e22c6adde6dc13dbef8082b6c9411d0e24f99b820c: Status 404 returned error can't find the container with id 2c161989fb80160dd27730e22c6adde6dc13dbef8082b6c9411d0e24f99b820c Jul 23 14:57:04.266544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:04.266516 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8mqw" event={"ID":"925f273f-56ff-4442-81be-943ea2f28e69","Type":"ContainerStarted","Data":"2c161989fb80160dd27730e22c6adde6dc13dbef8082b6c9411d0e24f99b820c"} Jul 23 14:57:09.448478 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:09.448447 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:09.550947 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:09.550904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:09.606002 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:09.605972 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:09.761502 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:09.761425 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:09.934284 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:09.934224 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:10.126802 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:10.126759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:10.290236 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:10.290197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8mqw" event={"ID":"925f273f-56ff-4442-81be-943ea2f28e69","Type":"ContainerStarted","Data":"1aeb882fc0da51e55aca006930aaac8040e432677f42aa7876623177914e8e99"} Jul 23 14:57:10.753628 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:10.753571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:10.811268 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:10.811227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:11.160501 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:11.160465 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:11.219560 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:11.219525 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:11.339913 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:11.339860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:11.541793 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:11.541727 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:12.116607 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:12.116577 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:12.786756 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:12.786730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:12.885641 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:12.885617 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:13.302155 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.302121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8mqw" event={"ID":"925f273f-56ff-4442-81be-943ea2f28e69","Type":"ContainerStarted","Data":"8f3ae996abeb7d61b3abef4f66d0e5fe1c997ac81bff13cdc32b10cf4f1b4208"} Jul 23 14:57:13.603758 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.603676 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:13.669034 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.668997 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl"] Jul 23 14:57:13.672252 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.672230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:13.676665 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.676639 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vnxfc\"" Jul 23 14:57:13.676773 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.676676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 14:57:13.681753 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.681731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl"] Jul 23 14:57:13.718713 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.718685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:13.728710 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.728686 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bb5db57f7-gnwhz"] Jul 23 14:57:13.731661 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.731639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.734715 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.734694 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 14:57:13.734821 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.734799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 14:57:13.735264 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.735246 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 14:57:13.735563 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.735545 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9zwgm\"" Jul 23 14:57:13.740480 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.740188 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 14:57:13.744270 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.744248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb5db57f7-gnwhz"] Jul 23 14:57:13.845660 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-ca-trust-extracted\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.845836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-registry-tls\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.845836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-trusted-ca\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.845836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-bound-sa-token\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.845836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/31cafbbf-1e70-4747-b5a3-59359fac180c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vnwpl\" (UID: \"31cafbbf-1e70-4747-b5a3-59359fac180c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:13.846080 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-registry-certificates\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.846080 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-image-registry-private-configuration\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.846080 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.845996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gvfp\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-kube-api-access-4gvfp\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.846080 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.846040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-installation-pull-secrets\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.946629 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.946546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-registry-certificates\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.946629 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.946584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-image-registry-private-configuration\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.946831 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.946752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gvfp\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-kube-api-access-4gvfp\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.946911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.946833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-installation-pull-secrets\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.946982 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.946962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-ca-trust-extracted\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.947544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.947032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-registry-tls\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.947544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.947081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-trusted-ca\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.947544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.947104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-bound-sa-token\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.947544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.947132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/31cafbbf-1e70-4747-b5a3-59359fac180c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vnwpl\" (UID: \"31cafbbf-1e70-4747-b5a3-59359fac180c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:13.947544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.947390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-ca-trust-extracted\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.947544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.947489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-registry-certificates\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.948469 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.948443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-trusted-ca\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.949917 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.949868 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-image-registry-private-configuration\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.950012 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.949962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-installation-pull-secrets\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.950911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.950865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-registry-tls\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.951333 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.951311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/31cafbbf-1e70-4747-b5a3-59359fac180c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vnwpl\" (UID: \"31cafbbf-1e70-4747-b5a3-59359fac180c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:13.956348 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.956326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-bound-sa-token\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.956754 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.956732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gvfp\" (UniqueName: \"kubernetes.io/projected/ea182948-84ac-4c85-8fd0-0f9c7ccc4888-kube-api-access-4gvfp\") pod \"image-registry-6bb5db57f7-gnwhz\" (UID: \"ea182948-84ac-4c85-8fd0-0f9c7ccc4888\") " pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:13.983629 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:13.983600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:14.044025 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.043796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:14.130590 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.130514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl"] Jul 23 14:57:14.134736 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:14.134707 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cafbbf_1e70_4747_b5a3_59359fac180c.slice/crio-da59c4f386528bcb87fe0f881a6e361845005c13e8c60ac700b2bc10069c65ec WatchSource:0}: Error finding container da59c4f386528bcb87fe0f881a6e361845005c13e8c60ac700b2bc10069c65ec: Status 404 returned error can't find the container with id da59c4f386528bcb87fe0f881a6e361845005c13e8c60ac700b2bc10069c65ec Jul 23 14:57:14.198630 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.198551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb5db57f7-gnwhz"] Jul 23 14:57:14.202500 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:14.202476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea182948_84ac_4c85_8fd0_0f9c7ccc4888.slice/crio-6cc7475992ba716bf7888eecbd88255cb8019019e570b49f06e30569fef22747 WatchSource:0}: Error finding container 6cc7475992ba716bf7888eecbd88255cb8019019e570b49f06e30569fef22747: Status 404 returned error can't find the container with id 6cc7475992ba716bf7888eecbd88255cb8019019e570b49f06e30569fef22747 Jul 23 14:57:14.307574 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.307537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" event={"ID":"31cafbbf-1e70-4747-b5a3-59359fac180c","Type":"ContainerStarted","Data":"da59c4f386528bcb87fe0f881a6e361845005c13e8c60ac700b2bc10069c65ec"} Jul 23 14:57:14.309204 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.309171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" event={"ID":"ea182948-84ac-4c85-8fd0-0f9c7ccc4888","Type":"ContainerStarted","Data":"2ef80f910234adad3eb86e818e8ad4853c893e668a1a9f277eb20d27f7ea1912"} Jul 23 14:57:14.309308 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.309219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" event={"ID":"ea182948-84ac-4c85-8fd0-0f9c7ccc4888","Type":"ContainerStarted","Data":"6cc7475992ba716bf7888eecbd88255cb8019019e570b49f06e30569fef22747"} Jul 23 14:57:14.309308 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.309302 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:14.329072 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:14.328973 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" podStartSLOduration=1.328953382 podStartE2EDuration="1.328953382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:14.328368492 +0000 UTC m=+279.350057739" watchObservedRunningTime="2026-07-23 14:57:14.328953382 +0000 UTC m=+279.350642630" Jul 23 14:57:16.965219 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:57:16.965168 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ppnjm" podUID="478b56c0-4902-4247-a906-24dc67389619" Jul 23 14:57:17.320850 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.320821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8mqw" event={"ID":"925f273f-56ff-4442-81be-943ea2f28e69","Type":"ContainerStarted","Data":"1593edd3afdd85ec6a7f7871f98f5ff23daac4f40dbe289a48466fe44ed708d7"} Jul 23 14:57:17.322213 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.322189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" event={"ID":"31cafbbf-1e70-4747-b5a3-59359fac180c","Type":"ContainerStarted","Data":"01ab71e6c12f5fb16dde17dc489ac28fb139fdab0d455ee2f9099e8bab222277"} Jul 23 14:57:17.322297 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.322205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppnjm" Jul 23 14:57:17.322375 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.322291 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:17.326714 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.326696 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" Jul 23 14:57:17.340696 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.340658 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v8mqw" podStartSLOduration=17.286736971 podStartE2EDuration="29.340647446s" totalImagesPullingTime="12.053910475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:56:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:17.338836588 +0000 UTC m=+282.360525830" watchObservedRunningTime="2026-07-23 14:57:17.340647446 +0000 UTC m=+282.362336691" Jul 23 14:57:17.354626 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:17.354586 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vnwpl" podStartSLOduration=1.441217216 podStartE2EDuration="4.354573019s" totalImagesPullingTime="2.913355803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:17.354051705 +0000 UTC m=+282.375740952" watchObservedRunningTime="2026-07-23 14:57:17.354573019 +0000 UTC m=+282.376262263" Jul 23 14:57:18.143465 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:18.143438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:18.208674 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:18.208648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:19.211344 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:19.211315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:20.411289 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.411257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:20.467578 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.467551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:20.518118 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.518097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:20.797807 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.797784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:57:20.800202 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.800173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478b56c0-4902-4247-a906-24dc67389619-metrics-tls\") pod \"dns-default-ppnjm\" (UID: \"478b56c0-4902-4247-a906-24dc67389619\") " pod="openshift-dns/dns-default-ppnjm" Jul 23 14:57:20.925809 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.925783 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zzbs4\"" Jul 23 14:57:20.934131 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:20.934113 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppnjm" Jul 23 14:57:21.056929 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:21.056836 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppnjm"] Jul 23 14:57:21.059542 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:21.059514 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478b56c0_4902_4247_a906_24dc67389619.slice/crio-64c5641f186f21f6fe999de0178d1128076c50818daea0259ba5eeebbf9f35f2 WatchSource:0}: Error finding container 64c5641f186f21f6fe999de0178d1128076c50818daea0259ba5eeebbf9f35f2: Status 404 returned error can't find the container with id 64c5641f186f21f6fe999de0178d1128076c50818daea0259ba5eeebbf9f35f2 Jul 23 14:57:21.335374 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:21.335297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppnjm" event={"ID":"478b56c0-4902-4247-a906-24dc67389619","Type":"ContainerStarted","Data":"64c5641f186f21f6fe999de0178d1128076c50818daea0259ba5eeebbf9f35f2"} Jul 23 14:57:22.466083 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.466052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:22.748981 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.748915 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76995c9bfc-9vq72"] Jul 23 14:57:22.751856 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.751840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.754932 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.754910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 14:57:22.755058 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.754949 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 14:57:22.756273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.756253 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 14:57:22.756273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.756260 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 14:57:22.756449 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.756336 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 14:57:22.756509 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.756472 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ld9fz\"" Jul 23 14:57:22.756563 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.756543 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 14:57:22.756616 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.756547 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 14:57:22.760842 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.760818 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 14:57:22.762522 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.762502 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76995c9bfc-9vq72"] Jul 23 14:57:22.811485 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-serving-cert\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.811583 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-oauth-config\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.811583 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znh84\" (UniqueName: \"kubernetes.io/projected/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-kube-api-access-znh84\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.811583 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-config\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.811681 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-service-ca\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.811681 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-oauth-serving-cert\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.811681 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.811623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-trusted-ca-bundle\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912613 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znh84\" (UniqueName: \"kubernetes.io/projected/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-kube-api-access-znh84\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912745 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-config\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912745 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-service-ca\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912745 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-oauth-serving-cert\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912745 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-trusted-ca-bundle\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912974 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-serving-cert\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.912974 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.912830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-oauth-config\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.913281 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.913260 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-service-ca\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.913341 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.913317 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-config\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.913774 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.913757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-trusted-ca-bundle\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.913990 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.913971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-oauth-serving-cert\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.915357 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.915337 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-serving-cert\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.915464 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.915444 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-oauth-config\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:22.922104 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:22.922085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znh84\" (UniqueName: \"kubernetes.io/projected/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-kube-api-access-znh84\") pod \"console-76995c9bfc-9vq72\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:23.061169 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.061144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:23.186719 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.186692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76995c9bfc-9vq72"] Jul 23 14:57:23.189637 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:23.189607 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e05e19_bb98_4819_80e2_3fb9c9d9cfce.slice/crio-a0ba475fb00617d0b3f47892df6d9f28ff9d73d582783f07eb40322e5d0de02a WatchSource:0}: Error finding container a0ba475fb00617d0b3f47892df6d9f28ff9d73d582783f07eb40322e5d0de02a: Status 404 returned error can't find the container with id a0ba475fb00617d0b3f47892df6d9f28ff9d73d582783f07eb40322e5d0de02a Jul 23 14:57:23.343821 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.343715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppnjm" event={"ID":"478b56c0-4902-4247-a906-24dc67389619","Type":"ContainerStarted","Data":"80a759e91cf57a20d0e52f0030932f4826ff14d5dd827d12e38bf38ff7ec2256"} Jul 23 14:57:23.343821 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.343775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppnjm" event={"ID":"478b56c0-4902-4247-a906-24dc67389619","Type":"ContainerStarted","Data":"3d87e689d2479fa5f99005b9bc162eea28f9daa1bc0ed1e24d60ca73e7aff9e2"} Jul 23 14:57:23.344066 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.343865 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ppnjm" Jul 23 14:57:23.344932 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.344910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995c9bfc-9vq72" event={"ID":"66e05e19-bb98-4819-80e2-3fb9c9d9cfce","Type":"ContainerStarted","Data":"a0ba475fb00617d0b3f47892df6d9f28ff9d73d582783f07eb40322e5d0de02a"} Jul 23 14:57:23.361544 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.361497 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ppnjm" podStartSLOduration=251.912534551 podStartE2EDuration="4m13.361484222s" totalImagesPullingTime="1.448949671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:23.359924413 +0000 UTC m=+288.381613657" watchObservedRunningTime="2026-07-23 14:57:23.361484222 +0000 UTC m=+288.383173494" Jul 23 14:57:23.757300 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:23.757199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.269539 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.269504 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.487504 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.487467 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.512032 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.511997 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d"] Jul 23 14:57:25.521121 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.521050 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zcj8f"] Jul 23 14:57:25.521259 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.521201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.528250 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.528225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.529542 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.529513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.529659 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.529568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.529659 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.529647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.529791 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.529682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthfc\" (UniqueName: \"kubernetes.io/projected/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-kube-api-access-rthfc\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.530491 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.530459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 14:57:25.533307 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.533286 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 14:57:25.535288 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.535263 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 14:57:25.535924 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.535906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 14:57:25.536933 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.536763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 14:57:25.536933 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.536802 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nfvzk\"" Jul 23 14:57:25.536933 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.536817 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 14:57:25.537166 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.537090 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 14:57:25.537316 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.537301 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-62kkx\"" Jul 23 14:57:25.537475 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.537454 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 14:57:25.537660 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.537637 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d"] Jul 23 14:57:25.554331 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.554309 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2nr5t"] Jul 23 14:57:25.559160 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.559135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.563909 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.563889 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 14:57:25.564298 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.564279 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n67p9\"" Jul 23 14:57:25.564739 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.564719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 14:57:25.565139 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.565120 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 14:57:25.581393 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.581368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2nr5t"] Jul 23 14:57:25.605408 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.605381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.631017 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.630985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-sys\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54012de9-6535-48db-8650-e2b25b055226-metrics-client-ca\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54012de9-6535-48db-8650-e2b25b055226-node-exporter-textfile\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631142 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54012de9-6535-48db-8650-e2b25b055226-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631348 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.631348 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.631348 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d899a705-2aa3-428d-a185-493dec1b469e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.631348 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.631348 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:57:25.631327 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-root\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d899a705-2aa3-428d-a185-493dec1b469e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:57:25.631402 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-tls podName:c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0 nodeName:}" failed. No retries permitted until 2026-07-23 14:57:26.131381895 +0000 UTC m=+291.153071124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-cc97d" (UID: "c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0") : secret "openshift-state-metrics-tls" not found Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ghwl\" (UniqueName: \"kubernetes.io/projected/54012de9-6535-48db-8650-e2b25b055226-kube-api-access-6ghwl\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54012de9-6535-48db-8650-e2b25b055226-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-node-exporter-wtmp\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.631911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9vf9\" (UniqueName: \"kubernetes.io/projected/d899a705-2aa3-428d-a185-493dec1b469e-kube-api-access-j9vf9\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.631911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54012de9-6535-48db-8650-e2b25b055226-node-exporter-tls\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.631911 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.631741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthfc\" (UniqueName: \"kubernetes.io/projected/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-kube-api-access-rthfc\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.632234 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.632210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.634424 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.634397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.645269 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.645247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthfc\" (UniqueName: \"kubernetes.io/projected/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-kube-api-access-rthfc\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:25.697771 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.697742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.732856 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.732821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54012de9-6535-48db-8650-e2b25b055226-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.732893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.732940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d899a705-2aa3-428d-a185-493dec1b469e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.732966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.732991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-root\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733023 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d899a705-2aa3-428d-a185-493dec1b469e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:57:25.733053 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ghwl\" (UniqueName: \"kubernetes.io/projected/54012de9-6535-48db-8650-e2b25b055226-kube-api-access-6ghwl\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54012de9-6535-48db-8650-e2b25b055226-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:57:25.733145 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-tls podName:d899a705-2aa3-428d-a185-493dec1b469e nodeName:}" failed. No retries permitted until 2026-07-23 14:57:26.233123618 +0000 UTC m=+291.254812853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-2nr5t" (UID: "d899a705-2aa3-428d-a185-493dec1b469e") : secret "kube-state-metrics-tls" not found Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-node-exporter-wtmp\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9vf9\" (UniqueName: \"kubernetes.io/projected/d899a705-2aa3-428d-a185-493dec1b469e-kube-api-access-j9vf9\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733273 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54012de9-6535-48db-8650-e2b25b055226-node-exporter-tls\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-sys\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54012de9-6535-48db-8650-e2b25b055226-metrics-client-ca\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733349 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d899a705-2aa3-428d-a185-493dec1b469e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733399 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-node-exporter-wtmp\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-sys\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54012de9-6535-48db-8650-e2b25b055226-node-exporter-textfile\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.733690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733619 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54012de9-6535-48db-8650-e2b25b055226-node-exporter-textfile\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.734055 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733692 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54012de9-6535-48db-8650-e2b25b055226-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.734055 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.733771 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54012de9-6535-48db-8650-e2b25b055226-root\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.734135 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.734054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54012de9-6535-48db-8650-e2b25b055226-metrics-client-ca\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.734498 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.734466 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d899a705-2aa3-428d-a185-493dec1b469e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.734606 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.734471 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.735791 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.735772 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54012de9-6535-48db-8650-e2b25b055226-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.735918 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.735897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54012de9-6535-48db-8650-e2b25b055226-node-exporter-tls\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.736697 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.736656 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.744756 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.744732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ghwl\" (UniqueName: \"kubernetes.io/projected/54012de9-6535-48db-8650-e2b25b055226-kube-api-access-6ghwl\") pod \"node-exporter-zcj8f\" (UID: \"54012de9-6535-48db-8650-e2b25b055226\") " pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.745044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.745028 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9vf9\" (UniqueName: \"kubernetes.io/projected/d899a705-2aa3-428d-a185-493dec1b469e-kube-api-access-j9vf9\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:25.798434 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.798366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.844050 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.844027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcj8f" Jul 23 14:57:25.853510 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:25.853483 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54012de9_6535_48db_8650_e2b25b055226.slice/crio-b2d34c7ca8c42d88aea0d6aa5eaf4c1e1a8659658d9e2a0549c343367eb55259 WatchSource:0}: Error finding container b2d34c7ca8c42d88aea0d6aa5eaf4c1e1a8659658d9e2a0549c343367eb55259: Status 404 returned error can't find the container with id b2d34c7ca8c42d88aea0d6aa5eaf4c1e1a8659658d9e2a0549c343367eb55259 Jul 23 14:57:25.897898 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.897852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:25.997743 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:25.997711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:26.098834 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.098755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:26.136734 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.136702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:26.139160 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.139133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cc97d\" (UID: \"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:26.233360 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.233331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:26.237451 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.237430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:26.239782 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.239762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d899a705-2aa3-428d-a185-493dec1b469e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2nr5t\" (UID: \"d899a705-2aa3-428d-a185-493dec1b469e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:26.357025 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.356942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995c9bfc-9vq72" event={"ID":"66e05e19-bb98-4819-80e2-3fb9c9d9cfce","Type":"ContainerStarted","Data":"02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4"} Jul 23 14:57:26.358002 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.357978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcj8f" event={"ID":"54012de9-6535-48db-8650-e2b25b055226","Type":"ContainerStarted","Data":"b2d34c7ca8c42d88aea0d6aa5eaf4c1e1a8659658d9e2a0549c343367eb55259"} Jul 23 14:57:26.377473 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.377432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76995c9bfc-9vq72" podStartSLOduration=1.715190644 podStartE2EDuration="4.377390223s" totalImagesPullingTime="2.662199579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:26.376658259 +0000 UTC m=+291.398347503" watchObservedRunningTime="2026-07-23 14:57:26.377390223 +0000 UTC m=+291.399079468" Jul 23 14:57:26.438952 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.438919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" Jul 23 14:57:26.468729 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.468700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" Jul 23 14:57:26.515675 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.515372 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:26.594679 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.594653 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d"] Jul 23 14:57:26.597693 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.597663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:26.625279 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.625240 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2nr5t"] Jul 23 14:57:26.714835 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.714804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:26.750141 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:26.750112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1dbe4f6_e97f_4348_8778_6ee2cd60ccd0.slice/crio-eed88484baedb52fd90efcf8dd8e6ae8decf45e0dca1de27f16e01b4ce9bbd8f WatchSource:0}: Error finding container eed88484baedb52fd90efcf8dd8e6ae8decf45e0dca1de27f16e01b4ce9bbd8f: Status 404 returned error can't find the container with id eed88484baedb52fd90efcf8dd8e6ae8decf45e0dca1de27f16e01b4ce9bbd8f Jul 23 14:57:26.750733 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:26.750630 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd899a705_2aa3_428d_a185_493dec1b469e.slice/crio-76697e32df18c04d554268d981615ada865ec80eef9e8448dad19e4644ad4bee WatchSource:0}: Error finding container 76697e32df18c04d554268d981615ada865ec80eef9e8448dad19e4644ad4bee: Status 404 returned error can't find the container with id 76697e32df18c04d554268d981615ada865ec80eef9e8448dad19e4644ad4bee Jul 23 14:57:26.815130 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:26.815101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:27.363338 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.363301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" event={"ID":"d899a705-2aa3-428d-a185-493dec1b469e","Type":"ContainerStarted","Data":"76697e32df18c04d554268d981615ada865ec80eef9e8448dad19e4644ad4bee"} Jul 23 14:57:27.364927 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.364903 2576 generic.go:356] "Generic (PLEG): container finished" podID="54012de9-6535-48db-8650-e2b25b055226" containerID="de198596c15531efc32c9768c45770e03c14f6131d38d732e961cfe7d111a86b" exitCode=0 Jul 23 14:57:27.365030 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.365000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcj8f" event={"ID":"54012de9-6535-48db-8650-e2b25b055226","Type":"ContainerDied","Data":"de198596c15531efc32c9768c45770e03c14f6131d38d732e961cfe7d111a86b"} Jul 23 14:57:27.367044 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.367016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" event={"ID":"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0","Type":"ContainerStarted","Data":"0d319c6d5be4f14afd499d0f0f3b4a22960bf7374a76becf2deff0348d4b320b"} Jul 23 14:57:27.367162 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.367065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" event={"ID":"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0","Type":"ContainerStarted","Data":"cac3c71d759991e5af267f89653362f00e5749357b4fb56dfcb68e2a72111977"} Jul 23 14:57:27.367162 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.367086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" event={"ID":"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0","Type":"ContainerStarted","Data":"eed88484baedb52fd90efcf8dd8e6ae8decf45e0dca1de27f16e01b4ce9bbd8f"} Jul 23 14:57:27.523690 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.523643 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n"] Jul 23 14:57:27.531662 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.531634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.535351 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 14:57:27.535599 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8cn8s04t5sv7m\"" Jul 23 14:57:27.535679 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535614 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 14:57:27.535735 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535687 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 14:57:27.535735 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 14:57:27.535806 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mm4df\"" Jul 23 14:57:27.535839 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.535818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 14:57:27.539717 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.539463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n"] Jul 23 14:57:27.549125 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-grpc-tls\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549239 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsvzc\" (UniqueName: \"kubernetes.io/projected/b054302b-7f02-4e82-8001-72db0865b4c3-kube-api-access-wsvzc\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549239 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549350 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549350 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-tls\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549350 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549489 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.549489 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.549396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b054302b-7f02-4e82-8001-72db0865b4c3-metrics-client-ca\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.650682 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.650836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.650836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-tls\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.650836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.650836 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.651132 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b054302b-7f02-4e82-8001-72db0865b4c3-metrics-client-ca\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.651132 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-grpc-tls\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.651132 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.650965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsvzc\" (UniqueName: \"kubernetes.io/projected/b054302b-7f02-4e82-8001-72db0865b4c3-kube-api-access-wsvzc\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.651897 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.651754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b054302b-7f02-4e82-8001-72db0865b4c3-metrics-client-ca\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.654287 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.654263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-tls\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.654667 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.654629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.655229 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.655191 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.655648 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.655624 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.655915 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.655887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-grpc-tls\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.656036 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.656014 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b054302b-7f02-4e82-8001-72db0865b4c3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.660166 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.660080 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsvzc\" (UniqueName: \"kubernetes.io/projected/b054302b-7f02-4e82-8001-72db0865b4c3-kube-api-access-wsvzc\") pod \"thanos-querier-66fdccd5bc-6mp4n\" (UID: \"b054302b-7f02-4e82-8001-72db0865b4c3\") " pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:27.844812 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:27.844784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:28.317476 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.317377 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n"] Jul 23 14:57:28.322590 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:57:28.322564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb054302b_7f02_4e82_8001_72db0865b4c3.slice/crio-0933060f30f53c7ae76b4bdd57ff9eeee04650c2f8b499341c180ba0b175c4f5 WatchSource:0}: Error finding container 0933060f30f53c7ae76b4bdd57ff9eeee04650c2f8b499341c180ba0b175c4f5: Status 404 returned error can't find the container with id 0933060f30f53c7ae76b4bdd57ff9eeee04650c2f8b499341c180ba0b175c4f5 Jul 23 14:57:28.375087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.375050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" event={"ID":"d899a705-2aa3-428d-a185-493dec1b469e","Type":"ContainerStarted","Data":"962fd6f10bb315dc573586f9ec4404ce6d604b2191c196ecff1e7630a4c46be8"} Jul 23 14:57:28.375488 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.375132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" event={"ID":"d899a705-2aa3-428d-a185-493dec1b469e","Type":"ContainerStarted","Data":"c884c7643032c9c60a690ff5bd07b177c383dbd1cc6e39ee4276ab58d10b72c6"} Jul 23 14:57:28.377411 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.377385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcj8f" event={"ID":"54012de9-6535-48db-8650-e2b25b055226","Type":"ContainerStarted","Data":"2a0692f872b032bc9240f1d901f1cd32e899242755370fbf0da79b4c7116d157"} Jul 23 14:57:28.377557 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.377424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcj8f" event={"ID":"54012de9-6535-48db-8650-e2b25b055226","Type":"ContainerStarted","Data":"05736d6b8863f38f5c0d3eb2f288c7024d9eba221aad4cb150b598f0e961eafe"} Jul 23 14:57:28.379396 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.379334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"0933060f30f53c7ae76b4bdd57ff9eeee04650c2f8b499341c180ba0b175c4f5"} Jul 23 14:57:28.381375 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.381309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" event={"ID":"c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0","Type":"ContainerStarted","Data":"8456e5b4bcb1a18c55ac3f50e2e26de3295a5400e463825c076641dd49e17a53"} Jul 23 14:57:28.396691 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.396635 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zcj8f" podStartSLOduration=2.383959222 podStartE2EDuration="3.396619165s" totalImagesPullingTime="942.487059ms" totalInitContainerRuntime="70.172884ms" isStatefulPod=true podCreationTimestamp="2026-07-23 14:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:28.39590562 +0000 UTC m=+293.417594868" watchObservedRunningTime="2026-07-23 14:57:28.396619165 +0000 UTC m=+293.418308410" Jul 23 14:57:28.416514 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.416418 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cc97d" podStartSLOduration=2.103331279 podStartE2EDuration="3.416397747s" totalImagesPullingTime="1.313066468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:28.415982982 +0000 UTC m=+293.437672228" watchObservedRunningTime="2026-07-23 14:57:28.416397747 +0000 UTC m=+293.438086993" Jul 23 14:57:28.442189 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.442116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:28.543155 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.543124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:28.654755 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:28.654726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:29.387123 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:29.387093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" event={"ID":"d899a705-2aa3-428d-a185-493dec1b469e","Type":"ContainerStarted","Data":"9b4ad0f9044e11a8f0e983aee9233fb8a2a573641728ee9650f8d16c70933977"} Jul 23 14:57:29.409499 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:29.409446 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2nr5t" podStartSLOduration=2.988060919 podStartE2EDuration="4.40943131s" totalImagesPullingTime="1.421370391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:29.406996938 +0000 UTC m=+294.428686373" watchObservedRunningTime="2026-07-23 14:57:29.40943131 +0000 UTC m=+294.431120585" Jul 23 14:57:29.875965 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:29.875920 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" podUID="b96b4752-0a71-4cf9-8a17-d9ac75d8d917" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 23 14:57:30.296580 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:30.296544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:30.370210 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:30.370185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:30.417921 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:57:30.417866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z4b8d" podUID="b2e85229-b5e7-41ba-a710-969494798b89" Jul 23 14:57:30.971026 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:30.971002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:31.041440 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:31.041407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:31.396073 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:31.396042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"9db41ec8ba0351e940949c758158223d6a9ee30ac224852933dd5731610d738c"} Jul 23 14:57:31.396237 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:31.396140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"01fbe176c7d9c4095952b46137e3bc6a3bf41257031832e02b298f5691c198a2"} Jul 23 14:57:31.396237 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:31.396177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"ad0c43e8c0e6e598584c1c56d6819188564519e69f8601820f1281b6ffe5241e"} Jul 23 14:57:31.722644 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:31.722567 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:32.131998 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:32.131967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:32.232450 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:32.232421 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:33.061869 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.061836 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:33.062295 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.061950 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:57:33.063241 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.063219 2576 patch_prober.go:28] interesting pod/console-76995c9bfc-9vq72 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body= Jul 23 14:57:33.063358 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.063256 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76995c9bfc-9vq72" podUID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" containerName="console" probeResult="failure" output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" Jul 23 14:57:33.349790 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.349722 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ppnjm" Jul 23 14:57:33.405709 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.405668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"2084b287f05bcfdfa3b97e14a290ea20066ef73734a4e43d0d8ed30185704660"} Jul 23 14:57:33.405901 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.405726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"95c929e7bc20c6db0a74b9ef44fcbefdf11cf1389206e045bbe4c24d5648c917"} Jul 23 14:57:33.405901 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.405753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" event={"ID":"b054302b-7f02-4e82-8001-72db0865b4c3","Type":"ContainerStarted","Data":"12182c44b11c5148e296c886f6bbe9188e4cb52c86e507c0bdde4eca1caa5b4d"} Jul 23 14:57:33.405901 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.405819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:33.434035 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:33.433992 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" podStartSLOduration=2.723580987 podStartE2EDuration="6.433978043s" totalImagesPullingTime="3.710397056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:57:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:57:33.432054062 +0000 UTC m=+298.453743307" watchObservedRunningTime="2026-07-23 14:57:33.433978043 +0000 UTC m=+298.455667302" Jul 23 14:57:34.048236 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:34.048206 2576 patch_prober.go:28] interesting pod/image-registry-6bb5db57f7-gnwhz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 14:57:34.048446 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:34.048253 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" podUID="ea182948-84ac-4c85-8fd0-0f9c7ccc4888" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 14:57:35.309743 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:35.309717 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:57:35.310731 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:35.310713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 14:57:35.316487 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:35.316467 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 14:57:35.318361 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:35.318330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bb5db57f7-gnwhz" Jul 23 14:57:35.380586 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:35.380539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:36.815774 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:36.815726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:37.038722 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:37.038683 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76995c9bfc-9vq72"] Jul 23 14:57:39.415672 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:39.415644 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66fdccd5bc-6mp4n" Jul 23 14:57:39.876865 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:39.876830 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" podUID="b96b4752-0a71-4cf9-8a17-d9ac75d8d917" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 23 14:57:41.440824 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:41.440787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:41.540163 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:41.540124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:41.641386 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:41.641357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:42.418051 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:42.418022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:57:45.637672 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:45.637636 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:45.738587 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:45.738556 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:45.980180 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:45.980075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:46.036420 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:46.036393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:46.191599 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:46.191572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:47.579927 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:47.579899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:47.684562 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:47.684534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:47.783910 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:47.783859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:49.876441 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:49.876406 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" podUID="b96b4752-0a71-4cf9-8a17-d9ac75d8d917" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 23 14:57:49.876844 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:49.876758 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" Jul 23 14:57:49.880802 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:49.877658 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e16a62229c1a7faa65b52cf18348e3fd223c92ac6b4fe33d6caaeed0d9f046f0"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 23 14:57:49.880802 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:49.877752 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" podUID="b96b4752-0a71-4cf9-8a17-d9ac75d8d917" containerName="service-proxy" containerID="cri-o://e16a62229c1a7faa65b52cf18348e3fd223c92ac6b4fe33d6caaeed0d9f046f0" gracePeriod=30 Jul 23 14:57:50.467973 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:50.467942 2576 generic.go:356] "Generic (PLEG): container finished" podID="b96b4752-0a71-4cf9-8a17-d9ac75d8d917" containerID="e16a62229c1a7faa65b52cf18348e3fd223c92ac6b4fe33d6caaeed0d9f046f0" exitCode=2 Jul 23 14:57:50.468155 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:50.468000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" event={"ID":"b96b4752-0a71-4cf9-8a17-d9ac75d8d917","Type":"ContainerDied","Data":"e16a62229c1a7faa65b52cf18348e3fd223c92ac6b4fe33d6caaeed0d9f046f0"} Jul 23 14:57:50.468155 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:50.468042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-798ff7d7bf-2hsgh" event={"ID":"b96b4752-0a71-4cf9-8a17-d9ac75d8d917","Type":"ContainerStarted","Data":"c909f3c4fda33700d3cabdfa4b1b2ddf01fa52274d54da27aca933a7790b6cf6"} Jul 23 14:57:54.714977 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:54.714931 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:54.768986 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:54.768948 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:58.585111 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:58.585075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:58.640764 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:58.640734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:59.486576 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:59.486540 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:57:59.557658 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:57:59.557632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:02.059364 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.059327 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76995c9bfc-9vq72" podUID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" containerName="console" containerID="cri-o://02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4" gracePeriod=15 Jul 23 14:58:02.294837 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.294817 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:58:02.422553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422477 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-trusted-ca-bundle\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.422553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422522 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-oauth-serving-cert\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.422553 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422545 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znh84\" (UniqueName: \"kubernetes.io/projected/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-kube-api-access-znh84\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.422857 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422576 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-service-ca\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.422857 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422627 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-oauth-config\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.422857 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422654 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-config\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.422857 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.422678 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-serving-cert\") pod \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\" (UID: \"66e05e19-bb98-4819-80e2-3fb9c9d9cfce\") " Jul 23 14:58:02.423376 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.423245 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:58:02.423376 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.423331 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:58:02.423557 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.423391 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-config" (OuterVolumeSpecName: "console-config") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:58:02.423804 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.423744 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-service-ca" (OuterVolumeSpecName: "service-ca") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:58:02.426032 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.425991 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:58:02.426032 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.426008 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-kube-api-access-znh84" (OuterVolumeSpecName: "kube-api-access-znh84") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "kube-api-access-znh84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:58:02.428649 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.427955 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66e05e19-bb98-4819-80e2-3fb9c9d9cfce" (UID: "66e05e19-bb98-4819-80e2-3fb9c9d9cfce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:58:02.512333 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.512308 2576 generic.go:356] "Generic (PLEG): container finished" podID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" containerID="02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4" exitCode=0 Jul 23 14:58:02.512437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.512362 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995c9bfc-9vq72" Jul 23 14:58:02.512437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.512374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995c9bfc-9vq72" event={"ID":"66e05e19-bb98-4819-80e2-3fb9c9d9cfce","Type":"ContainerDied","Data":"02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4"} Jul 23 14:58:02.512437 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.512435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995c9bfc-9vq72" event={"ID":"66e05e19-bb98-4819-80e2-3fb9c9d9cfce","Type":"ContainerDied","Data":"a0ba475fb00617d0b3f47892df6d9f28ff9d73d582783f07eb40322e5d0de02a"} Jul 23 14:58:02.512555 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.512454 2576 scope.go:117] "RemoveContainer" containerID="02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4" Jul 23 14:58:02.521601 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.521579 2576 scope.go:117] "RemoveContainer" containerID="02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4" Jul 23 14:58:02.521844 ip-10-0-143-139 kubenswrapper[2576]: E0723 14:58:02.521825 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4\": container with ID starting with 02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4 not found: ID does not exist" containerID="02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4" Jul 23 14:58:02.521933 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.521850 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4"} err="failed to get container status \"02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4\": rpc error: code = NotFound desc = could not find container \"02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4\": container with ID starting with 02922134d9ad23d1dd0e962ef6aabc4dc397ab1c307509d78fb6e236a94d53f4 not found: ID does not exist" Jul 23 14:58:02.524128 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524110 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znh84\" (UniqueName: \"kubernetes.io/projected/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-kube-api-access-znh84\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.524191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524132 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-service-ca\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.524191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524141 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-oauth-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.524191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524150 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.524191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524157 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-console-serving-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.524191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524165 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-trusted-ca-bundle\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.524191 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.524173 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e05e19-bb98-4819-80e2-3fb9c9d9cfce-oauth-serving-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 14:58:02.532502 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.532479 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76995c9bfc-9vq72"] Jul 23 14:58:02.536452 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:02.536429 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76995c9bfc-9vq72"] Jul 23 14:58:03.421711 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:03.421682 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" path="/var/lib/kubelet/pods/66e05e19-bb98-4819-80e2-3fb9c9d9cfce/volumes" Jul 23 14:58:13.591705 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:13.591675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:13.653299 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:13.653267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:18.323800 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:18.323755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:18.484028 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:18.484001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:22.704783 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:22.704728 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:24.003480 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:24.003428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:24.059828 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:24.059770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:41.589107 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:41.589071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:41.652757 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:41.652729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:46.703970 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:46.703919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:46.757747 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:46.757718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:46.833087 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:46.833052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:46.932829 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:46.932804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:47.536114 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:47.536083 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:47.598077 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:47.598022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:48.827049 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:48.827019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:48.927448 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:48.927416 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:49.355956 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:49.355922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:58:49.358274 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:49.358254 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e85229-b5e7-41ba-a710-969494798b89-metrics-certs\") pod \"network-metrics-daemon-z4b8d\" (UID: \"b2e85229-b5e7-41ba-a710-969494798b89\") " pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:58:49.622451 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:49.622375 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brw86\"" Jul 23 14:58:49.629923 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:49.629904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4b8d" Jul 23 14:58:49.754263 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:49.754234 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z4b8d"] Jul 23 14:58:49.757610 ip-10-0-143-139 kubenswrapper[2576]: W0723 14:58:49.757580 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e85229_b5e7_41ba_a710_969494798b89.slice/crio-b892a190bd0385410b357fe6b96dd18a4a08d188585cc78cd767297f51d166b3 WatchSource:0}: Error finding container b892a190bd0385410b357fe6b96dd18a4a08d188585cc78cd767297f51d166b3: Status 404 returned error can't find the container with id b892a190bd0385410b357fe6b96dd18a4a08d188585cc78cd767297f51d166b3 Jul 23 14:58:49.759928 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:49.759908 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 14:58:50.676947 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:50.676906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4b8d" event={"ID":"b2e85229-b5e7-41ba-a710-969494798b89","Type":"ContainerStarted","Data":"b892a190bd0385410b357fe6b96dd18a4a08d188585cc78cd767297f51d166b3"} Jul 23 14:58:51.682837 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:51.682802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4b8d" event={"ID":"b2e85229-b5e7-41ba-a710-969494798b89","Type":"ContainerStarted","Data":"1f341a0697bfead3df08c4270cd62569b994d0cbc7f4ac5c9e7f280850e08ad0"} Jul 23 14:58:51.683320 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:51.682860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4b8d" event={"ID":"b2e85229-b5e7-41ba-a710-969494798b89","Type":"ContainerStarted","Data":"c9650f842e01144a035328fbda7ab4c8a0611d039d07733a98ae3e8b49ff2f9e"} Jul 23 14:58:51.700258 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:51.700212 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z4b8d" podStartSLOduration=374.576295257 podStartE2EDuration="6m15.700197454s" totalImagesPullingTime="1.123902197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:58:51.699530763 +0000 UTC m=+376.721220008" watchObservedRunningTime="2026-07-23 14:58:51.700197454 +0000 UTC m=+376.721886699" Jul 23 14:58:51.796065 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:51.796031 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:51.853974 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:51.853951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:51.912941 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:51.912917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:53.515649 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:53.515620 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:53.599399 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:53.599366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:54.541892 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:54.541847 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:54.608517 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:54.608486 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:57.895711 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:57.895680 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:57.950993 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:57.950966 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:58.019923 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:58.019894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:58.587566 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:58.587536 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:58:58.688416 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:58:58.688386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:59:51.034725 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:59:51.034692 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:59:51.129295 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:59:51.129264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:59:54.160340 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:59:54.160305 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 14:59:54.249908 ip-10-0-143-139 kubenswrapper[2576]: I0723 14:59:54.249858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:12.836513 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:12.836483 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:18.004513 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:18.004482 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:18.842762 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:18.842729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:21.813435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:21.813397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:21.880448 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:21.880419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:23.568629 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:23.568596 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:23.686107 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:23.686077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:23.928696 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:23.928617 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:24.210317 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:24.210233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:26.238082 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:26.238041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:27.229427 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:27.229390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:33.862140 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:33.862108 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:35.916944 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:35.916913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:36.189342 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:36.189268 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:37.194286 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.191467 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4"] Jul 23 15:00:37.194286 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.192062 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" containerName="console" Jul 23 15:00:37.194286 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.192084 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" containerName="console" Jul 23 15:00:37.194286 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.192249 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e05e19-bb98-4819-80e2-3fb9c9d9cfce" containerName="console" Jul 23 15:00:37.195801 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.195775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.203656 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.203639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 15:00:37.203894 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.203865 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:00:37.205474 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.205455 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9dhc8\"" Jul 23 15:00:37.211539 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.211516 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4"] Jul 23 15:00:37.242338 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.242309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qmqr\" (UniqueName: \"kubernetes.io/projected/9ea67747-297b-402b-82cb-e46c4d98706d-kube-api-access-6qmqr\") pod \"openshift-lws-operator-fd8ccff4c-mgqr4\" (UID: \"9ea67747-297b-402b-82cb-e46c4d98706d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.242456 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.242345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ea67747-297b-402b-82cb-e46c4d98706d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mgqr4\" (UID: \"9ea67747-297b-402b-82cb-e46c4d98706d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.343751 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.343714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qmqr\" (UniqueName: \"kubernetes.io/projected/9ea67747-297b-402b-82cb-e46c4d98706d-kube-api-access-6qmqr\") pod \"openshift-lws-operator-fd8ccff4c-mgqr4\" (UID: \"9ea67747-297b-402b-82cb-e46c4d98706d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.343978 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.343769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ea67747-297b-402b-82cb-e46c4d98706d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mgqr4\" (UID: \"9ea67747-297b-402b-82cb-e46c4d98706d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.344151 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.344130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ea67747-297b-402b-82cb-e46c4d98706d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mgqr4\" (UID: \"9ea67747-297b-402b-82cb-e46c4d98706d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.355153 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.355127 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qmqr\" (UniqueName: \"kubernetes.io/projected/9ea67747-297b-402b-82cb-e46c4d98706d-kube-api-access-6qmqr\") pod \"openshift-lws-operator-fd8ccff4c-mgqr4\" (UID: \"9ea67747-297b-402b-82cb-e46c4d98706d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.504846 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.504730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" Jul 23 15:00:37.649719 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:37.649668 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4"] Jul 23 15:00:37.652463 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:00:37.652433 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ea67747_297b_402b_82cb_e46c4d98706d.slice/crio-93fdc0b52bda760ff2cc3ee1019cf0b5cc44e4d7ceb5929f4d8b7198c9a1d076 WatchSource:0}: Error finding container 93fdc0b52bda760ff2cc3ee1019cf0b5cc44e4d7ceb5929f4d8b7198c9a1d076: Status 404 returned error can't find the container with id 93fdc0b52bda760ff2cc3ee1019cf0b5cc44e4d7ceb5929f4d8b7198c9a1d076 Jul 23 15:00:38.048385 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:38.048348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" event={"ID":"9ea67747-297b-402b-82cb-e46c4d98706d","Type":"ContainerStarted","Data":"93fdc0b52bda760ff2cc3ee1019cf0b5cc44e4d7ceb5929f4d8b7198c9a1d076"} Jul 23 15:00:41.061079 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:41.061044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" event={"ID":"9ea67747-297b-402b-82cb-e46c4d98706d","Type":"ContainerStarted","Data":"0c8fbd1c67c43e80c82c20ceefe06a49f3b6073236d92daf0724f009bfe97701"} Jul 23 15:00:41.079775 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:41.079726 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mgqr4" podStartSLOduration=1.577600506 podStartE2EDuration="4.07971029s" totalImagesPullingTime="2.502109784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:41.078668883 +0000 UTC m=+486.100358128" watchObservedRunningTime="2026-07-23 15:00:41.07971029 +0000 UTC m=+486.101399534" Jul 23 15:00:41.861111 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:41.861079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:41.962655 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:41.962623 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:44.026849 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:44.026818 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:59.595342 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:59.595304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:00:59.788019 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:00:59.787986 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:12.512296 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.512264 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb"] Jul 23 15:01:12.515553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.515538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.518996 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.518976 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 15:01:12.520009 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.519989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 15:01:12.520344 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.520323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 15:01:12.520516 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.520498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 15:01:12.521939 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.521921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hqkq8\"" Jul 23 15:01:12.532588 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.532566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb"] Jul 23 15:01:12.604820 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.604791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f120a71-d344-49a4-b01a-4ef173654c2e-tmp\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.604974 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.604832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f120a71-d344-49a4-b01a-4ef173654c2e-manifests\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.604974 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.604856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f120a71-d344-49a4-b01a-4ef173654c2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.604974 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.604959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jdr\" (UniqueName: \"kubernetes.io/projected/3f120a71-d344-49a4-b01a-4ef173654c2e-kube-api-access-75jdr\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.605081 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.604995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f120a71-d344-49a4-b01a-4ef173654c2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.613070 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.613045 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9"] Jul 23 15:01:12.616169 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.616151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.619831 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.619797 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 15:01:12.619971 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.619929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ttqtl\"" Jul 23 15:01:12.619971 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.619929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 15:01:12.620101 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.620076 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 15:01:12.632688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.632661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9"] Jul 23 15:01:12.706171 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jdr\" (UniqueName: \"kubernetes.io/projected/3f120a71-d344-49a4-b01a-4ef173654c2e-kube-api-access-75jdr\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.706330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-cert\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.706330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f120a71-d344-49a4-b01a-4ef173654c2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.706330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-metrics-cert\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.706330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f120a71-d344-49a4-b01a-4ef173654c2e-tmp\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.706537 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f120a71-d344-49a4-b01a-4ef173654c2e-manifests\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.706537 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvcm6\" (UniqueName: \"kubernetes.io/projected/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-kube-api-access-cvcm6\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.706537 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f120a71-d344-49a4-b01a-4ef173654c2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.706537 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-manager-config\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.706743 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.706727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f120a71-d344-49a4-b01a-4ef173654c2e-manifests\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.708740 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.708715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f120a71-d344-49a4-b01a-4ef173654c2e-tmp\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.708846 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.708833 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f120a71-d344-49a4-b01a-4ef173654c2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.709049 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.709031 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f120a71-d344-49a4-b01a-4ef173654c2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.716786 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.716761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jdr\" (UniqueName: \"kubernetes.io/projected/3f120a71-d344-49a4-b01a-4ef173654c2e-kube-api-access-75jdr\") pod \"opendatahub-operator-controller-manager-56b97c94c-jgfcb\" (UID: \"3f120a71-d344-49a4-b01a-4ef173654c2e\") " pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.807590 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.807565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-cert\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.807703 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.807605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-metrics-cert\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.807703 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.807635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvcm6\" (UniqueName: \"kubernetes.io/projected/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-kube-api-access-cvcm6\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.807703 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.807654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-manager-config\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.808315 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.808295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-manager-config\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.810273 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.810251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-cert\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.810355 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.810317 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-metrics-cert\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.825840 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.825819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:12.826187 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.826171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvcm6\" (UniqueName: \"kubernetes.io/projected/5c34b7d1-c9f2-4b81-abd9-d0317796fbac-kube-api-access-cvcm6\") pod \"lws-controller-manager-5857c6d56c-5qgk9\" (UID: \"5c34b7d1-c9f2-4b81-abd9-d0317796fbac\") " pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.925661 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.925603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:12.966125 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:12.966099 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb"] Jul 23 15:01:12.969043 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:01:12.969010 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f120a71_d344_49a4_b01a_4ef173654c2e.slice/crio-26d14f7caa6f33b5f4edd782434755c2a902c4196b81bac6ee37d455035787ca WatchSource:0}: Error finding container 26d14f7caa6f33b5f4edd782434755c2a902c4196b81bac6ee37d455035787ca: Status 404 returned error can't find the container with id 26d14f7caa6f33b5f4edd782434755c2a902c4196b81bac6ee37d455035787ca Jul 23 15:01:13.075507 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:13.075398 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9"] Jul 23 15:01:13.078080 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:01:13.078055 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c34b7d1_c9f2_4b81_abd9_d0317796fbac.slice/crio-8faa4f397bc437ca895e9691cd577ff4fb22fb444d441117507d590106deb836 WatchSource:0}: Error finding container 8faa4f397bc437ca895e9691cd577ff4fb22fb444d441117507d590106deb836: Status 404 returned error can't find the container with id 8faa4f397bc437ca895e9691cd577ff4fb22fb444d441117507d590106deb836 Jul 23 15:01:13.110538 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:13.110503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:13.174899 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:13.174852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" event={"ID":"3f120a71-d344-49a4-b01a-4ef173654c2e","Type":"ContainerStarted","Data":"26d14f7caa6f33b5f4edd782434755c2a902c4196b81bac6ee37d455035787ca"} Jul 23 15:01:13.175900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:13.175852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" event={"ID":"5c34b7d1-c9f2-4b81-abd9-d0317796fbac","Type":"ContainerStarted","Data":"8faa4f397bc437ca895e9691cd577ff4fb22fb444d441117507d590106deb836"} Jul 23 15:01:13.209789 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:13.209763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:13.337005 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:13.336866 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:15.185615 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:15.185579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" event={"ID":"5c34b7d1-c9f2-4b81-abd9-d0317796fbac","Type":"ContainerStarted","Data":"aa711a75d6f63af81256bd1a40d4aa0e1b31d2490468f08247e1320a1c823c5e"} Jul 23 15:01:15.186046 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:15.185727 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:15.211785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:15.211734 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" podStartSLOduration=1.275477642 podStartE2EDuration="3.211718362s" totalImagesPullingTime="1.93624072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:15.211009898 +0000 UTC m=+520.232699143" watchObservedRunningTime="2026-07-23 15:01:15.211718362 +0000 UTC m=+520.233407585" Jul 23 15:01:18.201047 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:18.201011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" event={"ID":"3f120a71-d344-49a4-b01a-4ef173654c2e","Type":"ContainerStarted","Data":"595e4eff95256e9822f9b19006edb8b9a8debb3a1eeb434ae8ba0573adf98a74"} Jul 23 15:01:19.207053 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:19.207016 2576 generic.go:356] "Generic (PLEG): container finished" podID="3f120a71-d344-49a4-b01a-4ef173654c2e" containerID="595e4eff95256e9822f9b19006edb8b9a8debb3a1eeb434ae8ba0573adf98a74" exitCode=0 Jul 23 15:01:19.207416 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:19.207099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" event={"ID":"3f120a71-d344-49a4-b01a-4ef173654c2e","Type":"ContainerDied","Data":"595e4eff95256e9822f9b19006edb8b9a8debb3a1eeb434ae8ba0573adf98a74"} Jul 23 15:01:20.213396 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:20.213357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" event={"ID":"3f120a71-d344-49a4-b01a-4ef173654c2e","Type":"ContainerStarted","Data":"0bd46a71760309fa249e0f438f75636dfbb82a46822cbc895179254486220c14"} Jul 23 15:01:20.213772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:20.213494 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:20.239071 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:20.239021 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" podStartSLOduration=1.85474236 podStartE2EDuration="8.239005266s" totalImagesPullingTime="5.342179761s" totalInitContainerRuntime="1.042083145s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:20.237153073 +0000 UTC m=+525.258842318" watchObservedRunningTime="2026-07-23 15:01:20.239005266 +0000 UTC m=+525.260694511" Jul 23 15:01:23.389387 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:23.389351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:23.448927 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:23.448892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:26.194315 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:26.194284 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5857c6d56c-5qgk9" Jul 23 15:01:29.400408 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:29.400375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:29.498388 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:29.498353 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:31.219645 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:31.219613 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56b97c94c-jgfcb" Jul 23 15:01:33.107456 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:33.107429 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:33.260479 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:33.260451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:33.697076 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:33.697043 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:33.821115 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:33.821081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:34.036571 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:34.036544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:34.178951 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:34.178919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:34.244939 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:34.244908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:34.536563 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:34.536522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:34.890155 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:34.890084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:35.175007 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:35.174936 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:35.259597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:35.259568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:35.362593 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:35.362564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:38.982964 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:38.982927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:41.309154 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.309127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:41.417066 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.417035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:41.577604 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.577526 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p"] Jul 23 15:01:41.582132 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.582111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.585864 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.585839 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lh2rf\"" Jul 23 15:01:41.586005 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.585931 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 15:01:41.586005 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.585931 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 15:01:41.586942 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.586926 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 15:01:41.597891 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.597852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p"] Jul 23 15:01:41.625656 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.625622 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:41.644103 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644503 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644503 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c506dc08-3bc6-48c1-8672-b3172ee455b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644503 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.644673 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.644509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b4lz\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-kube-api-access-5b4lz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.655732 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.655699 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2"] Jul 23 15:01:41.658960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.658943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.672515 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.672490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2"] Jul 23 15:01:41.745735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.745735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768b4776-d08d-4931-8c69-0f5fb55144e4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.745987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.745987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p659z\" (UniqueName: \"kubernetes.io/projected/768b4776-d08d-4931-8c69-0f5fb55144e4-kube-api-access-p659z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.745987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.745987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c506dc08-3bc6-48c1-8672-b3172ee455b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.745987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.745965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b4lz\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-kube-api-access-5b4lz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.746232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.746553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.746553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.746553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746844 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746569 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746844 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746678 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c506dc08-3bc6-48c1-8672-b3172ee455b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.746844 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.746751 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.748593 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.748572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.748786 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.748768 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.755269 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.755245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.755460 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.755438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b4lz\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-kube-api-access-5b4lz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.848008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.847916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.847951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768b4776-d08d-4931-8c69-0f5fb55144e4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.847974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.847998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p659z\" (UniqueName: \"kubernetes.io/projected/768b4776-d08d-4931-8c69-0f5fb55144e4-kube-api-access-p659z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848335 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848335 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848335 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848335 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848335 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848560 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848560 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848560 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848512 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848711 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848569 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.848792 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.848773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768b4776-d08d-4931-8c69-0f5fb55144e4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.850795 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.850775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.850903 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.850829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.859945 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.859914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768b4776-d08d-4931-8c69-0f5fb55144e4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.860105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.860083 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p659z\" (UniqueName: \"kubernetes.io/projected/768b4776-d08d-4931-8c69-0f5fb55144e4-kube-api-access-p659z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xckq2\" (UID: \"768b4776-d08d-4931-8c69-0f5fb55144e4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.866639 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.866615 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:41.893070 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.893042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:41.968559 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.968531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:41.997166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:41.997093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:42.053011 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.052988 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p"] Jul 23 15:01:42.055747 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:01:42.055712 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc506dc08_3bc6_48c1_8672_b3172ee455b4.slice/crio-f357b2a4c93d74dea48461b951eaf0ffa1a8cac66ec06e9bf9d7a991f0e73006 WatchSource:0}: Error finding container f357b2a4c93d74dea48461b951eaf0ffa1a8cac66ec06e9bf9d7a991f0e73006: Status 404 returned error can't find the container with id f357b2a4c93d74dea48461b951eaf0ffa1a8cac66ec06e9bf9d7a991f0e73006 Jul 23 15:01:42.117182 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.117133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2"] Jul 23 15:01:42.119562 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:01:42.119534 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768b4776_d08d_4931_8c69_0f5fb55144e4.slice/crio-79fc7ae28518f4b281e0a6a63d3c7bd04bb4342ab20ce33717e342dc6f015517 WatchSource:0}: Error finding container 79fc7ae28518f4b281e0a6a63d3c7bd04bb4342ab20ce33717e342dc6f015517: Status 404 returned error can't find the container with id 79fc7ae28518f4b281e0a6a63d3c7bd04bb4342ab20ce33717e342dc6f015517 Jul 23 15:01:42.303038 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.302999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" event={"ID":"c506dc08-3bc6-48c1-8672-b3172ee455b4","Type":"ContainerStarted","Data":"f357b2a4c93d74dea48461b951eaf0ffa1a8cac66ec06e9bf9d7a991f0e73006"} Jul 23 15:01:42.304070 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.304050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" event={"ID":"768b4776-d08d-4931-8c69-0f5fb55144e4","Type":"ContainerStarted","Data":"79fc7ae28518f4b281e0a6a63d3c7bd04bb4342ab20ce33717e342dc6f015517"} Jul 23 15:01:42.678293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.678259 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84"] Jul 23 15:01:42.682738 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.682705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.688953 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.688925 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 23 15:01:42.689114 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.688926 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 23 15:01:42.689184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.689127 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 23 15:01:42.689252 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.689237 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4fmfc\"" Jul 23 15:01:42.694606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.694571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84"] Jul 23 15:01:42.754186 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5m2b\" (UniqueName: \"kubernetes.io/projected/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-kube-api-access-m5m2b\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.754186 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.754370 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.754370 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.754370 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.754370 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.754370 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.754356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.855755 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.855718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.855958 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.855806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5m2b\" (UniqueName: \"kubernetes.io/projected/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-kube-api-access-m5m2b\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.855958 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.855835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.855958 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.855895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.855958 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.855954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.856164 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.855988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.856164 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.856015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.857246 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.857188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.858923 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.858852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.858923 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.858902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.859222 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.859183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.859646 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.859608 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.865202 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.865158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.865361 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.865207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5m2b\" (UniqueName: \"kubernetes.io/projected/0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1-kube-api-access-m5m2b\") pod \"istiod-openshift-gateway-94bb8fbfd-7wh84\" (UID: \"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:42.992597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:42.992521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:43.310040 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:43.309991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84"] Jul 23 15:01:43.314122 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:01:43.314024 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0285d0d1_90b0_4cd2_8a6e_d69b8d9957c1.slice/crio-1a1f054177ede1587d11ee17a79890390b7c3ec02f2f46b7fd1c5d4c973930db WatchSource:0}: Error finding container 1a1f054177ede1587d11ee17a79890390b7c3ec02f2f46b7fd1c5d4c973930db: Status 404 returned error can't find the container with id 1a1f054177ede1587d11ee17a79890390b7c3ec02f2f46b7fd1c5d4c973930db Jul 23 15:01:44.316519 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:44.316468 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" event={"ID":"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1","Type":"ContainerStarted","Data":"1a1f054177ede1587d11ee17a79890390b7c3ec02f2f46b7fd1c5d4c973930db"} Jul 23 15:01:45.757606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:45.757569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:45.967188 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:45.967154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:46.031124 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.031084 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.031252 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.031171 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.031499 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.031468 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.031567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.031543 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.031623 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.031586 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.032313 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.032290 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.032384 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.032348 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.032384 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.032380 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:01:46.082701 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.082669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:46.298185 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.298103 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:46.329729 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.329688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" event={"ID":"0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1","Type":"ContainerStarted","Data":"aa5fab5ce3cfa34ed3afe12ff5c9857904e1e1e7bb4f8fc188b4eb83825a09db"} Jul 23 15:01:46.330514 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.330488 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:46.332650 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.332620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" event={"ID":"c506dc08-3bc6-48c1-8672-b3172ee455b4","Type":"ContainerStarted","Data":"fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d"} Jul 23 15:01:46.335249 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.335227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" event={"ID":"768b4776-d08d-4931-8c69-0f5fb55144e4","Type":"ContainerStarted","Data":"b8239d5366ad0c792a5ba6b359f2755ac8bf958845b062a4302e3cce52730c37"} Jul 23 15:01:46.371201 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.371132 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" podStartSLOduration=1.658608654 podStartE2EDuration="4.371109414s" totalImagesPullingTime="2.71250076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:46.367960299 +0000 UTC m=+551.389649545" watchObservedRunningTime="2026-07-23 15:01:46.371109414 +0000 UTC m=+551.392798660" Jul 23 15:01:46.401526 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.401473 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" podStartSLOduration=1.427116299 podStartE2EDuration="5.401451557s" totalImagesPullingTime="3.974335258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:46.398414131 +0000 UTC m=+551.420103378" watchObservedRunningTime="2026-07-23 15:01:46.401451557 +0000 UTC m=+551.423140806" Jul 23 15:01:46.436537 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.436502 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:01:46.442777 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.442724 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" podStartSLOduration=1.533172647 podStartE2EDuration="5.442703364s" totalImagesPullingTime="3.909530717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:46.442472269 +0000 UTC m=+551.464161516" watchObservedRunningTime="2026-07-23 15:01:46.442703364 +0000 UTC m=+551.464392614" Jul 23 15:01:46.893411 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.893378 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:46.969736 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:46.969696 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:47.343010 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:47.342984 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wh84" Jul 23 15:01:47.894860 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:47.894825 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Jul 23 15:01:47.895249 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:47.894899 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Jul 23 15:01:47.973772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:47.973744 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:48.346292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:48.346261 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:48.347112 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:48.347094 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xckq2" Jul 23 15:01:48.398428 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:48.398391 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p"] Jul 23 15:01:48.893858 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:48.893826 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Jul 23 15:01:48.894043 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:48.893912 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Jul 23 15:01:49.350413 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:49.350372 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerName="istio-proxy" containerID="cri-o://fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d" gracePeriod=30 Jul 23 15:01:54.595600 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.595574 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:54.664694 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-certs\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664694 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664648 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-credential-socket\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664701 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-podinfo\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664732 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-data\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664753 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-token\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664768 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b4lz\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-kube-api-access-5b4lz\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664786 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-socket\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664828 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c506dc08-3bc6-48c1-8672-b3172ee455b4-istiod-ca-cert\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664894 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-envoy\") pod \"c506dc08-3bc6-48c1-8672-b3172ee455b4\" (UID: \"c506dc08-3bc6-48c1-8672-b3172ee455b4\") " Jul 23 15:01:54.664929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.664896 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:01:54.665293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.665103 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.665293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.665104 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:01:54.665293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.665103 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:01:54.665293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.665115 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:01:54.665484 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.665413 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c506dc08-3bc6-48c1-8672-b3172ee455b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:01:54.667187 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.667160 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:01:54.667302 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.667254 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:01:54.667346 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.667303 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:01:54.667346 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.667298 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-kube-api-access-5b4lz" (OuterVolumeSpecName: "kube-api-access-5b4lz") pod "c506dc08-3bc6-48c1-8672-b3172ee455b4" (UID: "c506dc08-3bc6-48c1-8672-b3172ee455b4"). InnerVolumeSpecName "kube-api-access-5b4lz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:01:54.766118 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766084 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766118 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766110 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c506dc08-3bc6-48c1-8672-b3172ee455b4-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766118 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766120 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766128 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766138 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766146 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766153 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:54.766340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:54.766162 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b4lz\" (UniqueName: \"kubernetes.io/projected/c506dc08-3bc6-48c1-8672-b3172ee455b4-kube-api-access-5b4lz\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:01:55.376328 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.376292 2576 generic.go:356] "Generic (PLEG): container finished" podID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerID="fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d" exitCode=0 Jul 23 15:01:55.376497 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.376339 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" Jul 23 15:01:55.376497 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.376377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" event={"ID":"c506dc08-3bc6-48c1-8672-b3172ee455b4","Type":"ContainerDied","Data":"fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d"} Jul 23 15:01:55.376497 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.376428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p" event={"ID":"c506dc08-3bc6-48c1-8672-b3172ee455b4","Type":"ContainerDied","Data":"f357b2a4c93d74dea48461b951eaf0ffa1a8cac66ec06e9bf9d7a991f0e73006"} Jul 23 15:01:55.376497 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.376450 2576 scope.go:117] "RemoveContainer" containerID="fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d" Jul 23 15:01:55.385453 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.385438 2576 scope.go:117] "RemoveContainer" containerID="fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d" Jul 23 15:01:55.385701 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:01:55.385682 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d\": container with ID starting with fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d not found: ID does not exist" containerID="fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d" Jul 23 15:01:55.385757 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.385716 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d"} err="failed to get container status \"fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d\": rpc error: code = NotFound desc = could not find container \"fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d\": container with ID starting with fa7640e7c64afd3b8d3fe61e3914423a85eaf99866f7a775c2a3a6c4cbc4897d not found: ID does not exist" Jul 23 15:01:55.399973 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.399950 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p"] Jul 23 15:01:55.404288 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.404266 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xcx5p"] Jul 23 15:01:55.422741 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:01:55.422718 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" path="/var/lib/kubelet/pods/c506dc08-3bc6-48c1-8672-b3172ee455b4/volumes" Jul 23 15:02:14.535746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:14.535699 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:02:32.654373 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:32.654341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:02:34.830415 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:34.830383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:02:34.930164 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:34.930128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:02:35.030274 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:35.030231 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:02:35.338381 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:35.338359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:02:35.338479 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:35.338365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:02:35.777063 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:35.777026 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:02:36.298156 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:02:36.298127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:09.395509 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:09.395474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:17.260125 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:17.260092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:18.544318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:18.544278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:19.287140 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:19.287108 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:22.348338 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:22.348277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:22.521609 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:22.521572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:24.950853 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:24.950822 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:26.800976 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:26.800941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:27.879685 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:27.879652 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:29.915169 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:29.915133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:33.050718 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:33.050688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:33.151843 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:33.151809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:35.225354 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:35.225292 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:35.464584 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:35.464546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:35.565356 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:35.565330 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:36.021090 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:36.021062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:36.121468 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:36.121438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:40.130182 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:40.130151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:40.230239 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:40.230205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:46.474603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:46.474563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:47.443956 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:47.443927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:50.758920 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:50.758867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:50.873547 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:50.873519 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:56.169936 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:56.169902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:56.271044 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:56.271016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:56.567409 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:56.567375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:03:56.784062 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:03:56.784028 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:00.169629 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:00.169597 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:00.369380 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:00.369350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:02.620245 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:02.620216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:06.153987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:06.153940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:06.254041 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:06.254004 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:09.506757 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:09.506724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:09.564491 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:09.564467 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:14.833855 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.833694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp"] Jul 23 15:04:14.834913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.834447 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerName="istio-proxy" Jul 23 15:04:14.834913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.834474 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerName="istio-proxy" Jul 23 15:04:14.834913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.834634 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c506dc08-3bc6-48c1-8672-b3172ee455b4" containerName="istio-proxy" Jul 23 15:04:14.838633 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.838612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.842529 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.842503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rbpwr\"" Jul 23 15:04:14.853666 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.853642 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp"] Jul 23 15:04:14.864714 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.864687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:14.903247 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee84856-0629-4f4a-a7a8-fb04045e8437-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pw7j\" (UniqueName: \"kubernetes.io/projected/aee84856-0629-4f4a-a7a8-fb04045e8437-kube-api-access-9pw7j\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903561 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903561 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:14.903561 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:14.903452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004691 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004691 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee84856-0629-4f4a-a7a8-fb04045e8437-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pw7j\" (UniqueName: \"kubernetes.io/projected/aee84856-0629-4f4a-a7a8-fb04045e8437-kube-api-access-9pw7j\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.004940 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.004920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.005251 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.005138 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.005251 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.005192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.005337 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.005257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.005337 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.005301 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.005586 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.005567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee84856-0629-4f4a-a7a8-fb04045e8437-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.007338 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.007319 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.007471 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.007456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.017336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.017312 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pw7j\" (UniqueName: \"kubernetes.io/projected/aee84856-0629-4f4a-a7a8-fb04045e8437-kube-api-access-9pw7j\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.017422 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.017358 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee84856-0629-4f4a-a7a8-fb04045e8437-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9plnp\" (UID: \"aee84856-0629-4f4a-a7a8-fb04045e8437\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.087691 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.087624 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:15.148834 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.148805 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:15.286969 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.286940 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp"] Jul 23 15:04:15.289351 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:04:15.289316 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee84856_0629_4f4a_a7a8_fb04045e8437.slice/crio-bb82ef50bff804040f343506915f5f9b607890242eda565efac68d550209ab89 WatchSource:0}: Error finding container bb82ef50bff804040f343506915f5f9b607890242eda565efac68d550209ab89: Status 404 returned error can't find the container with id bb82ef50bff804040f343506915f5f9b607890242eda565efac68d550209ab89 Jul 23 15:04:15.291423 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.291395 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:04:15.291488 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.291459 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:04:15.291523 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.291491 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:04:15.944112 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.944080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" event={"ID":"aee84856-0629-4f4a-a7a8-fb04045e8437","Type":"ContainerStarted","Data":"a8d65bf578fd744b3d901a0b1b0d51362ca71ad20c5fa8ba2117b3f06ed3c92c"} Jul 23 15:04:15.944512 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.944127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" event={"ID":"aee84856-0629-4f4a-a7a8-fb04045e8437","Type":"ContainerStarted","Data":"bb82ef50bff804040f343506915f5f9b607890242eda565efac68d550209ab89"} Jul 23 15:04:15.967817 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:15.967751 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" podStartSLOduration=1.967729836 podStartE2EDuration="1.967729836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:04:15.966043333 +0000 UTC m=+700.987732571" watchObservedRunningTime="2026-07-23 15:04:15.967729836 +0000 UTC m=+700.989419082" Jul 23 15:04:16.149623 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:16.149590 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:16.153986 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:16.153963 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:16.947951 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:16.947924 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:16.948981 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:16.948962 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:04:30.555450 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:30.555378 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:30.663267 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:30.663235 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:30.725741 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:30.725706 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:31.395051 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:31.395020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:31.466586 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:31.466555 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:48.772188 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:48.772152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:48.872721 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:48.872688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:04:49.313546 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:04:49.313514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:02.064417 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:02.064386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:02.324970 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:02.324896 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:09.873231 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:09.873197 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:09.969477 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:09.969442 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:10.642174 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:10.642140 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:10.705027 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:10.704991 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:13.518996 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:13.518959 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:13.615543 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:13.615518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:45.232868 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:45.232835 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:45.326293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:45.326258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:45.998111 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:45.998069 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:46.672278 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:46.672246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:46.756837 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:46.756808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:50.554574 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:50.554539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:50.655824 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:50.655794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:55.361791 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:55.361759 2576 generic.go:356] "Generic (PLEG): container finished" podID="aee84856-0629-4f4a-a7a8-fb04045e8437" containerID="a8d65bf578fd744b3d901a0b1b0d51362ca71ad20c5fa8ba2117b3f06ed3c92c" exitCode=0 Jul 23 15:05:55.362197 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:55.361833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" event={"ID":"aee84856-0629-4f4a-a7a8-fb04045e8437","Type":"ContainerDied","Data":"a8d65bf578fd744b3d901a0b1b0d51362ca71ad20c5fa8ba2117b3f06ed3c92c"} Jul 23 15:05:55.362197 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:55.362193 2576 scope.go:117] "RemoveContainer" containerID="a8d65bf578fd744b3d901a0b1b0d51362ca71ad20c5fa8ba2117b3f06ed3c92c" Jul 23 15:05:55.363186 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:55.363161 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:05:55.363253 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:55.363227 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:05:55.363293 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:55.363257 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:05:56.368690 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:56.368611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" event={"ID":"aee84856-0629-4f4a-a7a8-fb04045e8437","Type":"ContainerStarted","Data":"9d8f5782e1e9c944f70e8ce51b4917e40a140b6cb18ab3582e022bc7e688eea8"} Jul 23 15:05:56.872939 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:56.872910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:56.975122 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:56.975085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:05:57.149759 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:57.149672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:05:57.149952 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:57.149923 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9plnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 23 15:05:57.150008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:57.149986 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" podUID="aee84856-0629-4f4a-a7a8-fb04045e8437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 23 15:05:58.149895 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:58.149790 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9plnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 23 15:05:58.149895 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:58.149843 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" podUID="aee84856-0629-4f4a-a7a8-fb04045e8437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 23 15:05:59.149390 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:59.149351 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9plnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 23 15:05:59.149567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:05:59.149412 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" podUID="aee84856-0629-4f4a-a7a8-fb04045e8437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 23 15:06:00.149732 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:00.149692 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9plnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 23 15:06:00.150134 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:00.149765 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" podUID="aee84856-0629-4f4a-a7a8-fb04045e8437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 23 15:06:01.153703 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:01.153673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:06:01.154108 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:01.153950 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:06:01.154547 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:01.154533 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9plnp" Jul 23 15:06:04.532621 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.532585 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7"] Jul 23 15:06:04.536181 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.536165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.541025 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.540993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 15:06:04.541025 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.540993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 15:06:04.541196 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.541086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nnqmb\"" Jul 23 15:06:04.541196 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.541093 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 23 15:06:04.546268 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.546246 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7"] Jul 23 15:06:04.702667 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.702638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhpg\" (UniqueName: \"kubernetes.io/projected/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-kube-api-access-rnhpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.702835 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.702694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.702835 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.702776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.702935 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.702840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.702969 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.702938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.702969 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.702960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803494 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhpg\" (UniqueName: \"kubernetes.io/projected/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-kube-api-access-rnhpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803494 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803676 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803676 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803676 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803676 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803914 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.803983 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.803962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.804095 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.804076 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.806027 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.806004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.806262 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.806246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.811101 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.811072 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhpg\" (UniqueName: \"kubernetes.io/projected/bfdaf028-8fe3-46b9-b2d6-072a617cc6f5-kube-api-access-rnhpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7\" (UID: \"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.847784 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.847759 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:04.856826 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.856804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:06:04.976057 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.976034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7"] Jul 23 15:06:04.978460 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:06:04.978431 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdaf028_8fe3_46b9_b2d6_072a617cc6f5.slice/crio-d1f1bd5a78fc462d53d34449042119c30b04052ed4b189dcf62ee7d094c6cf6b WatchSource:0}: Error finding container d1f1bd5a78fc462d53d34449042119c30b04052ed4b189dcf62ee7d094c6cf6b: Status 404 returned error can't find the container with id d1f1bd5a78fc462d53d34449042119c30b04052ed4b189dcf62ee7d094c6cf6b Jul 23 15:06:04.979887 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:04.979857 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 15:06:05.405760 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:05.405726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" event={"ID":"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5","Type":"ContainerStarted","Data":"d1f1bd5a78fc462d53d34449042119c30b04052ed4b189dcf62ee7d094c6cf6b"} Jul 23 15:06:07.422514 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:07.422428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" event={"ID":"bfdaf028-8fe3-46b9-b2d6-072a617cc6f5","Type":"ContainerStarted","Data":"0e3288acfff3c9fa6b159eb18e6e8d030e715b74a2ebf9aa6d2916ac9706f780"} Jul 23 15:06:07.440688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:07.440634 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" podStartSLOduration=1.278439712 podStartE2EDuration="3.440619142s" totalImagesPullingTime="2.16217943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:06:07.438681576 +0000 UTC m=+812.460370824" watchObservedRunningTime="2026-07-23 15:06:07.440619142 +0000 UTC m=+812.462308387" Jul 23 15:06:14.848890 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:14.848835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:14.849345 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:14.848918 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:14.861139 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:14.861118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:15.465294 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:15.465266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7" Jul 23 15:06:18.844944 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:18.844917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:06:28.361185 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:28.361147 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:06:31.862083 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:31.862050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:06:35.324077 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.324046 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj"] Jul 23 15:06:35.326614 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.326593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.329408 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.329391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 23 15:06:35.335556 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.335538 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj"] Jul 23 15:06:35.428335 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.428308 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:06:35.446460 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.446435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.446562 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.446468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.446562 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.446490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcf0a35-e764-4521-9f28-82f8a7c6e673-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.446562 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.446518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.446562 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.446548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b88nk\" (UniqueName: \"kubernetes.io/projected/9bcf0a35-e764-4521-9f28-82f8a7c6e673-kube-api-access-b88nk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.446705 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.446567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547048 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547223 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547223 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547223 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcf0a35-e764-4521-9f28-82f8a7c6e673-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547223 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b88nk\" (UniqueName: \"kubernetes.io/projected/9bcf0a35-e764-4521-9f28-82f8a7c6e673-kube-api-access-b88nk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547498 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547550 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.547600 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.547585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.549700 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.549677 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcf0a35-e764-4521-9f28-82f8a7c6e673-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.550084 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.550055 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcf0a35-e764-4521-9f28-82f8a7c6e673-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.555636 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.555614 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b88nk\" (UniqueName: \"kubernetes.io/projected/9bcf0a35-e764-4521-9f28-82f8a7c6e673-kube-api-access-b88nk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m9bcj\" (UID: \"9bcf0a35-e764-4521-9f28-82f8a7c6e673\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.636866 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.636778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:35.793477 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:35.793455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj"] Jul 23 15:06:35.795685 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:06:35.795655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcf0a35_e764_4521_9f28_82f8a7c6e673.slice/crio-6b27e6bc70dbf1f57467f36adc1e0e4ddbb52d502ea3b242efad1c03ab770035 WatchSource:0}: Error finding container 6b27e6bc70dbf1f57467f36adc1e0e4ddbb52d502ea3b242efad1c03ab770035: Status 404 returned error can't find the container with id 6b27e6bc70dbf1f57467f36adc1e0e4ddbb52d502ea3b242efad1c03ab770035 Jul 23 15:06:36.536823 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:36.536793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" event={"ID":"9bcf0a35-e764-4521-9f28-82f8a7c6e673","Type":"ContainerStarted","Data":"d8e2e4c0405b0004eb133d90b7040d144c27920408a467982a4354ab47f9a455"} Jul 23 15:06:36.537201 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:36.536842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" event={"ID":"9bcf0a35-e764-4521-9f28-82f8a7c6e673","Type":"ContainerStarted","Data":"6b27e6bc70dbf1f57467f36adc1e0e4ddbb52d502ea3b242efad1c03ab770035"} Jul 23 15:06:36.557866 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:36.557823 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" podStartSLOduration=1.126515949 podStartE2EDuration="1.557808102s" totalImagesPullingTime="431.292153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:06:36.556196637 +0000 UTC m=+841.577885883" watchObservedRunningTime="2026-07-23 15:06:36.557808102 +0000 UTC m=+841.579497345" Jul 23 15:06:45.637790 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:45.637760 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:45.638187 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:45.637805 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:45.649772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:45.649751 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:46.587464 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:46.587437 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m9bcj" Jul 23 15:06:48.855538 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:06:48.855487 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:07:35.367117 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:07:35.367031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:07:35.367656 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:07:35.367141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:07:42.340961 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:07:42.340923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:07:42.999028 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:07:42.998994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:07:43.662753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:07:43.662723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:07:43.761395 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:07:43.761356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:08:58.300942 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:08:58.300915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:09:03.476362 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:09:03.476331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:09:52.004816 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:09:52.004782 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:09:54.243689 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:09:54.243655 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:03.185634 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:03.185601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:07.052764 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:07.052729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:07.153442 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:07.153414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:34.224029 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:34.223947 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:34.324125 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:34.324081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:34.472769 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:34.472725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:40.569635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:40.569603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:40.676525 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:40.676493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:40.894147 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:40.894068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:40.993485 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:40.993449 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:46.798085 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:46.798053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:10:46.898085 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:10:46.898055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:11:58.085473 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:11:58.085370 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:11:58.184363 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:11:58.184321 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:12:27.101334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:12:27.101302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:12:35.394840 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:12:35.394812 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:12:35.396133 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:12:35.396110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:13:42.670500 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:13:42.670455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:17:35.421455 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:17:35.421426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:17:35.423622 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:17:35.423600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:17:45.822349 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:17:45.822314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:17:47.945309 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:17:47.945275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:18:35.770057 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:18:35.769965 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:18:56.163884 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:18:56.163838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:37.159173 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:19:37.159094 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:38.658577 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:19:38.658543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:40.017073 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:21:40.017032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:35.446907 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:22:35.446863 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:22:35.450260 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:22:35.450238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:22:45.855091 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:22:45.855058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:07.560383 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:07.560348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:10.811891 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:10.811850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:10.907290 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:10.907237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:11.315028 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:11.314995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:16.947067 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:16.947042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:17.014025 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.013989 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:17.218927 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.218834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:17.517959 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.517928 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8"] Jul 23 15:23:17.521079 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.521063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.524106 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.524086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-af2a71ee-openshift-default-dockercfg-p5669\"" Jul 23 15:23:17.538107 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.538082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8"] Jul 23 15:23:17.538333 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.538313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:17.637387 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.637356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:17.668440 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-socket\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668572 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-envoy\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668572 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-certs\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668572 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-credential-socket\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668724 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istiod-ca-cert\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668724 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-data\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668724 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-token\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668868 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-podinfo\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.668868 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.668809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsbd\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-kube-api-access-8dsbd\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.769836 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-socket\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.769836 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-envoy\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.769836 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-certs\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770141 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-credential-socket\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770141 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istiod-ca-cert\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770141 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-data\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770141 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.769995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-token\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-podinfo\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770209 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-socket\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsbd\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-kube-api-access-8dsbd\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-certs\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770479 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-data\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770604 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-credential-socket\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.770674 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.770642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istiod-ca-cert\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.772163 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.772141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-envoy\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.772622 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.772604 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-podinfo\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.778214 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.778195 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-token\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.778334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.778230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsbd\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-kube-api-access-8dsbd\") pod \"e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.830655 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.830632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:17.968397 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.968375 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8"] Jul 23 15:23:17.970648 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:23:17.970617 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773d82fa_3f11_43a6_8a0d_bb77cdf171e4.slice/crio-9eefa734708e95bf1ea4ef00e1cbb59940a31bc033ab330eb32305ccc876353d WatchSource:0}: Error finding container 9eefa734708e95bf1ea4ef00e1cbb59940a31bc033ab330eb32305ccc876353d: Status 404 returned error can't find the container with id 9eefa734708e95bf1ea4ef00e1cbb59940a31bc033ab330eb32305ccc876353d Jul 23 15:23:17.972845 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.972814 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:23:17.972953 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.972892 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:23:17.972953 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:17.972931 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:23:18.825754 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:18.825719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" event={"ID":"773d82fa-3f11-43a6-8a0d-bb77cdf171e4","Type":"ContainerStarted","Data":"8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a"} Jul 23 15:23:18.825935 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:18.825799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" event={"ID":"773d82fa-3f11-43a6-8a0d-bb77cdf171e4","Type":"ContainerStarted","Data":"9eefa734708e95bf1ea4ef00e1cbb59940a31bc033ab330eb32305ccc876353d"} Jul 23 15:23:18.830803 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:18.830786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:18.848812 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:18.848765 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" podStartSLOduration=1.848753721 podStartE2EDuration="1.848753721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:23:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:23:18.846963033 +0000 UTC m=+1843.868652292" watchObservedRunningTime="2026-07-23 15:23:18.848753721 +0000 UTC m=+1843.870442965" Jul 23 15:23:19.835680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:19.835648 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:20.198956 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.198860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:20.272798 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.272769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:20.366340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.366311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:20.567917 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.567886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:20.834498 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.834421 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:20.835284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.835266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:20.933010 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:20.932973 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:21.034482 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:21.034450 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:34.903250 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:34.903147 2576 generic.go:356] "Generic (PLEG): container finished" podID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerID="8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a" exitCode=0 Jul 23 15:23:34.903250 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:34.903227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" event={"ID":"773d82fa-3f11-43a6-8a0d-bb77cdf171e4","Type":"ContainerDied","Data":"8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a"} Jul 23 15:23:34.903792 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:34.903717 2576 scope.go:117] "RemoveContainer" containerID="8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a" Jul 23 15:23:34.904750 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:34.904726 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:23:34.904823 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:34.904800 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:23:34.904857 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:34.904832 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:23:35.834724 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:35.834697 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:35.910677 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:35.910640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" event={"ID":"773d82fa-3f11-43a6-8a0d-bb77cdf171e4","Type":"ContainerStarted","Data":"69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a"} Jul 23 15:23:36.831899 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:36.831838 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:36.833002 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:36.832977 2576 patch_prober.go:28] interesting pod/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 23 15:23:36.833115 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:36.833026 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 23 15:23:37.831680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:37.831644 2576 patch_prober.go:28] interesting pod/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 23 15:23:37.832171 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:37.831698 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 23 15:23:38.831702 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:38.831662 2576 patch_prober.go:28] interesting pod/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 23 15:23:38.832204 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:38.831725 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 23 15:23:39.831217 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:39.831180 2576 patch_prober.go:28] interesting pod/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 23 15:23:39.831404 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:39.831244 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 23 15:23:40.837208 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:40.837183 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:40.837586 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:40.837446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:40.838044 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:40.838029 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:23:56.298321 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:23:56.298239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:00.960951 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:00.960912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.101913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.101847 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8"] Jul 23 15:24:01.102125 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.102088 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" containerID="cri-o://69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a" gracePeriod=30 Jul 23 15:24:01.123663 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.123610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.375523 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.375490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.643107 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.643024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.743079 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.743042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.895327 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:01.895239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:02.210264 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.210175 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f"] Jul 23 15:24:02.213404 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.213387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.216425 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.216405 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e35a5c33-gw-openshift-default-dockercfg-9f59w\"" Jul 23 15:24:02.224503 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.224478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f"] Jul 23 15:24:02.232626 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.232598 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:02.251390 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c7cddb-8945-4cbe-9d2a-507584927b39-istiod-ca-cert\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251505 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-envoy\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251505 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-token\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251505 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-podinfo\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-certs\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-credential-socket\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-data\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs26r\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-kube-api-access-fs26r\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.251746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.251676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-socket\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.352894 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.352846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c7cddb-8945-4cbe-9d2a-507584927b39-istiod-ca-cert\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353073 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.352901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-envoy\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353073 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-token\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353073 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-podinfo\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353240 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-certs\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353240 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-credential-socket\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-data\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353397 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs26r\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-kube-api-access-fs26r\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353458 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-socket\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353506 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-credential-socket\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353564 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-certs\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c7cddb-8945-4cbe-9d2a-507584927b39-istiod-ca-cert\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353705 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-data\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.353967 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.353948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-socket\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.355363 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.355336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-envoy\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.355556 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.355539 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-podinfo\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.361502 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.361478 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-token\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.361582 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.361537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs26r\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-kube-api-access-fs26r\") pod \"e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.524620 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.524590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:02.659407 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.659383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f"] Jul 23 15:24:02.661189 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:24:02.661158 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c7cddb_8945_4cbe_9d2a_507584927b39.slice/crio-44e7830be1920543bac0b4c6912224ef32f93be1941de098cbdd39e5190964ae WatchSource:0}: Error finding container 44e7830be1920543bac0b4c6912224ef32f93be1941de098cbdd39e5190964ae: Status 404 returned error can't find the container with id 44e7830be1920543bac0b4c6912224ef32f93be1941de098cbdd39e5190964ae Jul 23 15:24:02.663455 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.663425 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:02.663569 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.663502 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:02.663569 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:02.663547 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:03.036042 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.036010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" event={"ID":"16c7cddb-8945-4cbe-9d2a-507584927b39","Type":"ContainerStarted","Data":"55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597"} Jul 23 15:24:03.036241 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.036066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" event={"ID":"16c7cddb-8945-4cbe-9d2a-507584927b39","Type":"ContainerStarted","Data":"44e7830be1920543bac0b4c6912224ef32f93be1941de098cbdd39e5190964ae"} Jul 23 15:24:03.043894 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.043844 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:03.059144 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.059100 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" podStartSLOduration=1.059084428 podStartE2EDuration="1.059084428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:24:03.056046226 +0000 UTC m=+1888.077735471" watchObservedRunningTime="2026-07-23 15:24:03.059084428 +0000 UTC m=+1888.080773731" Jul 23 15:24:03.356990 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.356912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:03.457956 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.457899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:03.524971 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.524939 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:03.529995 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:03.529968 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:04.042044 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:04.042014 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:04.042988 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:04.042965 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:04.560051 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:04.560023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:04.834983 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:04.834866 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:04.928131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:04.928102 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:05.256169 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:05.256094 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:05.362416 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:05.362384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:06.359922 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.359894 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:24:06.493624 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493524 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-certs\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493624 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-token\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493624 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493598 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-credential-socket\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493624 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493618 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istiod-ca-cert\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-podinfo\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493808 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-data\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493818 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:06.493949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493896 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-socket\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.493949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493927 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dsbd\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-kube-api-access-8dsbd\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.494184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-envoy\") pod \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\" (UID: \"773d82fa-3f11-43a6-8a0d-bb77cdf171e4\") " Jul 23 15:24:06.494184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.493969 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:06.494184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494035 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:24:06.494373 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494175 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:06.494779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494700 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.494779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494728 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.494779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494743 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.494779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494757 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.495027 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.494808 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:06.496086 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.496056 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:24:06.496222 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.496200 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-kube-api-access-8dsbd" (OuterVolumeSpecName: "kube-api-access-8dsbd") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "kube-api-access-8dsbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:24:06.496481 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.496461 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:06.496527 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.496467 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "773d82fa-3f11-43a6-8a0d-bb77cdf171e4" (UID: "773d82fa-3f11-43a6-8a0d-bb77cdf171e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:24:06.595364 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.595324 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.595364 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.595361 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.595364 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.595370 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.595364 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.595379 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dsbd\" (UniqueName: \"kubernetes.io/projected/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-kube-api-access-8dsbd\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:06.595617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:06.595389 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773d82fa-3f11-43a6-8a0d-bb77cdf171e4-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:07.057228 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.057192 2576 generic.go:356] "Generic (PLEG): container finished" podID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerID="69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a" exitCode=0 Jul 23 15:24:07.057392 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.057246 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" Jul 23 15:24:07.057392 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.057244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" event={"ID":"773d82fa-3f11-43a6-8a0d-bb77cdf171e4","Type":"ContainerDied","Data":"69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a"} Jul 23 15:24:07.057392 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.057368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8" event={"ID":"773d82fa-3f11-43a6-8a0d-bb77cdf171e4","Type":"ContainerDied","Data":"9eefa734708e95bf1ea4ef00e1cbb59940a31bc033ab330eb32305ccc876353d"} Jul 23 15:24:07.057392 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.057393 2576 scope.go:117] "RemoveContainer" containerID="69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a" Jul 23 15:24:07.066685 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.066667 2576 scope.go:117] "RemoveContainer" containerID="8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a" Jul 23 15:24:07.074112 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.074092 2576 scope.go:117] "RemoveContainer" containerID="69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a" Jul 23 15:24:07.074358 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:24:07.074340 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a\": container with ID starting with 69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a not found: ID does not exist" containerID="69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a" Jul 23 15:24:07.074410 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.074368 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a"} err="failed to get container status \"69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a\": rpc error: code = NotFound desc = could not find container \"69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a\": container with ID starting with 69b1034e9fc5f6ff9bbc804ee64f28671a8baecb3dbf5a58ffec3e8eba83750a not found: ID does not exist" Jul 23 15:24:07.074410 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.074384 2576 scope.go:117] "RemoveContainer" containerID="8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a" Jul 23 15:24:07.074603 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:24:07.074583 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a\": container with ID starting with 8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a not found: ID does not exist" containerID="8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a" Jul 23 15:24:07.074657 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.074612 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a"} err="failed to get container status \"8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a\": rpc error: code = NotFound desc = could not find container \"8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a\": container with ID starting with 8e384d151f4d1553c552eec67cf7a9c74fed9fab3d04b4a3221b0b1ea74ee07a not found: ID does not exist" Jul 23 15:24:07.079599 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.079574 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8"] Jul 23 15:24:07.085378 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.085357 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-af2a71ee-openshift-default-5b9f6ccf79-w6wl8"] Jul 23 15:24:07.422425 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:07.422344 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" path="/var/lib/kubelet/pods/773d82fa-3f11-43a6-8a0d-bb77cdf171e4/volumes" Jul 23 15:24:16.100949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:16.100842 2576 generic.go:356] "Generic (PLEG): container finished" podID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerID="55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597" exitCode=0 Jul 23 15:24:16.100949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:16.100914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" event={"ID":"16c7cddb-8945-4cbe-9d2a-507584927b39","Type":"ContainerDied","Data":"55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597"} Jul 23 15:24:16.101423 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:16.101271 2576 scope.go:117] "RemoveContainer" containerID="55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597" Jul 23 15:24:16.102314 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:16.102285 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:16.102430 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:16.102352 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:16.102430 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:16.102385 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:17.107343 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:17.107312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" event={"ID":"16c7cddb-8945-4cbe-9d2a-507584927b39","Type":"ContainerStarted","Data":"00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1"} Jul 23 15:24:17.525522 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:17.525485 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:17.526689 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:17.526663 2576 patch_prober.go:28] interesting pod/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 23 15:24:17.526812 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:17.526713 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 23 15:24:18.525127 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:18.525090 2576 patch_prober.go:28] interesting pod/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 23 15:24:18.525522 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:18.525151 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 23 15:24:19.042618 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:19.042587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:19.525359 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:19.525322 2576 patch_prober.go:28] interesting pod/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 23 15:24:19.525819 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:19.525397 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 23 15:24:20.525868 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:20.525830 2576 patch_prober.go:28] interesting pod/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 23 15:24:20.526272 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:20.525913 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 23 15:24:21.529151 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:21.529121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:21.529978 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:21.529958 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:40.464262 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:40.464230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:44.728254 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:44.728222 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:44.890688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:44.890657 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f"] Jul 23 15:24:44.890941 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:44.890919 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" containerID="cri-o://00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1" gracePeriod=30 Jul 23 15:24:44.904125 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:44.904101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:45.168606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.168572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:45.435062 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.434986 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:45.752303 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.752223 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h"] Jul 23 15:24:45.752645 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.752580 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" Jul 23 15:24:45.752645 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.752593 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" Jul 23 15:24:45.752645 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.752611 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" Jul 23 15:24:45.752645 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.752621 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" Jul 23 15:24:45.752765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.752712 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" Jul 23 15:24:45.755972 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.755949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.759153 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.759133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ee7b3491-openshift-default-dockercfg-fd9dr\"" Jul 23 15:24:45.766857 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.766833 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h"] Jul 23 15:24:45.786579 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.786546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:45.841549 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-credential-socket\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841549 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-certs\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841726 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-token\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841726 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-data\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841726 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-podinfo\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841726 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-envoy\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841852 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-socket\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841852 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwxl\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-kube-api-access-gwwxl\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.841852 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.841794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istiod-ca-cert\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.884815 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.884778 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:45.943244 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-credential-socket\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943244 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-certs\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943492 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-token\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943492 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-data\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943492 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-podinfo\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943658 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-envoy\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943658 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-socket\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943658 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwxl\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-kube-api-access-gwwxl\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943658 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istiod-ca-cert\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943914 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-certs\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943914 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943781 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-credential-socket\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.943914 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.943853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-data\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.944839 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.944803 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istiod-ca-cert\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.945001 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.944980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-socket\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.946807 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.946784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-envoy\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.948148 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.948108 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-podinfo\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.956203 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.955996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-token\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:45.959539 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:45.959516 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwxl\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-kube-api-access-gwwxl\") pod \"e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:46.067270 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:46.067232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:46.202843 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:46.202820 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h"] Jul 23 15:24:46.205411 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:24:46.205379 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc10fc01_a7b9_4021_9e84_e016af6c0efd.slice/crio-a40993d96749133996765bfa938793dcf70c933eed65aca13c4b8119998e58a1 WatchSource:0}: Error finding container a40993d96749133996765bfa938793dcf70c933eed65aca13c4b8119998e58a1: Status 404 returned error can't find the container with id a40993d96749133996765bfa938793dcf70c933eed65aca13c4b8119998e58a1 Jul 23 15:24:46.207636 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:46.207600 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:46.207726 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:46.207669 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:46.207726 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:46.207698 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:24:46.236534 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:46.236498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" event={"ID":"fc10fc01-a7b9-4021-9e84-e016af6c0efd","Type":"ContainerStarted","Data":"a40993d96749133996765bfa938793dcf70c933eed65aca13c4b8119998e58a1"} Jul 23 15:24:47.242172 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:47.242132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" event={"ID":"fc10fc01-a7b9-4021-9e84-e016af6c0efd","Type":"ContainerStarted","Data":"6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f"} Jul 23 15:24:47.266526 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:47.266472 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" podStartSLOduration=2.266454898 podStartE2EDuration="2.266454898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:24:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:24:47.265055103 +0000 UTC m=+1932.286744350" watchObservedRunningTime="2026-07-23 15:24:47.266454898 +0000 UTC m=+1932.288144142" Jul 23 15:24:48.067760 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:48.067723 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:48.072499 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:48.072475 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:48.246292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:48.246265 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:48.247249 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:48.247230 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:24:48.613511 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:48.613475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:49.126227 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:49.126188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:49.582058 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:49.582033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:49.684371 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:49.684332 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:50.148488 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.148464 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:50.180059 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs26r\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-kube-api-access-fs26r\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180183 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-token\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180183 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-socket\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180183 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-envoy\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180202 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c7cddb-8945-4cbe-9d2a-507584927b39-istiod-ca-cert\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180232 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-credential-socket\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180286 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-certs\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180466 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180324 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-podinfo\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180466 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180350 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-data\") pod \"16c7cddb-8945-4cbe-9d2a-507584927b39\" (UID: \"16c7cddb-8945-4cbe-9d2a-507584927b39\") " Jul 23 15:24:50.180466 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:50.180785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180609 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:50.180785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180642 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16c7cddb-8945-4cbe-9d2a-507584927b39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:24:50.180785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.180660 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.181169 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.181082 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:50.181169 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.181185 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-data" (OuterVolumeSpecName: "istio-data") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:50.182660 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.182634 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:24:50.182839 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.182820 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-token" (OuterVolumeSpecName: "istio-token") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:24:50.183020 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.182999 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:24:50.183118 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.183034 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-kube-api-access-fs26r" (OuterVolumeSpecName: "kube-api-access-fs26r") pod "16c7cddb-8945-4cbe-9d2a-507584927b39" (UID: "16c7cddb-8945-4cbe-9d2a-507584927b39"). InnerVolumeSpecName "kube-api-access-fs26r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:24:50.257418 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.257378 2576 generic.go:356] "Generic (PLEG): container finished" podID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerID="00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1" exitCode=0 Jul 23 15:24:50.257570 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.257437 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" Jul 23 15:24:50.257570 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.257476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" event={"ID":"16c7cddb-8945-4cbe-9d2a-507584927b39","Type":"ContainerDied","Data":"00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1"} Jul 23 15:24:50.257570 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.257528 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f" event={"ID":"16c7cddb-8945-4cbe-9d2a-507584927b39","Type":"ContainerDied","Data":"44e7830be1920543bac0b4c6912224ef32f93be1941de098cbdd39e5190964ae"} Jul 23 15:24:50.257570 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.257553 2576 scope.go:117] "RemoveContainer" containerID="00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1" Jul 23 15:24:50.271927 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.271909 2576 scope.go:117] "RemoveContainer" containerID="55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597" Jul 23 15:24:50.279548 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.279527 2576 scope.go:117] "RemoveContainer" containerID="00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1" Jul 23 15:24:50.279817 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:24:50.279799 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1\": container with ID starting with 00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1 not found: ID does not exist" containerID="00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1" Jul 23 15:24:50.279856 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.279824 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1"} err="failed to get container status \"00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1\": rpc error: code = NotFound desc = could not find container \"00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1\": container with ID starting with 00f587baceef79ad3b09c5d98af60f6479d70fd3b9f669ef28d95a287e88d5a1 not found: ID does not exist" Jul 23 15:24:50.279856 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.279841 2576 scope.go:117] "RemoveContainer" containerID="55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597" Jul 23 15:24:50.280095 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:24:50.280078 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597\": container with ID starting with 55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597 not found: ID does not exist" containerID="55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597" Jul 23 15:24:50.280137 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.280101 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597"} err="failed to get container status \"55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597\": rpc error: code = NotFound desc = could not find container \"55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597\": container with ID starting with 55686b69c8e731b02e63c6bf4aa621b134a5165672e493002d2e229a65d17597 not found: ID does not exist" Jul 23 15:24:50.281356 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281333 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281362 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281376 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281388 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs26r\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-kube-api-access-fs26r\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281402 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281413 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281424 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c7cddb-8945-4cbe-9d2a-507584927b39-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.281435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.281436 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c7cddb-8945-4cbe-9d2a-507584927b39-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:24:50.283380 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.283358 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f"] Jul 23 15:24:50.286925 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:50.286904 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e35a5c33-gw-openshift-default-7bc65459c5-45b9f"] Jul 23 15:24:51.423184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:24:51.423154 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" path="/var/lib/kubelet/pods/16c7cddb-8945-4cbe-9d2a-507584927b39/volumes" Jul 23 15:25:02.319963 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:02.319932 2576 generic.go:356] "Generic (PLEG): container finished" podID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerID="6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f" exitCode=0 Jul 23 15:25:02.320351 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:02.319982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" event={"ID":"fc10fc01-a7b9-4021-9e84-e016af6c0efd","Type":"ContainerDied","Data":"6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f"} Jul 23 15:25:02.320351 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:02.320325 2576 scope.go:117] "RemoveContainer" containerID="6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f" Jul 23 15:25:02.321289 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:02.321264 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:02.321347 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:02.321334 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:02.321386 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:02.321377 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:03.246979 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:03.246945 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:03.326607 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:03.326569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" event={"ID":"fc10fc01-a7b9-4021-9e84-e016af6c0efd","Type":"ContainerStarted","Data":"e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186"} Jul 23 15:25:04.067406 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:04.067379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:04.068489 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:04.068465 2576 patch_prober.go:28] interesting pod/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 23 15:25:04.068598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:04.068511 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 23 15:25:05.067769 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:05.067732 2576 patch_prober.go:28] interesting pod/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 23 15:25:05.068188 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:05.067800 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 23 15:25:06.068010 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:06.067975 2576 patch_prober.go:28] interesting pod/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 23 15:25:06.068402 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:06.068034 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 23 15:25:07.068175 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:07.068138 2576 patch_prober.go:28] interesting pod/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 23 15:25:07.068573 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:07.068208 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 23 15:25:08.072325 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:08.072291 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:08.072677 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:08.072657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:08.073411 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:08.073388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:16.305711 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:16.305675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:16.406249 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:16.406212 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:25.257782 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:25.257740 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:25.357241 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:25.357199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:25.495037 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:25.495003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:29.710655 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:29.710618 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:31.024120 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.024084 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h"] Jul 23 15:25:31.024897 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.024842 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" containerID="cri-o://e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186" gracePeriod=30 Jul 23 15:25:31.043968 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.043938 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:31.287551 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.287445 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:31.524678 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.524647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:31.831667 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.831632 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd"] Jul 23 15:25:31.832103 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832074 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" Jul 23 15:25:31.832103 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832095 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" Jul 23 15:25:31.832255 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832110 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" Jul 23 15:25:31.832255 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832116 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" Jul 23 15:25:31.832255 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832175 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" Jul 23 15:25:31.832255 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832183 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="773d82fa-3f11-43a6-8a0d-bb77cdf171e4" containerName="istio-proxy" Jul 23 15:25:31.832255 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.832191 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="16c7cddb-8945-4cbe-9d2a-507584927b39" containerName="istio-proxy" Jul 23 15:25:31.835217 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.835200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.838153 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.838134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3e83224e-openshift-default-dockercfg-s9kcg\"" Jul 23 15:25:31.847690 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.847662 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd"] Jul 23 15:25:31.858680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.858651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-certs\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.858955 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.858930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-data\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859088 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-token\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-credential-socket\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859346 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istiod-ca-cert\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859450 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d56wr\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-kube-api-access-d56wr\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859450 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-socket\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859575 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-envoy\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.859615 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.859594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-podinfo\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.861055 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.861034 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:31.960396 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istiod-ca-cert\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960396 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d56wr\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-kube-api-access-d56wr\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-socket\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-envoy\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-podinfo\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-certs\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-data\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-token\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-credential-socket\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.960865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.960852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-socket\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.961336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.961077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-certs\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.961336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.961130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-data\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.961336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.961304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istiod-ca-cert\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.961493 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.961471 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-credential-socket\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.963068 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.963048 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-envoy\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.963161 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.963142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-podinfo\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.969401 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.969376 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-token\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:31.969509 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:31.969435 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d56wr\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-kube-api-access-d56wr\") pod \"e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:32.143232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.143141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:32.146067 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.146047 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:32.289368 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.289343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd"] Jul 23 15:25:32.291655 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:25:32.291629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6c6385_53f7_4034_87ec_f559e9a6e2a6.slice/crio-fa3bcf193ac7fb07070d4cad92a525ce6c592875350f373415b26158dd577e82 WatchSource:0}: Error finding container fa3bcf193ac7fb07070d4cad92a525ce6c592875350f373415b26158dd577e82: Status 404 returned error can't find the container with id fa3bcf193ac7fb07070d4cad92a525ce6c592875350f373415b26158dd577e82 Jul 23 15:25:32.294013 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.293976 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:32.294087 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.294059 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:32.294126 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.294101 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:32.470354 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.470261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" event={"ID":"4d6c6385-53f7-4034-87ec-f559e9a6e2a6","Type":"ContainerStarted","Data":"ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59"} Jul 23 15:25:32.470354 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.470338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" event={"ID":"4d6c6385-53f7-4034-87ec-f559e9a6e2a6","Type":"ContainerStarted","Data":"fa3bcf193ac7fb07070d4cad92a525ce6c592875350f373415b26158dd577e82"} Jul 23 15:25:32.489820 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:32.489747 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" podStartSLOduration=1.489730864 podStartE2EDuration="1.489730864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:25:32.488973358 +0000 UTC m=+1977.510662605" watchObservedRunningTime="2026-07-23 15:25:32.489730864 +0000 UTC m=+1977.511420200" Jul 23 15:25:33.147107 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:33.147075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:33.151712 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:33.151688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:33.475241 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:33.475153 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:33.476153 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:33.476137 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:33.827290 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:33.827259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:33.925397 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:33.925362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:34.072719 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:34.072687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:34.377529 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:34.377501 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:34.494932 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:34.494900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:34.597972 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:34.597940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:36.275633 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.275610 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:36.299474 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299380 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istiod-ca-cert\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299474 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299450 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwwxl\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-kube-api-access-gwwxl\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299692 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299490 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-podinfo\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299692 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299548 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-data\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299692 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299592 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-socket\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299692 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299629 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-envoy\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299692 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-token\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299985 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299699 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-credential-socket\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.299985 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299702 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:25:36.299985 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.299815 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-certs\") pod \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\" (UID: \"fc10fc01-a7b9-4021-9e84-e016af6c0efd\") " Jul 23 15:25:36.300135 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.300017 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:25:36.300185 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.300170 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:25:36.300415 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.300260 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.300415 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.300282 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.300415 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.300296 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.300735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.300585 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:25:36.301110 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.301086 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:25:36.302965 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.302925 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:25:36.303236 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.303196 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:25:36.303314 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.303234 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-kube-api-access-gwwxl" (OuterVolumeSpecName: "kube-api-access-gwwxl") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "kube-api-access-gwwxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:25:36.303314 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.303287 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc10fc01-a7b9-4021-9e84-e016af6c0efd" (UID: "fc10fc01-a7b9-4021-9e84-e016af6c0efd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:25:36.401747 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.401704 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwwxl\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-kube-api-access-gwwxl\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.401747 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.401739 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.401747 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.401753 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.402050 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.401764 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.402050 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.401776 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.402050 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.401789 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc10fc01-a7b9-4021-9e84-e016af6c0efd-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:25:36.489173 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.489132 2576 generic.go:356] "Generic (PLEG): container finished" podID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerID="e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186" exitCode=0 Jul 23 15:25:36.489369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.489187 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" Jul 23 15:25:36.489369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.489213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" event={"ID":"fc10fc01-a7b9-4021-9e84-e016af6c0efd","Type":"ContainerDied","Data":"e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186"} Jul 23 15:25:36.489369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.489268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h" event={"ID":"fc10fc01-a7b9-4021-9e84-e016af6c0efd","Type":"ContainerDied","Data":"a40993d96749133996765bfa938793dcf70c933eed65aca13c4b8119998e58a1"} Jul 23 15:25:36.489369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.489294 2576 scope.go:117] "RemoveContainer" containerID="e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186" Jul 23 15:25:36.499002 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.498814 2576 scope.go:117] "RemoveContainer" containerID="6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f" Jul 23 15:25:36.507417 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.507396 2576 scope.go:117] "RemoveContainer" containerID="e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186" Jul 23 15:25:36.507713 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:25:36.507693 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186\": container with ID starting with e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186 not found: ID does not exist" containerID="e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186" Jul 23 15:25:36.507759 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.507724 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186"} err="failed to get container status \"e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186\": rpc error: code = NotFound desc = could not find container \"e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186\": container with ID starting with e14c3e1f1cef0fc2682533992031095e06220b962a4ae66ab95847617ec99186 not found: ID does not exist" Jul 23 15:25:36.507759 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.507743 2576 scope.go:117] "RemoveContainer" containerID="6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f" Jul 23 15:25:36.508032 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:25:36.508009 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f\": container with ID starting with 6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f not found: ID does not exist" containerID="6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f" Jul 23 15:25:36.508097 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.508042 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f"} err="failed to get container status \"6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f\": rpc error: code = NotFound desc = could not find container \"6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f\": container with ID starting with 6533c6fb32bb932c9f92df1ee865698ea9fc02c3efa98980ed2f3086bc61f79f not found: ID does not exist" Jul 23 15:25:36.511865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.511838 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h"] Jul 23 15:25:36.515526 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:36.515497 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ee7b3491-openshift-default-75996b856c-f9c4h"] Jul 23 15:25:37.422894 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:37.422853 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" path="/var/lib/kubelet/pods/fc10fc01-a7b9-4021-9e84-e016af6c0efd/volumes" Jul 23 15:25:44.536318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:44.536281 2576 generic.go:356] "Generic (PLEG): container finished" podID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerID="ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59" exitCode=0 Jul 23 15:25:44.536833 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:44.536352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" event={"ID":"4d6c6385-53f7-4034-87ec-f559e9a6e2a6","Type":"ContainerDied","Data":"ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59"} Jul 23 15:25:44.536941 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:44.536869 2576 scope.go:117] "RemoveContainer" containerID="ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59" Jul 23 15:25:44.537936 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:44.537907 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:44.538033 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:44.537976 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:44.538033 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:44.538014 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:25:45.543425 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:45.543389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" event={"ID":"4d6c6385-53f7-4034-87ec-f559e9a6e2a6","Type":"ContainerStarted","Data":"413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a"} Jul 23 15:25:46.146665 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:46.146622 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:46.147765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:46.147733 2576 patch_prober.go:28] interesting pod/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 23 15:25:46.147934 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:46.147796 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 23 15:25:47.147155 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:47.147118 2576 patch_prober.go:28] interesting pod/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 23 15:25:47.147737 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:47.147198 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 23 15:25:48.147460 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:48.147421 2576 patch_prober.go:28] interesting pod/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 23 15:25:48.147859 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:48.147480 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 23 15:25:48.475283 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:48.475192 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:49.146650 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:49.146606 2576 patch_prober.go:28] interesting pod/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 23 15:25:49.146857 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:49.146672 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 23 15:25:50.151147 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:50.151114 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:25:50.152145 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:25:50.152126 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:26:09.208265 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:09.208227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:10.287524 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:10.287485 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:10.339501 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:10.339464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:13.888357 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:13.888318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:14.028048 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:14.028004 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd"] Jul 23 15:26:14.028291 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:14.028251 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" containerID="cri-o://413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a" gracePeriod=30 Jul 23 15:26:14.050034 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:14.050002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:14.311112 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:14.311078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:14.820417 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:14.820386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:14.956190 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:14.956154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:15.056684 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:15.056650 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:16.730375 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:16.730341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:19.282228 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.282203 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:26:19.287265 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287243 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d56wr\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-kube-api-access-d56wr\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287380 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287290 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-certs\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287380 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287329 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-socket\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287380 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287364 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-podinfo\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287541 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287414 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-envoy\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287541 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287448 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-token\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287541 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287476 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-data\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287541 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287525 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-credential-socket\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287749 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istiod-ca-cert\") pod \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\" (UID: \"4d6c6385-53f7-4034-87ec-f559e9a6e2a6\") " Jul 23 15:26:19.287749 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287660 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:26:19.287864 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287810 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:26:19.287949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287921 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.288003 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.287983 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:26:19.288210 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.288163 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:26:19.288744 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.288706 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:26:19.289752 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.289721 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-kube-api-access-d56wr" (OuterVolumeSpecName: "kube-api-access-d56wr") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "kube-api-access-d56wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:26:19.289863 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.289845 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:26:19.290307 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.290287 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:26:19.290307 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.290287 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d6c6385-53f7-4034-87ec-f559e9a6e2a6" (UID: "4d6c6385-53f7-4034-87ec-f559e9a6e2a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:26:19.388311 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388273 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388311 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388305 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388311 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388314 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388311 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388321 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388585 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388330 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388585 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388338 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388585 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388347 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d56wr\" (UniqueName: \"kubernetes.io/projected/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-kube-api-access-d56wr\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.388585 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.388356 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6c6385-53f7-4034-87ec-f559e9a6e2a6-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:26:19.695825 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.695725 2576 generic.go:356] "Generic (PLEG): container finished" podID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerID="413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a" exitCode=0 Jul 23 15:26:19.695825 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.695780 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" Jul 23 15:26:19.696076 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.695819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" event={"ID":"4d6c6385-53f7-4034-87ec-f559e9a6e2a6","Type":"ContainerDied","Data":"413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a"} Jul 23 15:26:19.696076 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.695899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd" event={"ID":"4d6c6385-53f7-4034-87ec-f559e9a6e2a6","Type":"ContainerDied","Data":"fa3bcf193ac7fb07070d4cad92a525ce6c592875350f373415b26158dd577e82"} Jul 23 15:26:19.696076 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.695909 2576 scope.go:117] "RemoveContainer" containerID="413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a" Jul 23 15:26:19.704646 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.704626 2576 scope.go:117] "RemoveContainer" containerID="ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59" Jul 23 15:26:19.713437 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.713414 2576 scope.go:117] "RemoveContainer" containerID="413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a" Jul 23 15:26:19.713718 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:26:19.713693 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a\": container with ID starting with 413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a not found: ID does not exist" containerID="413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a" Jul 23 15:26:19.713772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.713731 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a"} err="failed to get container status \"413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a\": rpc error: code = NotFound desc = could not find container \"413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a\": container with ID starting with 413ad152e9593591e2b586c0f7e094ddebfedf26f05fd24c3f6b65bf274fed7a not found: ID does not exist" Jul 23 15:26:19.713772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.713756 2576 scope.go:117] "RemoveContainer" containerID="ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59" Jul 23 15:26:19.714051 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:26:19.714027 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59\": container with ID starting with ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59 not found: ID does not exist" containerID="ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59" Jul 23 15:26:19.714122 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.714058 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59"} err="failed to get container status \"ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59\": rpc error: code = NotFound desc = could not find container \"ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59\": container with ID starting with ca7ade312985ae1453052508af1314e5b92a5d70fc5c1bcf8486f9e5bba67c59 not found: ID does not exist" Jul 23 15:26:19.714381 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.714367 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd"] Jul 23 15:26:19.719512 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:19.719485 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3e83224e-openshift-default-58f45588dc-cjscd"] Jul 23 15:26:21.422539 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:21.422509 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" path="/var/lib/kubelet/pods/4d6c6385-53f7-4034-87ec-f559e9a6e2a6/volumes" Jul 23 15:26:23.223058 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:23.223020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:23.290307 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:23.290269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:23.366753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:23.366710 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:23.470117 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:23.470085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:23.566419 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:23.566387 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:24.002272 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:24.002186 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:47.292407 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:47.292373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:50.066177 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:50.066138 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:56.257401 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:56.257364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:56.364219 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:56.364131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:56.472640 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:26:56.472609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:12.477346 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:12.477313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:18.342787 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:18.342751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:18.491099 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:18.491066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:18.580309 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:18.580276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:29.098730 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:29.098692 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:29.958842 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:29.958809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:35.474267 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:35.474237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:27:35.478056 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:35.478033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:27:35.957630 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:35.957595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:36.065608 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:36.065568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:36.160517 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:36.160481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:36.258164 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:36.258087 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:37.093402 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:37.093365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:37.211682 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:37.211650 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:37.314599 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:37.314554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:39.070833 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:39.070798 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:45.481865 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:45.481832 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:45.589613 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:45.589575 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:46.250216 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:46.250165 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:52.177246 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.177204 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:52.277635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.277604 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:52.435513 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.435427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:52.742454 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742366 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6"] Jul 23 15:27:52.742736 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742723 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" Jul 23 15:27:52.742779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742738 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" Jul 23 15:27:52.742779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742750 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" Jul 23 15:27:52.742779 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742755 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" Jul 23 15:27:52.742902 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742813 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" Jul 23 15:27:52.742902 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742821 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" Jul 23 15:27:52.742902 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.742829 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" Jul 23 15:27:52.744829 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.744815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.747894 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.747851 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7f6db9fe-openshift-default-dockercfg-nxg2w\"" Jul 23 15:27:52.763725 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.763697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6"] Jul 23 15:27:52.766825 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.766796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:52.903713 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.903678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-podinfo\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.903960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.903724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-credential-socket\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.903960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.903756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrkbg\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-kube-api-access-vrkbg\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.903960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.903862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-token\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.903960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.903942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-data\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.904135 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.903974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-socket\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.904135 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.904033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-certs\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.904135 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.904081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809df88d-fdff-4f10-a8bb-9e22e01f793d-istiod-ca-cert\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:52.904135 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:52.904122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-envoy\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005312 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-credential-socket\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005312 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkbg\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-kube-api-access-vrkbg\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005542 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-token\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005542 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-data\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005542 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-socket\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005542 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-certs\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809df88d-fdff-4f10-a8bb-9e22e01f793d-istiod-ca-cert\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-envoy\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-podinfo\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005735 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-credential-socket\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005966 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005781 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-data\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005966 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-socket\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.005966 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.005956 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-certs\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.006353 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.006331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809df88d-fdff-4f10-a8bb-9e22e01f793d-istiod-ca-cert\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.008114 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.008096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-envoy\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.008440 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.008421 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-podinfo\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.014261 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.014235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkbg\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-kube-api-access-vrkbg\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.014353 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.014265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-token\") pod \"e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.055372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.055336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:53.199292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.199267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6"] Jul 23 15:27:53.201104 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:27:53.201064 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809df88d_fdff_4f10_a8bb_9e22e01f793d.slice/crio-86a6f11258b4dbce3122260c826c88b23213d7207ba44d1154b7eb0630f592f8 WatchSource:0}: Error finding container 86a6f11258b4dbce3122260c826c88b23213d7207ba44d1154b7eb0630f592f8: Status 404 returned error can't find the container with id 86a6f11258b4dbce3122260c826c88b23213d7207ba44d1154b7eb0630f592f8 Jul 23 15:27:53.203169 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.203129 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:27:53.203270 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.203222 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:27:53.203333 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.203270 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:27:53.218651 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:53.218624 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:54.136785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:54.136747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" event={"ID":"809df88d-fdff-4f10-a8bb-9e22e01f793d","Type":"ContainerStarted","Data":"9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0"} Jul 23 15:27:54.136993 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:54.136807 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" event={"ID":"809df88d-fdff-4f10-a8bb-9e22e01f793d","Type":"ContainerStarted","Data":"86a6f11258b4dbce3122260c826c88b23213d7207ba44d1154b7eb0630f592f8"} Jul 23 15:27:54.161441 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:54.161393 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podStartSLOduration=2.161376471 podStartE2EDuration="2.161376471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:27:54.159807885 +0000 UTC m=+2119.181497131" watchObservedRunningTime="2026-07-23 15:27:54.161376471 +0000 UTC m=+2119.183065716" Jul 23 15:27:55.056192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:55.056152 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:55.061129 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:55.061103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:55.141273 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:55.141245 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:55.142339 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:55.142320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:27:56.249050 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:56.249009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:56.340771 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:56.340741 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:56.402580 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:56.402546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:56.906696 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:56.906663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:57.005262 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:27:57.005230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:00.683204 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:00.683175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:01.409515 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:01.409474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:01.546551 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:01.546512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:01.881838 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:01.881807 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:07.551357 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:07.551316 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:07.607898 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:07.607837 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:10.143291 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.143256 2576 patch_prober.go:28] interesting pod/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 23 15:28:10.143717 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.143321 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 23 15:28:10.219016 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.218981 2576 generic.go:356] "Generic (PLEG): container finished" podID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerID="9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0" exitCode=0 Jul 23 15:28:10.219180 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.219053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" event={"ID":"809df88d-fdff-4f10-a8bb-9e22e01f793d","Type":"ContainerDied","Data":"9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0"} Jul 23 15:28:10.219453 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.219440 2576 scope.go:117] "RemoveContainer" containerID="9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0" Jul 23 15:28:10.220463 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.220436 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:28:10.220567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.220517 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:28:10.220627 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:10.220566 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:28:11.225919 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:11.225887 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" event={"ID":"809df88d-fdff-4f10-a8bb-9e22e01f793d","Type":"ContainerStarted","Data":"df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f"} Jul 23 15:28:12.056292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:12.056260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:28:12.056488 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:12.056443 2576 patch_prober.go:28] interesting pod/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 23 15:28:12.056534 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:12.056487 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 23 15:28:13.056366 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:13.056329 2576 patch_prober.go:28] interesting pod/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 23 15:28:13.056755 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:13.056383 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 23 15:28:14.056159 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:14.056120 2576 patch_prober.go:28] interesting pod/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 23 15:28:14.056366 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:14.056213 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 23 15:28:15.056578 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:15.056534 2576 patch_prober.go:28] interesting pod/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 23 15:28:15.057023 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:15.056611 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 23 15:28:16.060199 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:16.060172 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:28:16.060663 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:16.060447 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:28:16.061185 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:16.061168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:28:18.438038 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:18.437998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:23.013972 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:23.013934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:23.447272 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:23.447177 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:29.146539 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.146451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:29.247024 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.246992 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:29.403237 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.403146 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6"] Jul 23 15:28:29.403406 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.403379 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" containerID="cri-o://df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f" gracePeriod=30 Jul 23 15:28:29.454330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.454294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:29.671251 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.671154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:29.824459 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.824423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:29.914415 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:29.914379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:30.097365 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:30.097331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:31.063473 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:31.063430 2576 patch_prober.go:28] interesting pod/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 23 15:28:31.063912 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:31.063512 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:28:34.646998 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.646973 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:28:34.814084 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814050 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-token\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814094 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-envoy\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814115 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrkbg\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-kube-api-access-vrkbg\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814180 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-podinfo\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814196 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-certs\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814248 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809df88d-fdff-4f10-a8bb-9e22e01f793d-istiod-ca-cert\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814284 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-credential-socket\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814305 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-data\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814334 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-socket\") pod \"809df88d-fdff-4f10-a8bb-9e22e01f793d\" (UID: \"809df88d-fdff-4f10-a8bb-9e22e01f793d\") " Jul 23 15:28:34.814603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814561 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:28:34.814748 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814648 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/809df88d-fdff-4f10-a8bb-9e22e01f793d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:28:34.814748 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814699 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.814852 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814784 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:28:34.814994 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.814955 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:28:34.815508 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.815489 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-data" (OuterVolumeSpecName: "istio-data") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:28:34.816543 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.816515 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:28:34.816543 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.816521 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-kube-api-access-vrkbg" (OuterVolumeSpecName: "kube-api-access-vrkbg") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "kube-api-access-vrkbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:28:34.816934 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.816914 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-token" (OuterVolumeSpecName: "istio-token") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:28:34.816990 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.816957 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "809df88d-fdff-4f10-a8bb-9e22e01f793d" (UID: "809df88d-fdff-4f10-a8bb-9e22e01f793d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:28:34.915721 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915678 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.915721 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915715 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809df88d-fdff-4f10-a8bb-9e22e01f793d-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.915721 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915724 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.916011 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915735 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.916011 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915744 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.916011 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915752 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.916011 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915764 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809df88d-fdff-4f10-a8bb-9e22e01f793d-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:34.916011 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:34.915783 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrkbg\" (UniqueName: \"kubernetes.io/projected/809df88d-fdff-4f10-a8bb-9e22e01f793d-kube-api-access-vrkbg\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:28:35.148679 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.148585 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:35.332830 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.332797 2576 generic.go:356] "Generic (PLEG): container finished" podID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerID="df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f" exitCode=0 Jul 23 15:28:35.333047 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.332864 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" Jul 23 15:28:35.333047 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.332896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" event={"ID":"809df88d-fdff-4f10-a8bb-9e22e01f793d","Type":"ContainerDied","Data":"df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f"} Jul 23 15:28:35.333047 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.332999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6" event={"ID":"809df88d-fdff-4f10-a8bb-9e22e01f793d","Type":"ContainerDied","Data":"86a6f11258b4dbce3122260c826c88b23213d7207ba44d1154b7eb0630f592f8"} Jul 23 15:28:35.333047 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.333031 2576 scope.go:117] "RemoveContainer" containerID="df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f" Jul 23 15:28:35.342965 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.342945 2576 scope.go:117] "RemoveContainer" containerID="9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0" Jul 23 15:28:35.351143 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.351123 2576 scope.go:117] "RemoveContainer" containerID="df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f" Jul 23 15:28:35.351446 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:28:35.351426 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f\": container with ID starting with df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f not found: ID does not exist" containerID="df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f" Jul 23 15:28:35.351490 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.351457 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f"} err="failed to get container status \"df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f\": rpc error: code = NotFound desc = could not find container \"df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f\": container with ID starting with df8785569858947f340c1b4363ba9cbe76fdf12d096f5dfda883dd809c7eba3f not found: ID does not exist" Jul 23 15:28:35.351490 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.351477 2576 scope.go:117] "RemoveContainer" containerID="9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0" Jul 23 15:28:35.351732 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:28:35.351710 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0\": container with ID starting with 9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0 not found: ID does not exist" containerID="9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0" Jul 23 15:28:35.351802 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.351737 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0"} err="failed to get container status \"9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0\": rpc error: code = NotFound desc = could not find container \"9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0\": container with ID starting with 9018e26cfb11b51a6a4eeb9a929314ff16196a53d274c9d398d5e4bf285208e0 not found: ID does not exist" Jul 23 15:28:35.355864 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.355839 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6"] Jul 23 15:28:35.359447 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.359423 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7f6db9fe-openshift-default-c97bfddc-vw9p6"] Jul 23 15:28:35.423756 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.423680 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" path="/var/lib/kubelet/pods/809df88d-fdff-4f10-a8bb-9e22e01f793d/volumes" Jul 23 15:28:35.707515 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.707438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:35.762602 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.762569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:35.864570 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:35.864539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:36.113723 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:36.113688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:36.178827 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:36.178792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:41.768649 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:41.768613 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:41.833131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:41.833095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:48.793641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:48.793609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:49.100074 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.099977 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4"] Jul 23 15:28:49.100472 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" Jul 23 15:28:49.100527 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100476 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" Jul 23 15:28:49.100527 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100492 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" Jul 23 15:28:49.100527 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100501 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" Jul 23 15:28:49.100527 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100514 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" Jul 23 15:28:49.100527 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100522 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d6c6385-53f7-4034-87ec-f559e9a6e2a6" containerName="istio-proxy" Jul 23 15:28:49.100753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100551 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" Jul 23 15:28:49.100753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100559 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" Jul 23 15:28:49.100753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100626 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc10fc01-a7b9-4021-9e84-e016af6c0efd" containerName="istio-proxy" Jul 23 15:28:49.100753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.100637 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" Jul 23 15:28:49.102963 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.102943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.105947 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.105928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e2bd74f9-openshift-default-dockercfg-b4fpc\"" Jul 23 15:28:49.113361 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.113338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4"] Jul 23 15:28:49.122300 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.122274 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:49.135905 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.135853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-data\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136054 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.135936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7th6\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-kube-api-access-f7th6\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136054 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.135968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-credential-socket\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136054 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.136034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-certs\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.136074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-envoy\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.136097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-token\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136184 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.136129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a502b8-23ab-4c78-bfd2-8b482c637993-istiod-ca-cert\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136295 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.136185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-podinfo\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.136295 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.136214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-socket\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.234214 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.234175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:49.237401 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-data\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237474 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7th6\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-kube-api-access-f7th6\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237474 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-credential-socket\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237474 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-certs\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-envoy\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-token\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a502b8-23ab-4c78-bfd2-8b482c637993-istiod-ca-cert\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-podinfo\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-socket\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-data\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.237965 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.237932 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-credential-socket\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.238036 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.238020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-socket\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.238094 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.238074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-certs\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.238476 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.238369 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a502b8-23ab-4c78-bfd2-8b482c637993-istiod-ca-cert\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.240201 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.240180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-envoy\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.240296 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.240264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-podinfo\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.245849 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.245813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-token\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.245994 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.245974 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7th6\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-kube-api-access-f7th6\") pod \"e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.414263 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.414181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:49.552958 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.552772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4"] Jul 23 15:28:49.555234 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:28:49.555207 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a502b8_23ab_4c78_bfd2_8b482c637993.slice/crio-40615403494f11f7e7b4008adf108892816004f45ce1f3833bc7e84344ed3cfd WatchSource:0}: Error finding container 40615403494f11f7e7b4008adf108892816004f45ce1f3833bc7e84344ed3cfd: Status 404 returned error can't find the container with id 40615403494f11f7e7b4008adf108892816004f45ce1f3833bc7e84344ed3cfd Jul 23 15:28:49.557536 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.557499 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:28:49.557617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.557585 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:28:49.557655 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:49.557626 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:28:50.399248 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:50.399213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" event={"ID":"49a502b8-23ab-4c78-bfd2-8b482c637993","Type":"ContainerStarted","Data":"a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674"} Jul 23 15:28:50.399630 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:50.399288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" event={"ID":"49a502b8-23ab-4c78-bfd2-8b482c637993","Type":"ContainerStarted","Data":"40615403494f11f7e7b4008adf108892816004f45ce1f3833bc7e84344ed3cfd"} Jul 23 15:28:50.414718 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:50.414681 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:50.420289 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:50.420263 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:50.420612 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:50.420575 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podStartSLOduration=1.4205582620000001 podStartE2EDuration="1.420558262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:28:50.418011774 +0000 UTC m=+2175.439701019" watchObservedRunningTime="2026-07-23 15:28:50.420558262 +0000 UTC m=+2175.442247509" Jul 23 15:28:51.404188 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:51.404145 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:51.405150 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:51.405132 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:28:52.399964 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:52.399927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:52.499734 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:52.499702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:52.599321 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:52.599293 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:52.955173 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:52.955139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:53.057287 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:53.057252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:53.158294 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:53.158262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:28:56.960257 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:28:56.960218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:06.571478 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:06.571333 2576 patch_prober.go:28] interesting pod/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:53020->10.133.0.30:15021: read: connection reset by peer" start-of-body= Jul 23 15:29:06.571478 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:06.571407 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:53020->10.133.0.30:15021: read: connection reset by peer" Jul 23 15:29:07.480781 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:07.480748 2576 generic.go:356] "Generic (PLEG): container finished" podID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerID="a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674" exitCode=0 Jul 23 15:29:07.481065 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:07.480830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" event={"ID":"49a502b8-23ab-4c78-bfd2-8b482c637993","Type":"ContainerDied","Data":"a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674"} Jul 23 15:29:07.481281 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:07.481267 2576 scope.go:117] "RemoveContainer" containerID="a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674" Jul 23 15:29:07.482271 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:07.482246 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:29:07.482332 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:07.482311 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:29:07.482370 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:07.482342 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:29:08.043674 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:08.043639 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:08.486918 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:08.486813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" event={"ID":"49a502b8-23ab-4c78-bfd2-8b482c637993","Type":"ContainerStarted","Data":"0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a"} Jul 23 15:29:09.415936 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:09.415899 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:29:09.416449 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:09.416029 2576 patch_prober.go:28] interesting pod/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 23 15:29:09.416449 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:09.416073 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 23 15:29:10.415269 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:10.415217 2576 patch_prober.go:28] interesting pod/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 23 15:29:10.415494 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:10.415305 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 23 15:29:11.414897 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:11.414839 2576 patch_prober.go:28] interesting pod/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 23 15:29:11.415422 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:11.414940 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 23 15:29:12.415791 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:12.415737 2576 patch_prober.go:28] interesting pod/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 23 15:29:12.416398 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:12.416362 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 23 15:29:13.423304 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:13.423274 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:29:13.423694 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:13.423534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:29:13.424224 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:13.424210 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:29:18.328278 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:18.328239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:18.383330 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:18.383285 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:46.250470 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:46.250439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:50.871643 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:50.871613 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:53.368522 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:53.368486 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:29:58.388635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:29:58.388554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:17.144552 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:17.144516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:17.245045 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:17.245015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:34.924753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:34.924716 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:35.523157 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:35.523122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:41.117277 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:41.117237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:41.217371 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:41.217334 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:41.317890 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:41.317839 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4"] Jul 23 15:30:41.318120 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:41.318079 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" containerID="cri-o://0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a" gracePeriod=30 Jul 23 15:30:41.358423 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:41.358388 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:41.601549 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:41.601514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:42.756593 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:42.756553 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:42.856640 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:42.856603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:42.957232 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:42.957184 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:43.425981 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:43.425950 2576 patch_prober.go:28] interesting pod/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 15:30:43.426148 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:43.426013 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:30:43.867269 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:43.867230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:43.966080 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:43.966042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:44.066822 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:44.066789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:45.732317 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:45.732282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:46.576041 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.575980 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:30:46.673331 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673291 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-podinfo\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673528 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-socket\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673528 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673374 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-data\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673528 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673396 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-token\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673528 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673440 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-credential-socket\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673528 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a502b8-23ab-4c78-bfd2-8b482c637993-istiod-ca-cert\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673528 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673524 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-envoy\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673854 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673576 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7th6\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-kube-api-access-f7th6\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673854 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673613 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-certs\") pod \"49a502b8-23ab-4c78-bfd2-8b482c637993\" (UID: \"49a502b8-23ab-4c78-bfd2-8b482c637993\") " Jul 23 15:30:46.673854 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673691 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:30:46.674057 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673868 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:30:46.674057 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673954 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:30:46.674057 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673965 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.674057 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.673978 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49a502b8-23ab-4c78-bfd2-8b482c637993-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:30:46.674676 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.674654 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-data" (OuterVolumeSpecName: "istio-data") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:30:46.675752 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.675730 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:30:46.675859 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.675822 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:30:46.676394 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.676373 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-token" (OuterVolumeSpecName: "istio-token") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:30:46.676470 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.676375 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-kube-api-access-f7th6" (OuterVolumeSpecName: "kube-api-access-f7th6") pod "49a502b8-23ab-4c78-bfd2-8b482c637993" (UID: "49a502b8-23ab-4c78-bfd2-8b482c637993"). InnerVolumeSpecName "kube-api-access-f7th6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:30:46.775316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775266 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775302 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775311 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775321 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a502b8-23ab-4c78-bfd2-8b482c637993-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775329 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775839 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775338 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7th6\" (UniqueName: \"kubernetes.io/projected/49a502b8-23ab-4c78-bfd2-8b482c637993-kube-api-access-f7th6\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775839 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775346 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a502b8-23ab-4c78-bfd2-8b482c637993-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.775839 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.775354 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a502b8-23ab-4c78-bfd2-8b482c637993-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:30:46.940244 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.940152 2576 generic.go:356] "Generic (PLEG): container finished" podID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerID="0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a" exitCode=0 Jul 23 15:30:46.940244 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.940203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" event={"ID":"49a502b8-23ab-4c78-bfd2-8b482c637993","Type":"ContainerDied","Data":"0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a"} Jul 23 15:30:46.940457 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.940245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" event={"ID":"49a502b8-23ab-4c78-bfd2-8b482c637993","Type":"ContainerDied","Data":"40615403494f11f7e7b4008adf108892816004f45ce1f3833bc7e84344ed3cfd"} Jul 23 15:30:46.940457 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.940273 2576 scope.go:117] "RemoveContainer" containerID="0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a" Jul 23 15:30:46.940457 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.940208 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4" Jul 23 15:30:46.949346 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.949326 2576 scope.go:117] "RemoveContainer" containerID="a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674" Jul 23 15:30:46.957987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.957965 2576 scope.go:117] "RemoveContainer" containerID="0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a" Jul 23 15:30:46.958267 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:30:46.958247 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a\": container with ID starting with 0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a not found: ID does not exist" containerID="0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a" Jul 23 15:30:46.958316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.958278 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a"} err="failed to get container status \"0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a\": rpc error: code = NotFound desc = could not find container \"0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a\": container with ID starting with 0ab94fae2d213c5c6534b9ff374e316a1c693eeeb8791121e5db11ab903b508a not found: ID does not exist" Jul 23 15:30:46.958316 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.958304 2576 scope.go:117] "RemoveContainer" containerID="a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674" Jul 23 15:30:46.958542 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:30:46.958528 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674\": container with ID starting with a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674 not found: ID does not exist" containerID="a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674" Jul 23 15:30:46.958584 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.958546 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674"} err="failed to get container status \"a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674\": rpc error: code = NotFound desc = could not find container \"a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674\": container with ID starting with a9ffaa79bc23a992e440f19b72c4ba82ceebd7404371582bd9e14097b6204674 not found: ID does not exist" Jul 23 15:30:46.963064 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.963036 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4"] Jul 23 15:30:46.966824 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:46.966801 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e2bd74f9-openshift-default-6666764dbc-srwq4"] Jul 23 15:30:47.422979 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:47.422951 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" path="/var/lib/kubelet/pods/49a502b8-23ab-4c78-bfd2-8b482c637993/volumes" Jul 23 15:30:51.545807 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:51.545769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:51.647374 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:51.647316 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:52.295843 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:52.295788 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:58.451009 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:58.450967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:58.552399 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:58.552365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:30:58.654008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:30:58.653978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:09.275466 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:09.275427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:09.720152 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:09.720057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:30.827832 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:30.827727 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:37.302132 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:37.302096 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:37.402423 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:37.402389 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:37.673513 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:37.673421 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:38.001170 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001091 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt"] Jul 23 15:31:38.001416 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001404 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" Jul 23 15:31:38.001465 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001417 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" Jul 23 15:31:38.001465 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001426 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" Jul 23 15:31:38.001465 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001431 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" Jul 23 15:31:38.001572 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001493 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" Jul 23 15:31:38.001572 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001503 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809df88d-fdff-4f10-a8bb-9e22e01f793d" containerName="istio-proxy" Jul 23 15:31:38.001572 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.001511 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="49a502b8-23ab-4c78-bfd2-8b482c637993" containerName="istio-proxy" Jul 23 15:31:38.005520 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.005502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.008500 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.008482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ec2b36-openshift-default-dockercfg-tspz8\"" Jul 23 15:31:38.015207 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.015176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt"] Jul 23 15:31:38.031407 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.031380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:38.121456 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58511469-07f4-431b-a46d-96e815ac2769-istiod-ca-cert\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-certs\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-data\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w85pl\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-kube-api-access-w85pl\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-credential-socket\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-istio-token\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121818 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-envoy\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121818 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58511469-07f4-431b-a46d-96e815ac2769-istio-podinfo\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.121818 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.121689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-socket\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223130 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-istio-token\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223130 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-envoy\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223359 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58511469-07f4-431b-a46d-96e815ac2769-istio-podinfo\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223359 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-socket\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223464 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58511469-07f4-431b-a46d-96e815ac2769-istiod-ca-cert\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223464 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-certs\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223464 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-data\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w85pl\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-kube-api-access-w85pl\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-credential-socket\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.223814 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-socket\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.224126 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.223950 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-credential-socket\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.224126 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.224098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-certs\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.224267 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.224160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58511469-07f4-431b-a46d-96e815ac2769-istiod-ca-cert\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.224267 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.224223 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-data\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.225742 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.225721 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-envoy\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.225848 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.225831 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58511469-07f4-431b-a46d-96e815ac2769-istio-podinfo\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.232160 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.232133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-istio-token\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.232260 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.232131 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w85pl\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-kube-api-access-w85pl\") pod \"e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.316493 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.316461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:38.456668 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.456642 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt"] Jul 23 15:31:38.458774 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:31:38.458747 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58511469_07f4_431b_a46d_96e815ac2769.slice/crio-69d4b7354cf97d2665b3765078c7ce74b4ddf86aa05b19a58f93288445da4159 WatchSource:0}: Error finding container 69d4b7354cf97d2665b3765078c7ce74b4ddf86aa05b19a58f93288445da4159: Status 404 returned error can't find the container with id 69d4b7354cf97d2665b3765078c7ce74b4ddf86aa05b19a58f93288445da4159 Jul 23 15:31:38.460803 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.460774 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:38.460920 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.460841 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:38.460920 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.460868 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:38.486916 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:38.486850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:39.171067 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:39.171029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" event={"ID":"58511469-07f4-431b-a46d-96e815ac2769","Type":"ContainerStarted","Data":"c90dac839ff9d94968633aaa2f16100c9ac744daf71430ee714cb1a9244fe0da"} Jul 23 15:31:39.171259 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:39.171089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" event={"ID":"58511469-07f4-431b-a46d-96e815ac2769","Type":"ContainerStarted","Data":"69d4b7354cf97d2665b3765078c7ce74b4ddf86aa05b19a58f93288445da4159"} Jul 23 15:31:39.193459 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:39.193406 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podStartSLOduration=2.193390786 podStartE2EDuration="2.193390786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:31:39.193292665 +0000 UTC m=+2344.214981915" watchObservedRunningTime="2026-07-23 15:31:39.193390786 +0000 UTC m=+2344.215080010" Jul 23 15:31:39.316891 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:39.316834 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:39.322346 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:39.322319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:40.175312 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:40.175285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:40.176281 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:40.176256 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:41.232806 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:41.232775 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:41.334360 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:41.334331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:41.448609 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:41.448572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:41.886969 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:41.886935 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:41.992924 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:41.992862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:45.822055 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:45.822022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:46.254202 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.254109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:46.521760 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.521730 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm"] Jul 23 15:31:46.525034 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.525014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.528251 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.528227 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5c302e-openshift-default-dockercfg-9rdb7\"" Jul 23 15:31:46.541763 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.541730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm"] Jul 23 15:31:46.565942 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.565905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:46.607577 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.607536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-socket\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.607752 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.607613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-data\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.607752 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.607638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgvg\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-kube-api-access-4fgvg\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.607752 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.607737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-envoy\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.607931 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.607855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-token\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.608008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.607989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-certs\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.608050 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.608023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istiod-ca-cert\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.608101 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.608058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-credential-socket\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.608157 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.608114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-podinfo\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709065 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-credential-socket\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709065 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-podinfo\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709324 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-socket\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709324 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-data\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709324 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgvg\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-kube-api-access-4fgvg\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709324 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-envoy\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709324 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-token\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709551 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-certs\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709551 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istiod-ca-cert\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709551 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709502 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-credential-socket\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709713 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709688 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-socket\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-data\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.709836 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.709821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-certs\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.710741 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.710713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istiod-ca-cert\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.711858 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.711836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-envoy\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.712008 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.711993 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-podinfo\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.717791 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.717768 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-token\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.718021 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.718002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgvg\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-kube-api-access-4fgvg\") pod \"e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.836619 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.836532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:46.881581 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.881545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:46.983598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.983574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm"] Jul 23 15:31:46.986398 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:31:46.986370 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d0ebcb_86ea_4a90_b5f6_449d49449b13.slice/crio-365bf59d34c96354e3546167407fef712d4e6b169927582c5a7fef7278969ba9 WatchSource:0}: Error finding container 365bf59d34c96354e3546167407fef712d4e6b169927582c5a7fef7278969ba9: Status 404 returned error can't find the container with id 365bf59d34c96354e3546167407fef712d4e6b169927582c5a7fef7278969ba9 Jul 23 15:31:46.988723 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.988682 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:46.988804 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.988773 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:46.988841 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:46.988814 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:47.207336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:47.207188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" event={"ID":"88d0ebcb-86ea-4a90-b5f6-449d49449b13","Type":"ContainerStarted","Data":"6d9ec858a2969f0d458f9ede11a790488af387b03f19a27dba44c97e5dca5c28"} Jul 23 15:31:47.207336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:47.207242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" event={"ID":"88d0ebcb-86ea-4a90-b5f6-449d49449b13","Type":"ContainerStarted","Data":"365bf59d34c96354e3546167407fef712d4e6b169927582c5a7fef7278969ba9"} Jul 23 15:31:47.837532 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:47.837498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:48.841983 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:48.841954 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:48.864556 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:48.864495 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podStartSLOduration=2.864477233 podStartE2EDuration="2.864477233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:31:47.243368197 +0000 UTC m=+2352.265057446" watchObservedRunningTime="2026-07-23 15:31:48.864477233 +0000 UTC m=+2353.886166477" Jul 23 15:31:49.216424 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.216334 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:49.217356 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.217327 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:31:49.302826 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.302793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:49.380004 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.379964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:49.452688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.452646 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:49.561045 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.561009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:49.975151 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:49.975061 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:50.074321 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:50.074287 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:53.841787 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:53.841683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:31:56.217038 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:56.217010 2576 patch_prober.go:28] interesting pod/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 23 15:31:56.228971 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:56.217061 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 23 15:31:57.254265 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:57.254232 2576 generic.go:356] "Generic (PLEG): container finished" podID="58511469-07f4-431b-a46d-96e815ac2769" containerID="c90dac839ff9d94968633aaa2f16100c9ac744daf71430ee714cb1a9244fe0da" exitCode=0 Jul 23 15:31:57.254658 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:57.254301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" event={"ID":"58511469-07f4-431b-a46d-96e815ac2769","Type":"ContainerDied","Data":"c90dac839ff9d94968633aaa2f16100c9ac744daf71430ee714cb1a9244fe0da"} Jul 23 15:31:57.254711 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:57.254697 2576 scope.go:117] "RemoveContainer" containerID="c90dac839ff9d94968633aaa2f16100c9ac744daf71430ee714cb1a9244fe0da" Jul 23 15:31:57.255699 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:57.255675 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:57.255754 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:57.255741 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:57.255801 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:57.255773 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:31:58.260929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:58.260897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" event={"ID":"58511469-07f4-431b-a46d-96e815ac2769","Type":"ContainerStarted","Data":"bc7da5a390ff78c13b5cd892535690441351930a88610c923d3e27aa59866ee1"} Jul 23 15:31:58.317291 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:58.317243 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:31:58.317737 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:58.317704 2576 patch_prober.go:28] interesting pod/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 23 15:31:58.317852 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:58.317765 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 23 15:31:59.317275 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:59.317225 2576 patch_prober.go:28] interesting pod/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 23 15:31:59.317801 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:31:59.317299 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 23 15:32:00.317039 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:00.316992 2576 patch_prober.go:28] interesting pod/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 23 15:32:00.317253 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:00.317071 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 23 15:32:01.317431 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:01.317391 2576 patch_prober.go:28] interesting pod/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 23 15:32:01.317955 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:01.317459 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 23 15:32:02.320282 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:02.320249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:32:02.320714 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:02.320645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:32:02.321438 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:02.321419 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:32:02.729058 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:02.729022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:32:02.829650 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:02.829605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:32:03.546077 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:03.546043 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:32:04.218547 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.218509 2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 23 15:32:04.218722 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.218572 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 23 15:32:04.298336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.298306 2576 generic.go:356] "Generic (PLEG): container finished" podID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerID="6d9ec858a2969f0d458f9ede11a790488af387b03f19a27dba44c97e5dca5c28" exitCode=0 Jul 23 15:32:04.298508 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.298384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" event={"ID":"88d0ebcb-86ea-4a90-b5f6-449d49449b13","Type":"ContainerDied","Data":"6d9ec858a2969f0d458f9ede11a790488af387b03f19a27dba44c97e5dca5c28"} Jul 23 15:32:04.298922 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.298862 2576 scope.go:117] "RemoveContainer" containerID="6d9ec858a2969f0d458f9ede11a790488af387b03f19a27dba44c97e5dca5c28" Jul 23 15:32:04.299953 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.299926 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:32:04.300042 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.300024 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:32:04.300088 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:04.300073 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:32:05.306848 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:05.306810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" event={"ID":"88d0ebcb-86ea-4a90-b5f6-449d49449b13","Type":"ContainerStarted","Data":"57394bb54f6c72b40e903f64ebb3cd37a2d75ce5bc775bb3574715dc63c41aea"} Jul 23 15:32:05.837592 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:05.837553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:32:05.837802 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:05.837782 2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 23 15:32:05.837855 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:05.837839 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 23 15:32:06.837195 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:06.837163 2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 23 15:32:06.837590 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:06.837217 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 23 15:32:07.837263 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:07.837222 2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 23 15:32:07.837657 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:07.837288 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 23 15:32:08.837501 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:08.837464 2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 23 15:32:08.837902 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:08.837515 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 23 15:32:09.841961 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:09.841931 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:32:09.842350 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:09.842190 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:32:09.842951 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:09.842930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:32:11.946362 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:11.946323 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:32:12.046994 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:12.046962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:32:22.168369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:22.168336 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:32:35.503196 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:35.503168 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:32:35.509075 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:32:35.509056 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:33:03.746754 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:03.746721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:04.742254 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:04.742216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:05.429004 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:05.428968 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:05.530510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:05.530477 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:15.405170 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:15.405133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:19.986430 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:19.986396 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:20.426163 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:20.426127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:26.263919 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:26.263855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:26.545296 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:26.545212 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt"] Jul 23 15:33:26.545451 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:26.545417 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" containerID="cri-o://bc7da5a390ff78c13b5cd892535690441351930a88610c923d3e27aa59866ee1" gracePeriod=30 Jul 23 15:33:27.770189 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:27.770152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:31.706571 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:31.706534 2576 generic.go:356] "Generic (PLEG): container finished" podID="58511469-07f4-431b-a46d-96e815ac2769" containerID="bc7da5a390ff78c13b5cd892535690441351930a88610c923d3e27aa59866ee1" exitCode=0 Jul 23 15:33:31.707053 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:31.706602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" event={"ID":"58511469-07f4-431b-a46d-96e815ac2769","Type":"ContainerDied","Data":"bc7da5a390ff78c13b5cd892535690441351930a88610c923d3e27aa59866ee1"} Jul 23 15:33:31.707053 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:31.706665 2576 scope.go:117] "RemoveContainer" containerID="c90dac839ff9d94968633aaa2f16100c9ac744daf71430ee714cb1a9244fe0da" Jul 23 15:33:31.811052 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:31.810990 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:33:32.007025 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.006987 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-envoy\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007062 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-istio-token\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007092 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w85pl\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-kube-api-access-w85pl\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007149 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-data\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007180 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-credential-socket\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007223 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58511469-07f4-431b-a46d-96e815ac2769-istio-podinfo\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007501 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007271 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-socket\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007501 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007302 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58511469-07f4-431b-a46d-96e815ac2769-istiod-ca-cert\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007501 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-certs\") pod \"58511469-07f4-431b-a46d-96e815ac2769\" (UID: \"58511469-07f4-431b-a46d-96e815ac2769\") " Jul 23 15:33:32.007669 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007519 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:32.007728 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007679 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.007795 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.007734 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:32.008152 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.008128 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:32.008251 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.008212 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58511469-07f4-431b-a46d-96e815ac2769-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:33:32.008333 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.008302 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-data" (OuterVolumeSpecName: "istio-data") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:32.009550 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.009521 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:32.009654 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.009548 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-istio-token" (OuterVolumeSpecName: "istio-token") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:33:32.009654 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.009604 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-kube-api-access-w85pl" (OuterVolumeSpecName: "kube-api-access-w85pl") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "kube-api-access-w85pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:33:32.009654 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.009636 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58511469-07f4-431b-a46d-96e815ac2769-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58511469-07f4-431b-a46d-96e815ac2769" (UID: "58511469-07f4-431b-a46d-96e815ac2769"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109013 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109044 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109053 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109065 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w85pl\" (UniqueName: \"kubernetes.io/projected/58511469-07f4-431b-a46d-96e815ac2769-kube-api-access-w85pl\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109074 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109082 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58511469-07f4-431b-a46d-96e815ac2769-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109091 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58511469-07f4-431b-a46d-96e815ac2769-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.109105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.109100 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58511469-07f4-431b-a46d-96e815ac2769-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:32.712858 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.712821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" event={"ID":"58511469-07f4-431b-a46d-96e815ac2769","Type":"ContainerDied","Data":"69d4b7354cf97d2665b3765078c7ce74b4ddf86aa05b19a58f93288445da4159"} Jul 23 15:33:32.712858 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.712849 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt" Jul 23 15:33:32.713412 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.712904 2576 scope.go:117] "RemoveContainer" containerID="bc7da5a390ff78c13b5cd892535690441351930a88610c923d3e27aa59866ee1" Jul 23 15:33:32.735173 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.735140 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt"] Jul 23 15:33:32.741110 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:32.741080 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ec2b36-openshift-default-84656fb755-n9kmt"] Jul 23 15:33:33.424020 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:33.423991 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58511469-07f4-431b-a46d-96e815ac2769" path="/var/lib/kubelet/pods/58511469-07f4-431b-a46d-96e815ac2769/volumes" Jul 23 15:33:37.355642 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:37.355603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:42.030306 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:42.030271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:42.446181 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:42.446085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:48.308494 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:48.308462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:48.374435 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:48.374398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:48.587490 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:48.587399 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm"] Jul 23 15:33:48.587746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:48.587695 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" containerID="cri-o://57394bb54f6c72b40e903f64ebb3cd37a2d75ce5bc775bb3574715dc63c41aea" gracePeriod=30 Jul 23 15:33:48.613630 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:48.613598 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:48.871349 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:48.871255 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:49.266719 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.266690 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:49.576439 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.576359 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck"] Jul 23 15:33:49.576849 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.576834 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" Jul 23 15:33:49.576913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.576853 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" Jul 23 15:33:49.576913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.576901 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" Jul 23 15:33:49.576981 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.576912 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" Jul 23 15:33:49.577020 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.577014 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" Jul 23 15:33:49.577053 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.577025 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58511469-07f4-431b-a46d-96e815ac2769" containerName="istio-proxy" Jul 23 15:33:49.580154 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.580136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.583001 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.582974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fdfc03-openshift-default-dockercfg-6bv7w\"" Jul 23 15:33:49.589385 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.589359 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck"] Jul 23 15:33:49.648652 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-socket\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.648652 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-credential-socket\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.648900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-token\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.648900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnksh\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-kube-api-access-mnksh\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.648900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-envoy\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.648900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-certs\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.648900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-podinfo\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.649074 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-data\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.649074 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.648959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istiod-ca-cert\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.749986 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.749931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-socket\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750175 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-credential-socket\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750175 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-token\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750175 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnksh\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-kube-api-access-mnksh\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750175 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-envoy\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750175 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-certs\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750455 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-podinfo\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750455 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-data\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750455 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istiod-ca-cert\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-socket\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-credential-socket\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750521 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-certs\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.750764 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.750667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-data\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.751063 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.751042 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istiod-ca-cert\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.752759 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.752736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-podinfo\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.752863 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.752740 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-envoy\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.758519 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.758494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-token\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.758683 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.758663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnksh\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-kube-api-access-mnksh\") pod \"e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:49.892688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:49.892593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:50.038280 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.038246 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck"] Jul 23 15:33:50.040823 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:33:50.040795 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5863ba_9543_4531_bb9c_bf3a81c6b69f.slice/crio-e61096cfc29c957754d5bc92e07cfc0856f9244929808f7c3f21a2559337954c WatchSource:0}: Error finding container e61096cfc29c957754d5bc92e07cfc0856f9244929808f7c3f21a2559337954c: Status 404 returned error can't find the container with id e61096cfc29c957754d5bc92e07cfc0856f9244929808f7c3f21a2559337954c Jul 23 15:33:50.043162 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.043132 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:33:50.043235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.043201 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:33:50.043235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.043231 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:33:50.535630 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.535590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:50.601115 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.601074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:50.799900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.799781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" event={"ID":"4c5863ba-9543-4531-bb9c-bf3a81c6b69f","Type":"ContainerStarted","Data":"eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c"} Jul 23 15:33:50.799900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.799849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" event={"ID":"4c5863ba-9543-4531-bb9c-bf3a81c6b69f","Type":"ContainerStarted","Data":"e61096cfc29c957754d5bc92e07cfc0856f9244929808f7c3f21a2559337954c"} Jul 23 15:33:50.822775 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.822719 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" podStartSLOduration=1.822701603 podStartE2EDuration="1.822701603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:33:50.820625751 +0000 UTC m=+2475.842314998" watchObservedRunningTime="2026-07-23 15:33:50.822701603 +0000 UTC m=+2475.844390848" Jul 23 15:33:50.893440 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:50.893402 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:51.897995 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:51.897967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:52.808797 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:52.808763 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:52.809748 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:52.809726 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:33:52.865086 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:52.865051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:52.963930 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:52.963899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:53.113132 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.113006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:53.246777 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.246737 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:53.720133 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.720097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:53.816075 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.816046 2576 generic.go:356] "Generic (PLEG): container finished" podID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerID="57394bb54f6c72b40e903f64ebb3cd37a2d75ce5bc775bb3574715dc63c41aea" exitCode=0 Jul 23 15:33:53.816250 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.816117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" event={"ID":"88d0ebcb-86ea-4a90-b5f6-449d49449b13","Type":"ContainerDied","Data":"57394bb54f6c72b40e903f64ebb3cd37a2d75ce5bc775bb3574715dc63c41aea"} Jul 23 15:33:53.816250 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.816179 2576 scope.go:117] "RemoveContainer" containerID="6d9ec858a2969f0d458f9ede11a790488af387b03f19a27dba44c97e5dca5c28" Jul 23 15:33:53.817953 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.817865 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:53.857615 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.857529 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:33:53.991036 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991003 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fgvg\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-kube-api-access-4fgvg\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991073 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-data\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-token\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991135 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-envoy\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991150 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-certs\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991172 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istiod-ca-cert\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-credential-socket\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991234 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-socket\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-podinfo\") pod \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\" (UID: \"88d0ebcb-86ea-4a90-b5f6-449d49449b13\") " Jul 23 15:33:53.991530 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991476 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:53.992192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991640 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:53.992192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991645 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:53.992192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991826 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:53.992192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.991853 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:33:53.992192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.992106 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-data" (OuterVolumeSpecName: "istio-data") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:53.993567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.993541 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-token" (OuterVolumeSpecName: "istio-token") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:33:53.993683 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.993640 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-kube-api-access-4fgvg" (OuterVolumeSpecName: "kube-api-access-4fgvg") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "kube-api-access-4fgvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:33:53.994016 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.993993 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:33:53.994081 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:53.994047 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88d0ebcb-86ea-4a90-b5f6-449d49449b13" (UID: "88d0ebcb-86ea-4a90-b5f6-449d49449b13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:33:54.092285 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092243 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fgvg\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-kube-api-access-4fgvg\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092285 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092278 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092285 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092288 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092285 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092295 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092574 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092303 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092574 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092311 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092574 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092320 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d0ebcb-86ea-4a90-b5f6-449d49449b13-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.092574 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.092328 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d0ebcb-86ea-4a90-b5f6-449d49449b13-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:33:54.821941 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.821902 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" event={"ID":"88d0ebcb-86ea-4a90-b5f6-449d49449b13","Type":"ContainerDied","Data":"365bf59d34c96354e3546167407fef712d4e6b169927582c5a7fef7278969ba9"} Jul 23 15:33:54.821941 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.821926 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm" Jul 23 15:33:54.822198 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.821966 2576 scope.go:117] "RemoveContainer" containerID="57394bb54f6c72b40e903f64ebb3cd37a2d75ce5bc775bb3574715dc63c41aea" Jul 23 15:33:54.843327 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.843292 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm"] Jul 23 15:33:54.847270 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:54.847241 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5c302e-openshift-default-796d97c46c-sg7mm"] Jul 23 15:33:55.423045 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:55.423011 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" path="/var/lib/kubelet/pods/88d0ebcb-86ea-4a90-b5f6-449d49449b13/volumes" Jul 23 15:33:57.469558 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:57.469526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:58.317212 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.317178 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd"] Jul 23 15:33:58.318120 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.318085 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" Jul 23 15:33:58.318283 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.318270 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" Jul 23 15:33:58.318405 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.318394 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" Jul 23 15:33:58.318508 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.318498 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" Jul 23 15:33:58.318712 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.318699 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" Jul 23 15:33:58.318828 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.318817 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d0ebcb-86ea-4a90-b5f6-449d49449b13" containerName="istio-proxy" Jul 23 15:33:58.326708 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.326680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.330149 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.330117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8bca8c-openshift-default-dockercfg-wrc8j\"" Jul 23 15:33:58.331960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.331931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd"] Jul 23 15:33:58.432484 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-envoy\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432675 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-certs\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432675 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-data\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432675 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-token\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432815 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istiod-ca-cert\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432815 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6j4\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-kube-api-access-wp6j4\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432815 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-socket\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-podinfo\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.432987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.432855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-credential-socket\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.437671 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.437648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:58.534226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-certs\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-data\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-token\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istiod-ca-cert\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6j4\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-kube-api-access-wp6j4\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-socket\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-podinfo\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-credential-socket\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-envoy\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-certs\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.534765 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-data\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.535266 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.534899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-credential-socket\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.535266 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.535025 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-socket\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.535266 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.535188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istiod-ca-cert\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.536949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.536925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-envoy\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.537126 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.537103 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-podinfo\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.538128 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.538101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:33:58.542686 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.542651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-token\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.542784 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.542764 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6j4\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-kube-api-access-wp6j4\") pod \"e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.639985 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.639860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:33:58.816898 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.814122 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd"] Jul 23 15:33:58.819194 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:33:58.819159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71472e9_8bf3_424c_8a24_b7bf4088cdf3.slice/crio-d8c55af0592e0863dc0185f5e500e57a056a749d81c2dc051c410b63311d72f8 WatchSource:0}: Error finding container d8c55af0592e0863dc0185f5e500e57a056a749d81c2dc051c410b63311d72f8: Status 404 returned error can't find the container with id d8c55af0592e0863dc0185f5e500e57a056a749d81c2dc051c410b63311d72f8 Jul 23 15:33:58.822146 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.822106 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:33:58.822248 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.822197 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:33:58.822248 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.822241 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:33:58.844900 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:58.844851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" event={"ID":"b71472e9-8bf3-424c-8a24-b7bf4088cdf3","Type":"ContainerStarted","Data":"d8c55af0592e0863dc0185f5e500e57a056a749d81c2dc051c410b63311d72f8"} Jul 23 15:33:59.851841 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:59.851805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" event={"ID":"b71472e9-8bf3-424c-8a24-b7bf4088cdf3","Type":"ContainerStarted","Data":"4764c0842e8007d07cfefedacc52915258f4a4c5c0064bb804fd13570e0d35c7"} Jul 23 15:33:59.873089 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:33:59.873031 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podStartSLOduration=1.873013687 podStartE2EDuration="1.873013687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:33:59.871406586 +0000 UTC m=+2484.893095855" watchObservedRunningTime="2026-07-23 15:33:59.873013687 +0000 UTC m=+2484.894702987" Jul 23 15:34:00.640999 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:00.640957 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:00.646115 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:00.646087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:00.857276 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:00.857240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:00.858403 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:00.858383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:01.845570 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:01.845526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:01.947475 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:01.947437 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:02.010292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:02.010260 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:02.215464 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:02.215357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:02.323328 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:02.323291 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:02.929091 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:02.929051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:02.983192 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:02.983089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:04.878111 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:04.878081 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerID="eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c" exitCode=0 Jul 23 15:34:04.878546 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:04.878154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" event={"ID":"4c5863ba-9543-4531-bb9c-bf3a81c6b69f","Type":"ContainerDied","Data":"eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c"} Jul 23 15:34:04.878591 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:04.878556 2576 scope.go:117] "RemoveContainer" containerID="eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c" Jul 23 15:34:04.879653 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:04.879625 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:34:04.879783 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:04.879707 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:34:04.879783 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:04.879763 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:34:05.885480 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:05.885448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" event={"ID":"4c5863ba-9543-4531-bb9c-bf3a81c6b69f","Type":"ContainerStarted","Data":"350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be"} Jul 23 15:34:05.893291 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:05.893256 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:34:05.894394 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:05.894358 2576 patch_prober.go:28] interesting pod/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 23 15:34:05.894533 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:05.894424 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 23 15:34:06.463641 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:06.463613 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:06.893688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:06.893650 2576 patch_prober.go:28] interesting pod/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 23 15:34:06.894369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:06.894336 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 23 15:34:07.809185 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:07.809143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:34:07.896583 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:07.896540 2576 patch_prober.go:28] interesting pod/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 23 15:34:07.897130 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:07.896620 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 23 15:34:08.894099 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:08.894051 2576 patch_prober.go:28] interesting pod/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 23 15:34:08.894313 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:08.894142 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 23 15:34:09.896934 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:09.896903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:34:09.897786 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:09.897768 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:34:15.081203 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:15.081168 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:15.179567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:15.179512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:19.965580 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:19.965489 2576 generic.go:356] "Generic (PLEG): container finished" podID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerID="4764c0842e8007d07cfefedacc52915258f4a4c5c0064bb804fd13570e0d35c7" exitCode=0 Jul 23 15:34:19.965580 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:19.965565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" event={"ID":"b71472e9-8bf3-424c-8a24-b7bf4088cdf3","Type":"ContainerDied","Data":"4764c0842e8007d07cfefedacc52915258f4a4c5c0064bb804fd13570e0d35c7"} Jul 23 15:34:19.966035 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:19.966016 2576 scope.go:117] "RemoveContainer" containerID="4764c0842e8007d07cfefedacc52915258f4a4c5c0064bb804fd13570e0d35c7" Jul 23 15:34:19.967053 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:19.967025 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:34:19.967162 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:19.967097 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:34:19.967162 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:19.967130 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:34:20.972088 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:20.972053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" event={"ID":"b71472e9-8bf3-424c-8a24-b7bf4088cdf3","Type":"ContainerStarted","Data":"8621ffd08ee31887f8239b9b9854b680d78341f11cb5ebd20e71ed94380af7c1"} Jul 23 15:34:21.640949 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:21.640914 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:21.641255 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:21.641233 2576 patch_prober.go:28] interesting pod/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 23 15:34:21.641302 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:21.641282 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 23 15:34:22.640762 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:22.640720 2576 patch_prober.go:28] interesting pod/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 23 15:34:22.641185 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:22.640799 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 23 15:34:23.320260 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:23.320225 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:23.418145 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:23.418108 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:23.641230 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:23.641133 2576 patch_prober.go:28] interesting pod/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 23 15:34:23.641230 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:23.641192 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 23 15:34:24.640465 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:24.640422 2576 patch_prober.go:28] interesting pod/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 23 15:34:24.640653 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:24.640499 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 23 15:34:25.386200 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:25.386154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:25.487453 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:25.487421 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:25.644693 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:25.644601 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:25.644926 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:25.644904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:25.645467 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:25.645450 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:34:30.626717 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:30.626637 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:34.953964 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:34.953924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:35.386278 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:35.386242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:40.998603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:40.998564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:41.099434 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:41.099400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:41.277068 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:41.277030 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck"] Jul 23 15:34:41.277326 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:41.277302 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" containerID="cri-o://350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be" gracePeriod=30 Jul 23 15:34:41.304903 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:41.304861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:41.561379 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:41.561283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:42.193103 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:42.193062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:42.293760 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:42.293721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:34:46.522228 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.522197 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:34:46.586681 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.586595 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnksh\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-kube-api-access-mnksh\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.586681 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.586681 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-token\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.586928 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.586706 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-socket\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.586928 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.586730 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-podinfo\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.586928 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.586897 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-credential-socket\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.587095 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587003 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-envoy\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.587095 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587043 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-certs\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.587095 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587066 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-data\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.587095 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istiod-ca-cert\") pod \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\" (UID: \"4c5863ba-9543-4531-bb9c-bf3a81c6b69f\") " Jul 23 15:34:46.587302 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587088 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:34:46.587302 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587174 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:34:46.587406 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587316 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:34:46.588544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587489 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:34:46.588544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587643 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.588544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587667 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.588544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587681 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.588544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.587698 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.588544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.588507 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:34:46.589171 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.589146 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-kube-api-access-mnksh" (OuterVolumeSpecName: "kube-api-access-mnksh") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "kube-api-access-mnksh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:34:46.589436 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.589410 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:34:46.589580 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.589565 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:34:46.589621 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.589607 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c5863ba-9543-4531-bb9c-bf3a81c6b69f" (UID: "4c5863ba-9543-4531-bb9c-bf3a81c6b69f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:34:46.688820 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.688779 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.688820 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.688816 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.688820 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.688827 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.689101 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.688838 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:46.689101 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:46.688850 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnksh\" (UniqueName: \"kubernetes.io/projected/4c5863ba-9543-4531-bb9c-bf3a81c6b69f-kube-api-access-mnksh\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:34:47.089019 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.088986 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerID="350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be" exitCode=0 Jul 23 15:34:47.089019 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.089025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" event={"ID":"4c5863ba-9543-4531-bb9c-bf3a81c6b69f","Type":"ContainerDied","Data":"350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be"} Jul 23 15:34:47.089248 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.089035 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" Jul 23 15:34:47.089248 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.089076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck" event={"ID":"4c5863ba-9543-4531-bb9c-bf3a81c6b69f","Type":"ContainerDied","Data":"e61096cfc29c957754d5bc92e07cfc0856f9244929808f7c3f21a2559337954c"} Jul 23 15:34:47.089248 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.089099 2576 scope.go:117] "RemoveContainer" containerID="350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be" Jul 23 15:34:47.098287 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.098265 2576 scope.go:117] "RemoveContainer" containerID="eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c" Jul 23 15:34:47.106157 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.106139 2576 scope.go:117] "RemoveContainer" containerID="350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be" Jul 23 15:34:47.106413 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:34:47.106392 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be\": container with ID starting with 350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be not found: ID does not exist" containerID="350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be" Jul 23 15:34:47.106485 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.106426 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be"} err="failed to get container status \"350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be\": rpc error: code = NotFound desc = could not find container \"350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be\": container with ID starting with 350297fe8e3dae1ba2220f43187da59e6f162d8115ec7106b848c02afe1a68be not found: ID does not exist" Jul 23 15:34:47.106485 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.106451 2576 scope.go:117] "RemoveContainer" containerID="eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c" Jul 23 15:34:47.106682 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:34:47.106665 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c\": container with ID starting with eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c not found: ID does not exist" containerID="eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c" Jul 23 15:34:47.106732 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.106690 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c"} err="failed to get container status \"eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c\": rpc error: code = NotFound desc = could not find container \"eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c\": container with ID starting with eae0e2678a0237e8d7d24d773dd2688d42325727ab449241efaad529c8c94a9c not found: ID does not exist" Jul 23 15:34:47.110341 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.110317 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck"] Jul 23 15:34:47.114372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.114351 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fdfc03-openshift-default-74f6fc76bc-qtcck"] Jul 23 15:34:47.423996 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:47.423903 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" path="/var/lib/kubelet/pods/4c5863ba-9543-4531-bb9c-bf3a81c6b69f/volumes" Jul 23 15:34:57.106139 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:34:57.106105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:01.762938 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:01.762905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:02.190403 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:02.190374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:07.793938 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:07.793896 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:07.853161 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:07.853123 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:08.074531 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:08.074438 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd"] Jul 23 15:35:08.074710 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:08.074689 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" containerID="cri-o://8621ffd08ee31887f8239b9b9854b680d78341f11cb5ebd20e71ed94380af7c1" gracePeriod=30 Jul 23 15:35:08.136517 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:08.136481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:08.360352 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:08.360272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:08.758193 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:08.758101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:09.080737 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.080695 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2"] Jul 23 15:35:09.081235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.081109 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" Jul 23 15:35:09.081235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.081125 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" Jul 23 15:35:09.081235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.081132 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" Jul 23 15:35:09.081235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.081137 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" Jul 23 15:35:09.081235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.081203 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" Jul 23 15:35:09.081235 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.081210 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c5863ba-9543-4531-bb9c-bf3a81c6b69f" containerName="istio-proxy" Jul 23 15:35:09.085749 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.085729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.088705 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.088683 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d3e0e7-openshift-default-dockercfg-g66bg\"" Jul 23 15:35:09.094774 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.094753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2"] Jul 23 15:35:09.099943 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.099919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:09.190589 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-socket\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.190785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-credential-socket\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.190785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hvq\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-kube-api-access-98hvq\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.190785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-envoy\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.190785 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-token\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.191056 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3300244b-dbb4-43c3-a8da-6ca285a719d2-istiod-ca-cert\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.191056 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.190949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-certs\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.191056 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.191005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-data\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.191056 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.191045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-podinfo\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.291903 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.291836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-certs\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292102 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.291914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-data\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292102 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.291950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-podinfo\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292102 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-socket\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292102 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-credential-socket\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292102 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hvq\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-kube-api-access-98hvq\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-envoy\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-certs\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-token\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3300244b-dbb4-43c3-a8da-6ca285a719d2-istiod-ca-cert\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292426 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-credential-socket\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-socket\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292533 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-data\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.292996 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.292979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3300244b-dbb4-43c3-a8da-6ca285a719d2-istiod-ca-cert\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.294627 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.294597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-envoy\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.294981 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.294959 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-podinfo\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.300496 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.300472 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-token\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.300591 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.300562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hvq\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-kube-api-access-98hvq\") pod \"e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.304980 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.304957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:09.396747 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.396659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:09.544351 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.544229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2"] Jul 23 15:35:09.547025 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.546988 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:09.547131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.547066 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:09.547131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:09.547103 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:10.196656 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.196621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" event={"ID":"3300244b-dbb4-43c3-a8da-6ca285a719d2","Type":"ContainerStarted","Data":"96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503"} Jul 23 15:35:10.197070 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.196675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" event={"ID":"3300244b-dbb4-43c3-a8da-6ca285a719d2","Type":"ContainerStarted","Data":"17724cd2a78da2c6e3e14bdc1878e8d77336215391df65ce197a3b663f5e7211"} Jul 23 15:35:10.219973 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.219916 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podStartSLOduration=1.219898379 podStartE2EDuration="1.219898379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:35:10.2175378 +0000 UTC m=+2555.239227044" watchObservedRunningTime="2026-07-23 15:35:10.219898379 +0000 UTC m=+2555.241587624" Jul 23 15:35:10.397115 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.397075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:10.402039 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.402016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:10.647919 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.647863 2576 patch_prober.go:28] interesting pod/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 15:35:10.648090 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:10.647953 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:35:11.201243 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:11.201211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:11.202097 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:11.202076 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:12.212787 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:12.212752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:12.313460 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:12.313420 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:13.213401 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.213369 2576 generic.go:356] "Generic (PLEG): container finished" podID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerID="8621ffd08ee31887f8239b9b9854b680d78341f11cb5ebd20e71ed94380af7c1" exitCode=0 Jul 23 15:35:13.213794 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.213448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" event={"ID":"b71472e9-8bf3-424c-8a24-b7bf4088cdf3","Type":"ContainerDied","Data":"8621ffd08ee31887f8239b9b9854b680d78341f11cb5ebd20e71ed94380af7c1"} Jul 23 15:35:13.213794 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.213513 2576 scope.go:117] "RemoveContainer" containerID="4764c0842e8007d07cfefedacc52915258f4a4c5c0064bb804fd13570e0d35c7" Jul 23 15:35:13.321374 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.321347 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:13.336364 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.336291 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:35:13.382901 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.382848 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:13.532244 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532206 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-data\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532260 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp6j4\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-kube-api-access-wp6j4\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532287 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-envoy\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-certs\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532326 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-podinfo\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532375 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-credential-socket\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532446 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-socket\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532460 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istiod-ca-cert\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532490 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-token\") pod \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\" (UID: \"b71472e9-8bf3-424c-8a24-b7bf4088cdf3\") " Jul 23 15:35:13.532772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532748 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:35:13.532772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532744 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:35:13.533014 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532816 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:35:13.533014 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532821 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.533014 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532852 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.533014 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.532979 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:35:13.533605 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.533578 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:35:13.534810 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.534774 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:35:13.534810 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.534788 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:35:13.534976 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.534830 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-kube-api-access-wp6j4" (OuterVolumeSpecName: "kube-api-access-wp6j4") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "kube-api-access-wp6j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:35:13.534976 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.534866 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b71472e9-8bf3-424c-8a24-b7bf4088cdf3" (UID: "b71472e9-8bf3-424c-8a24-b7bf4088cdf3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634134 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634165 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp6j4\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-kube-api-access-wp6j4\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634177 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634190 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634199 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634209 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:13.634226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:13.634217 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71472e9-8bf3-424c-8a24-b7bf4088cdf3-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:35:14.220305 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:14.220278 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" Jul 23 15:35:14.220305 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:14.220289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd" event={"ID":"b71472e9-8bf3-424c-8a24-b7bf4088cdf3","Type":"ContainerDied","Data":"d8c55af0592e0863dc0185f5e500e57a056a749d81c2dc051c410b63311d72f8"} Jul 23 15:35:14.220810 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:14.220350 2576 scope.go:117] "RemoveContainer" containerID="8621ffd08ee31887f8239b9b9854b680d78341f11cb5ebd20e71ed94380af7c1" Jul 23 15:35:14.241833 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:14.241793 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd"] Jul 23 15:35:14.246243 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:14.246211 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8bca8c-openshift-default-5cdddd8887-fs8sd"] Jul 23 15:35:15.422688 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:15.422651 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" path="/var/lib/kubelet/pods/b71472e9-8bf3-424c-8a24-b7bf4088cdf3/volumes" Jul 23 15:35:16.794336 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:16.794297 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:17.167837 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.167736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:17.465647 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.465569 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm"] Jul 23 15:35:17.465913 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.465900 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" Jul 23 15:35:17.465963 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.465914 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" Jul 23 15:35:17.465963 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.465930 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" Jul 23 15:35:17.465963 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.465938 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" Jul 23 15:35:17.466052 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.465998 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" Jul 23 15:35:17.466052 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.466008 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71472e9-8bf3-424c-8a24-b7bf4088cdf3" containerName="istio-proxy" Jul 23 15:35:17.470374 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.470353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.473391 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.473371 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-53a4f4-openshift-default-dockercfg-dkczg\"" Jul 23 15:35:17.481568 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.481542 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm"] Jul 23 15:35:17.495290 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.495244 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:17.568006 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.567969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-certs\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568214 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istiod-ca-cert\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568214 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-data\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568214 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjnw5\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-kube-api-access-fjnw5\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568386 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-credential-socket\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568386 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-socket\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568386 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-envoy\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568386 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-podinfo\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.568386 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.568382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-token\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.620297 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.620267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:17.669332 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-data\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669332 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjnw5\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-kube-api-access-fjnw5\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-credential-socket\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-socket\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-envoy\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-podinfo\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669598 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-token\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669860 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-certs\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.669860 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.669652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istiod-ca-cert\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.670162 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.670136 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-data\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.670241 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.670201 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-credential-socket\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.670241 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.670222 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-socket\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.670354 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.670336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-certs\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.670391 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.670375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istiod-ca-cert\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.672265 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.672241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-podinfo\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.672351 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.672322 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-envoy\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.678205 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.678172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-token\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.678303 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.678245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjnw5\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-kube-api-access-fjnw5\") pod \"e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.781368 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.781328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:17.903340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.903314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:17.921550 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.921525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm"] Jul 23 15:35:17.924063 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:35:17.924026 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4144fb3a_56ba_4e1b_82a5_ca265b69eb9f.slice/crio-bbb21961b5dd54eeb4adc06bec768096077369936617cdf9a9240bd31dafcbce WatchSource:0}: Error finding container bbb21961b5dd54eeb4adc06bec768096077369936617cdf9a9240bd31dafcbce: Status 404 returned error can't find the container with id bbb21961b5dd54eeb4adc06bec768096077369936617cdf9a9240bd31dafcbce Jul 23 15:35:17.926292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.926261 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:17.926387 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.926329 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:17.926387 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:17.926357 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:18.005051 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:18.005019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:18.243289 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:18.243187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" event={"ID":"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f","Type":"ContainerStarted","Data":"6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361"} Jul 23 15:35:18.243289 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:18.243250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" event={"ID":"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f","Type":"ContainerStarted","Data":"bbb21961b5dd54eeb4adc06bec768096077369936617cdf9a9240bd31dafcbce"} Jul 23 15:35:18.265892 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:18.265833 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" podStartSLOduration=1.265814983 podStartE2EDuration="1.265814983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:35:18.263474213 +0000 UTC m=+2563.285163464" watchObservedRunningTime="2026-07-23 15:35:18.265814983 +0000 UTC m=+2563.287504227" Jul 23 15:35:18.781984 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:18.781943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:18.786929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:18.786902 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:19.248402 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:19.248315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:19.249408 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:19.249387 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:20.261040 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:20.261006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:20.343006 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:20.342978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:20.411536 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:20.411490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:20.815099 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:20.815063 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:20.915701 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:20.915652 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:21.016226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:21.016186 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:24.874357 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:24.874321 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:27.243087 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:27.243041 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 23 15:35:27.245481 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:27.243111 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 23 15:35:28.292950 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:28.292915 2576 generic.go:356] "Generic (PLEG): container finished" podID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerID="96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503" exitCode=0 Jul 23 15:35:28.293385 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:28.293001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" event={"ID":"3300244b-dbb4-43c3-a8da-6ca285a719d2","Type":"ContainerDied","Data":"96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503"} Jul 23 15:35:28.293549 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:28.293530 2576 scope.go:117] "RemoveContainer" containerID="96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503" Jul 23 15:35:28.294809 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:28.294778 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:28.294918 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:28.294866 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:28.294987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:28.294970 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:29.316271 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:29.316222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" event={"ID":"3300244b-dbb4-43c3-a8da-6ca285a719d2","Type":"ContainerStarted","Data":"bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882"} Jul 23 15:35:29.397253 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:29.397151 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:29.397488 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:29.397455 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 23 15:35:29.397573 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:29.397518 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 23 15:35:30.397799 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:30.397320 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 23 15:35:30.397799 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:30.397384 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 23 15:35:31.397919 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:31.397373 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 23 15:35:31.397919 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:31.397459 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 23 15:35:32.333106 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.333071 2576 generic.go:356] "Generic (PLEG): container finished" podID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerID="6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361" exitCode=0 Jul 23 15:35:32.333332 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.333140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" event={"ID":"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f","Type":"ContainerDied","Data":"6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361"} Jul 23 15:35:32.333531 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.333517 2576 scope.go:117] "RemoveContainer" containerID="6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361" Jul 23 15:35:32.334546 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.334514 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:32.334619 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.334603 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:32.334669 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.334656 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 23 15:35:32.401911 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.400270 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 23 15:35:32.401911 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:32.400328 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 23 15:35:33.339278 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.339243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" event={"ID":"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f","Type":"ContainerStarted","Data":"5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108"} Jul 23 15:35:33.401223 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.401193 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:33.401493 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.401472 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:33.402372 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.402349 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:35:33.781944 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.781903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:33.782993 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.782968 2576 patch_prober.go:28] interesting pod/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 23 15:35:33.783112 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.783029 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 23 15:35:33.798411 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.798368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:33.899000 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:33.898958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:34.248617 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:34.248519 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:34.782105 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:34.782069 2576 patch_prober.go:28] interesting pod/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 23 15:35:34.782492 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:34.782134 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 23 15:35:35.782359 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:35.782321 2576 patch_prober.go:28] interesting pod/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 23 15:35:35.782753 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:35.782381 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 23 15:35:36.782101 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:36.782057 2576 patch_prober.go:28] interesting pod/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 23 15:35:36.782311 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:36.782121 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 23 15:35:37.786378 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:37.786349 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:37.787275 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:37.787252 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:35:41.595862 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:41.595836 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:41.696555 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:41.696516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:46.645886 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:46.645849 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:55.227576 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:55.227542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:35:55.285206 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:35:55.285175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:36:10.262228 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:36:10.262187 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:37:35.531049 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:37:35.530958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:37:35.537081 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:37:35.537061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:37:48.348886 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:37:48.348849 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:38:13.445187 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:13.445155 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:38:14.488657 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:14.488626 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:38:20.813718 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.813679 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb"] Jul 23 15:38:20.817195 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.817177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.820294 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.820274 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d3e0e7\"/\"default-dockercfg-5h5kt\"" Jul 23 15:38:20.820404 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.820276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d3e0e7\"/\"kube-root-ca.crt\"" Jul 23 15:38:20.821676 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.821658 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d3e0e7\"/\"sub-test-model-d3e0e7-kserve-self-signed-certs\"" Jul 23 15:38:20.821777 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.821698 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d3e0e7\"/\"openshift-service-ca.crt\"" Jul 23 15:38:20.827603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.827582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb"] Jul 23 15:38:20.849243 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.849209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28frg\" (UniqueName: \"kubernetes.io/projected/403cf6b8-b137-48f7-a305-c9077c0fcd7e-kube-api-access-28frg\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.849404 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.849249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-dshm\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.849458 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.849417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-home\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.849502 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.849473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tls-certs\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.849502 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.849493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-model-cache\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.849587 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.849541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tmp-dir\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.943929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.943895 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:38:20.950078 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tmp-dir\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950242 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28frg\" (UniqueName: \"kubernetes.io/projected/403cf6b8-b137-48f7-a305-c9077c0fcd7e-kube-api-access-28frg\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950242 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-dshm\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950242 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-home\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950400 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tls-certs\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950400 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-model-cache\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950498 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950469 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tmp-dir\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950613 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950590 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-home\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.950737 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.950684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-model-cache\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.952747 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.952722 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-dshm\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.952938 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.952921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tls-certs\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:20.958085 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:20.958066 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28frg\" (UniqueName: \"kubernetes.io/projected/403cf6b8-b137-48f7-a305-c9077c0fcd7e-kube-api-access-28frg\") pod \"sub-test-model-d3e0e7-kserve-68744d9447-fqlmb\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:21.127146 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:21.127049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:21.273029 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:21.273004 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb"] Jul 23 15:38:21.274913 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:38:21.274886 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod403cf6b8_b137_48f7_a305_c9077c0fcd7e.slice/crio-aad3c32d735e21c96a732601772fd0c92b5afd6babc6f4ccb7969620a6ee1ce3 WatchSource:0}: Error finding container aad3c32d735e21c96a732601772fd0c92b5afd6babc6f4ccb7969620a6ee1ce3: Status 404 returned error can't find the container with id aad3c32d735e21c96a732601772fd0c92b5afd6babc6f4ccb7969620a6ee1ce3 Jul 23 15:38:22.108098 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:22.108068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" event={"ID":"403cf6b8-b137-48f7-a305-c9077c0fcd7e","Type":"ContainerStarted","Data":"cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef"} Jul 23 15:38:22.108098 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:22.108104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" event={"ID":"403cf6b8-b137-48f7-a305-c9077c0fcd7e","Type":"ContainerStarted","Data":"aad3c32d735e21c96a732601772fd0c92b5afd6babc6f4ccb7969620a6ee1ce3"} Jul 23 15:38:22.125622 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:22.125568 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" podStartSLOduration=2.125552675 podStartE2EDuration="2.125552675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:38:22.123714251 +0000 UTC m=+2747.145403498" watchObservedRunningTime="2026-07-23 15:38:22.125552675 +0000 UTC m=+2747.147241919" Jul 23 15:38:30.564367 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:30.564321 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:38:31.127710 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:31.127676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:31.127927 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:31.127729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:31.140378 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:31.140352 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:31.159276 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:31.159244 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:38:32.334239 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:32.334206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:38:42.959405 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:38:42.959373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:39:27.606279 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:27.606244 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb"] Jul 23 15:39:27.623243 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:27.623197 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:39:28.387922 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:28.387865 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:39:28.680153 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:28.680071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:39:42.627996 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.627949 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" podUID="403cf6b8-b137-48f7-a305-c9077c0fcd7e" containerName="main" containerID="cri-o://cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef" gracePeriod=45 Jul 23 15:39:42.876513 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.876488 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:39:42.991377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991279 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tmp-dir\") pod \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " Jul 23 15:39:42.991377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991338 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tls-certs\") pod \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " Jul 23 15:39:42.991597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991417 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28frg\" (UniqueName: \"kubernetes.io/projected/403cf6b8-b137-48f7-a305-c9077c0fcd7e-kube-api-access-28frg\") pod \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " Jul 23 15:39:42.991597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991442 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-model-cache\") pod \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " Jul 23 15:39:42.991597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-home\") pod \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " Jul 23 15:39:42.991597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-dshm\") pod \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\" (UID: \"403cf6b8-b137-48f7-a305-c9077c0fcd7e\") " Jul 23 15:39:42.991597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991550 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "403cf6b8-b137-48f7-a305-c9077c0fcd7e" (UID: "403cf6b8-b137-48f7-a305-c9077c0fcd7e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:39:42.991866 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991742 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-model-cache" (OuterVolumeSpecName: "model-cache") pod "403cf6b8-b137-48f7-a305-c9077c0fcd7e" (UID: "403cf6b8-b137-48f7-a305-c9077c0fcd7e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:39:42.991866 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991752 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-home" (OuterVolumeSpecName: "home") pod "403cf6b8-b137-48f7-a305-c9077c0fcd7e" (UID: "403cf6b8-b137-48f7-a305-c9077c0fcd7e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:39:42.992006 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991907 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-model-cache\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:39:42.992006 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991927 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-home\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:39:42.992006 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.991943 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tmp-dir\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:39:42.993789 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.993759 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "403cf6b8-b137-48f7-a305-c9077c0fcd7e" (UID: "403cf6b8-b137-48f7-a305-c9077c0fcd7e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:39:42.993943 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.993839 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-dshm" (OuterVolumeSpecName: "dshm") pod "403cf6b8-b137-48f7-a305-c9077c0fcd7e" (UID: "403cf6b8-b137-48f7-a305-c9077c0fcd7e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:39:42.993943 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:42.993915 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403cf6b8-b137-48f7-a305-c9077c0fcd7e-kube-api-access-28frg" (OuterVolumeSpecName: "kube-api-access-28frg") pod "403cf6b8-b137-48f7-a305-c9077c0fcd7e" (UID: "403cf6b8-b137-48f7-a305-c9077c0fcd7e"). InnerVolumeSpecName "kube-api-access-28frg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:39:43.092823 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.092782 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28frg\" (UniqueName: \"kubernetes.io/projected/403cf6b8-b137-48f7-a305-c9077c0fcd7e-kube-api-access-28frg\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:39:43.092823 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.092817 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/403cf6b8-b137-48f7-a305-c9077c0fcd7e-dshm\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:39:43.092823 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.092830 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/403cf6b8-b137-48f7-a305-c9077c0fcd7e-tls-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:39:43.485196 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.485157 2576 generic.go:356] "Generic (PLEG): container finished" podID="403cf6b8-b137-48f7-a305-c9077c0fcd7e" containerID="cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef" exitCode=0 Jul 23 15:39:43.485369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.485205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" event={"ID":"403cf6b8-b137-48f7-a305-c9077c0fcd7e","Type":"ContainerDied","Data":"cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef"} Jul 23 15:39:43.485369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.485225 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" Jul 23 15:39:43.485369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.485243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb" event={"ID":"403cf6b8-b137-48f7-a305-c9077c0fcd7e","Type":"ContainerDied","Data":"aad3c32d735e21c96a732601772fd0c92b5afd6babc6f4ccb7969620a6ee1ce3"} Jul 23 15:39:43.485369 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.485264 2576 scope.go:117] "RemoveContainer" containerID="cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef" Jul 23 15:39:43.493990 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.493972 2576 scope.go:117] "RemoveContainer" containerID="cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef" Jul 23 15:39:43.494255 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:39:43.494235 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef\": container with ID starting with cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef not found: ID does not exist" containerID="cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef" Jul 23 15:39:43.494318 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.494263 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef"} err="failed to get container status \"cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef\": rpc error: code = NotFound desc = could not find container \"cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef\": container with ID starting with cbeff3a0d52a39f2452a79a0fb2a78977d2e82d8475984843cc774a0c2d9fdef not found: ID does not exist" Jul 23 15:39:43.502495 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.502460 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb"] Jul 23 15:39:43.505810 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:43.505781 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d3e0e7/sub-test-model-d3e0e7-kserve-68744d9447-fqlmb"] Jul 23 15:39:44.053587 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:44.053560 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:39:45.425946 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:39:45.425914 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403cf6b8-b137-48f7-a305-c9077c0fcd7e" path="/var/lib/kubelet/pods/403cf6b8-b137-48f7-a305-c9077c0fcd7e/volumes" Jul 23 15:40:06.849237 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:06.849196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:18.662068 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:18.662031 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:18.762267 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:18.762226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:34.686145 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:34.686103 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:34.784845 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:34.784803 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:42.403603 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:42.403565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:42.504016 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:42.503955 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:56.577813 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:56.577778 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:40:57.560080 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:40:57.560040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:17.977846 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:17.977811 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:18.107544 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:18.107514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:30.411596 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:30.411548 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:32.264199 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:32.264149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:32.745065 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:32.744964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:38.506529 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:38.506494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:38.603910 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:38.603863 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:38.767131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:38.767086 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2"] Jul 23 15:41:38.767384 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:38.767359 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" containerID="cri-o://bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882" gracePeriod=30 Jul 23 15:41:38.783072 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:38.783042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:39.042535 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:39.042443 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:39.671568 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:39.671534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:39.773747 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:39.773699 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:44.027252 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.027179 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:41:44.033929 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.033900 2576 generic.go:356] "Generic (PLEG): container finished" podID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerID="bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882" exitCode=0 Jul 23 15:41:44.034078 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.033969 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" Jul 23 15:41:44.034078 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.033971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" event={"ID":"3300244b-dbb4-43c3-a8da-6ca285a719d2","Type":"ContainerDied","Data":"bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882"} Jul 23 15:41:44.034166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.034091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2" event={"ID":"3300244b-dbb4-43c3-a8da-6ca285a719d2","Type":"ContainerDied","Data":"17724cd2a78da2c6e3e14bdc1878e8d77336215391df65ce197a3b663f5e7211"} Jul 23 15:41:44.034166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.034115 2576 scope.go:117] "RemoveContainer" containerID="bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882" Jul 23 15:41:44.042960 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.042942 2576 scope.go:117] "RemoveContainer" containerID="96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503" Jul 23 15:41:44.055632 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.055605 2576 scope.go:117] "RemoveContainer" containerID="bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882" Jul 23 15:41:44.056044 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:41:44.056016 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882\": container with ID starting with bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882 not found: ID does not exist" containerID="bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882" Jul 23 15:41:44.056110 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.056056 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882"} err="failed to get container status \"bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882\": rpc error: code = NotFound desc = could not find container \"bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882\": container with ID starting with bd3c57680d5c2abdc15a45174db3d476093c1cc7e207bd1cfe025c366c947882 not found: ID does not exist" Jul 23 15:41:44.056110 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.056075 2576 scope.go:117] "RemoveContainer" containerID="96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503" Jul 23 15:41:44.056382 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:41:44.056366 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503\": container with ID starting with 96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503 not found: ID does not exist" containerID="96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503" Jul 23 15:41:44.056441 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.056386 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503"} err="failed to get container status \"96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503\": rpc error: code = NotFound desc = could not find container \"96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503\": container with ID starting with 96cdb2d265671492e0ee07986ebaab2318f2d4a8b662756a8b448a0499eba503 not found: ID does not exist" Jul 23 15:41:44.099597 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099555 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3300244b-dbb4-43c3-a8da-6ca285a719d2-istiod-ca-cert\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.099772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099607 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-certs\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.099772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099633 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98hvq\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-kube-api-access-98hvq\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.099772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099650 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-podinfo\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.099772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099735 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-credential-socket\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.099772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099756 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-socket\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.099772 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099774 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-envoy\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.100131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-token\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.100131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099863 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-data\") pod \"3300244b-dbb4-43c3-a8da-6ca285a719d2\" (UID: \"3300244b-dbb4-43c3-a8da-6ca285a719d2\") " Jul 23 15:41:44.100131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.099994 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:41:44.100131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100001 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3300244b-dbb4-43c3-a8da-6ca285a719d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:41:44.100131 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100097 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:41:44.100377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100146 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:41:44.100377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100250 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.100377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100268 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.100377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100282 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.100377 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.100295 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3300244b-dbb4-43c3-a8da-6ca285a719d2-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.101112 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.101085 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:41:44.102162 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.102137 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:41:44.102285 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.102154 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:41:44.102285 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.102223 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-kube-api-access-98hvq" (OuterVolumeSpecName: "kube-api-access-98hvq") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "kube-api-access-98hvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:41:44.102363 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.102288 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3300244b-dbb4-43c3-a8da-6ca285a719d2" (UID: "3300244b-dbb4-43c3-a8da-6ca285a719d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:41:44.201328 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.201285 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98hvq\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-kube-api-access-98hvq\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.201328 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.201321 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.201328 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.201332 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.201567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.201340 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.201567 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.201348 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3300244b-dbb4-43c3-a8da-6ca285a719d2-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:41:44.356123 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.356088 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2"] Jul 23 15:41:44.361213 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:44.361188 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d3e0e7-openshift-default-76d87bb47f-tchm2"] Jul 23 15:41:45.422613 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:45.422583 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" path="/var/lib/kubelet/pods/3300244b-dbb4-43c3-a8da-6ca285a719d2/volumes" Jul 23 15:41:46.648938 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:46.648859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:49.627728 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:49.627690 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:54.253416 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:54.253379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:41:54.691810 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:41:54.691770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:00.394154 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:00.394077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:00.496210 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:00.496174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:00.681809 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:00.681719 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm"] Jul 23 15:42:00.682025 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:00.681995 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" containerID="cri-o://5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108" gracePeriod=30 Jul 23 15:42:00.713210 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:00.713177 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:00.973108 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:00.973009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:05.946264 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.946182 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:42:05.998084 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998046 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjnw5\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-kube-api-access-fjnw5\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998287 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998091 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-credential-socket\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998287 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998133 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-podinfo\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998287 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998181 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-token\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998287 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998197 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-socket\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998361 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-envoy\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998409 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-data\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998453 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istiod-ca-cert\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998463 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:42:05.998510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998477 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:42:05.998764 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998518 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-certs\") pod \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\" (UID: \"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f\") " Jul 23 15:42:05.998825 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998783 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:42:05.998924 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998865 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-credential-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:05.998924 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998923 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-socket\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:05.998924 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998937 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istiod-ca-cert\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:05.999231 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.998939 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:42:05.999553 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:05.999527 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:42:06.000502 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.000478 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 15:42:06.000587 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.000554 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-kube-api-access-fjnw5" (OuterVolumeSpecName: "kube-api-access-fjnw5") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "kube-api-access-fjnw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:42:06.000685 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.000664 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:42:06.000736 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.000673 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" (UID: "4144fb3a-56ba-4e1b-82a5-ca265b69eb9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:42:06.099409 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.099379 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-workload-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:06.099409 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.099406 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjnw5\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-kube-api-access-fjnw5\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:06.099606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.099417 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-podinfo\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:06.099606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.099427 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-token\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:06.099606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.099435 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-envoy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:06.099606 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.099443 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f-istio-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\"" Jul 23 15:42:06.134484 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.134449 2576 generic.go:356] "Generic (PLEG): container finished" podID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerID="5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108" exitCode=0 Jul 23 15:42:06.134680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.134499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" event={"ID":"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f","Type":"ContainerDied","Data":"5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108"} Jul 23 15:42:06.134680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.134507 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" Jul 23 15:42:06.134680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.134541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm" event={"ID":"4144fb3a-56ba-4e1b-82a5-ca265b69eb9f","Type":"ContainerDied","Data":"bbb21961b5dd54eeb4adc06bec768096077369936617cdf9a9240bd31dafcbce"} Jul 23 15:42:06.134680 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.134562 2576 scope.go:117] "RemoveContainer" containerID="5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108" Jul 23 15:42:06.144378 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.144360 2576 scope.go:117] "RemoveContainer" containerID="6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361" Jul 23 15:42:06.153311 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.153286 2576 scope.go:117] "RemoveContainer" containerID="5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108" Jul 23 15:42:06.153579 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:42:06.153558 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108\": container with ID starting with 5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108 not found: ID does not exist" containerID="5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108" Jul 23 15:42:06.153635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.153588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108"} err="failed to get container status \"5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108\": rpc error: code = NotFound desc = could not find container \"5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108\": container with ID starting with 5c936e8b273a511674a2269442f7eb162410df3e1f7ba924efc5533568b0a108 not found: ID does not exist" Jul 23 15:42:06.153635 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.153610 2576 scope.go:117] "RemoveContainer" containerID="6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361" Jul 23 15:42:06.153934 ip-10-0-143-139 kubenswrapper[2576]: E0723 15:42:06.153916 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361\": container with ID starting with 6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361 not found: ID does not exist" containerID="6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361" Jul 23 15:42:06.153988 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.153941 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361"} err="failed to get container status \"6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361\": rpc error: code = NotFound desc = could not find container \"6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361\": container with ID starting with 6c203f50ffe312eca7e74f721aa1d78aa13159dc5407ac6f49e17f5daf5a3361 not found: ID does not exist" Jul 23 15:42:06.157389 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.157363 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm"] Jul 23 15:42:06.163426 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:06.163405 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-53a4f4-openshift-default-5bcbdd7fcf-l4bkm"] Jul 23 15:42:07.423295 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:07.423266 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" path="/var/lib/kubelet/pods/4144fb3a-56ba-4e1b-82a5-ca265b69eb9f/volumes" Jul 23 15:42:08.245539 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:08.245506 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b97c94c-jgfcb_3f120a71-d344-49a4-b01a-4ef173654c2e/copy-manifests/0.log" Jul 23 15:42:08.251667 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:08.251645 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b97c94c-jgfcb_3f120a71-d344-49a4-b01a-4ef173654c2e/manager/0.log" Jul 23 15:42:13.475097 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:13.475067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xckq2_768b4776-d08d-4931-8c69-0f5fb55144e4/istio-proxy/0.log" Jul 23 15:42:13.750407 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:13.750328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wh84_0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1/discovery/0.log" Jul 23 15:42:14.247392 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:14.247358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/1.log" Jul 23 15:42:15.101977 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:15.101950 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5cnf7_bfdaf028-8fe3-46b9-b2d6-072a617cc6f5/main/0.log" Jul 23 15:42:15.656906 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:15.656865 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-m9bcj_9bcf0a35-e764-4521-9f28-82f8a7c6e673/main/0.log" Jul 23 15:42:25.996349 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:25.996311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:26.058987 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:26.058940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" limit=1024 Jul 23 15:42:27.079763 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:27.079733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rgx2d_d33a5fd4-6211-4249-a57e-79d4d352690a/global-pull-secret-syncer/0.log" Jul 23 15:42:27.124677 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:27.124644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-54tvk_ca7dfdf5-05e8-4744-bd43-2bdae8e72e8b/konnectivity-agent/0.log" Jul 23 15:42:27.249864 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:27.249830 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-139.ec2.internal_0e0a0dfd9afe87f2fe9fb1dd4357d8df/haproxy/0.log" Jul 23 15:42:34.905764 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:34.905733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2nr5t_d899a705-2aa3-428d-a185-493dec1b469e/kube-state-metrics/0.log" Jul 23 15:42:34.927855 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:34.927810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2nr5t_d899a705-2aa3-428d-a185-493dec1b469e/kube-rbac-proxy-main/0.log" Jul 23 15:42:34.950851 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:34.950803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2nr5t_d899a705-2aa3-428d-a185-493dec1b469e/kube-rbac-proxy-self/0.log" Jul 23 15:42:35.350732 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.350702 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcj8f_54012de9-6535-48db-8650-e2b25b055226/node-exporter/0.log" Jul 23 15:42:35.371817 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.371769 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcj8f_54012de9-6535-48db-8650-e2b25b055226/kube-rbac-proxy/0.log" Jul 23 15:42:35.392629 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.392602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcj8f_54012de9-6535-48db-8650-e2b25b055226/init-textfile/0.log" Jul 23 15:42:35.422226 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.422194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-cc97d_c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0/kube-rbac-proxy-main/0.log" Jul 23 15:42:35.440292 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.440266 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-cc97d_c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0/kube-rbac-proxy-self/0.log" Jul 23 15:42:35.466623 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.466593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-cc97d_c1dbe4f6-e97f-4348-8778-6ee2cd60ccd0/openshift-state-metrics/0.log" Jul 23 15:42:35.564357 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.564331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:42:35.570935 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.570913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:42:35.819510 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.819486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-vnwpl_31cafbbf-1e70-4747-b5a3-59359fac180c/prometheus-operator-admission-webhook/0.log" Jul 23 15:42:35.972796 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.972718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fdccd5bc-6mp4n_b054302b-7f02-4e82-8001-72db0865b4c3/thanos-query/0.log" Jul 23 15:42:35.994870 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:35.994833 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fdccd5bc-6mp4n_b054302b-7f02-4e82-8001-72db0865b4c3/kube-rbac-proxy-web/0.log" Jul 23 15:42:36.016314 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:36.016288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fdccd5bc-6mp4n_b054302b-7f02-4e82-8001-72db0865b4c3/kube-rbac-proxy/0.log" Jul 23 15:42:36.037724 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:36.037696 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fdccd5bc-6mp4n_b054302b-7f02-4e82-8001-72db0865b4c3/prom-label-proxy/0.log" Jul 23 15:42:36.058191 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:36.058165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fdccd5bc-6mp4n_b054302b-7f02-4e82-8001-72db0865b4c3/kube-rbac-proxy-rules/0.log" Jul 23 15:42:36.080738 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:36.080690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fdccd5bc-6mp4n_b054302b-7f02-4e82-8001-72db0865b4c3/kube-rbac-proxy-metrics/0.log" Jul 23 15:42:37.171958 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.171920 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c"] Jul 23 15:42:37.172334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172233 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" Jul 23 15:42:37.172334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172244 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" Jul 23 15:42:37.172334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172256 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403cf6b8-b137-48f7-a305-c9077c0fcd7e" containerName="main" Jul 23 15:42:37.172334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172261 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="403cf6b8-b137-48f7-a305-c9077c0fcd7e" containerName="main" Jul 23 15:42:37.172334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172269 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" Jul 23 15:42:37.172334 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172276 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" Jul 23 15:42:37.172520 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172347 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4144fb3a-56ba-4e1b-82a5-ca265b69eb9f" containerName="istio-proxy" Jul 23 15:42:37.172520 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172359 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" Jul 23 15:42:37.172520 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172365 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3300244b-dbb4-43c3-a8da-6ca285a719d2" containerName="istio-proxy" Jul 23 15:42:37.172520 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.172371 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="403cf6b8-b137-48f7-a305-c9077c0fcd7e" containerName="main" Jul 23 15:42:37.176809 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.176783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.179938 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.179914 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lzsc\"/\"kube-root-ca.crt\"" Jul 23 15:42:37.180193 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.179924 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lzsc\"/\"openshift-service-ca.crt\"" Jul 23 15:42:37.180294 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.179970 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8lzsc\"/\"default-dockercfg-nn8hv\"" Jul 23 15:42:37.186210 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.186184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c"] Jul 23 15:42:37.289006 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.288980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-podres\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.289166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.289021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-lib-modules\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.289166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.289061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bxcd\" (UniqueName: \"kubernetes.io/projected/4040c126-f7bd-4244-a0b8-751beaf737be-kube-api-access-9bxcd\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.289166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.289102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-sys\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.289166 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.289142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-proc\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389767 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-podres\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389975 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-lib-modules\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389975 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxcd\" (UniqueName: \"kubernetes.io/projected/4040c126-f7bd-4244-a0b8-751beaf737be-kube-api-access-9bxcd\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389975 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-sys\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389975 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-proc\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389975 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389942 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-podres\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.389975 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.389965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-sys\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.390189 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.390003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-proc\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.390189 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.390003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4040c126-f7bd-4244-a0b8-751beaf737be-lib-modules\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.398536 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.398505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bxcd\" (UniqueName: \"kubernetes.io/projected/4040c126-f7bd-4244-a0b8-751beaf737be-kube-api-access-9bxcd\") pod \"perf-node-gather-daemonset-7b48c\" (UID: \"4040c126-f7bd-4244-a0b8-751beaf737be\") " pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.487585 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.487486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:37.621799 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:37.621766 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c"] Jul 23 15:42:37.624507 ip-10-0-143-139 kubenswrapper[2576]: W0723 15:42:37.624474 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4040c126_f7bd_4244_a0b8_751beaf737be.slice/crio-3de7b277a1336f2f9d7df4c53b3cc1292dabea6209dfd83006ff1b66eba24a74 WatchSource:0}: Error finding container 3de7b277a1336f2f9d7df4c53b3cc1292dabea6209dfd83006ff1b66eba24a74: Status 404 returned error can't find the container with id 3de7b277a1336f2f9d7df4c53b3cc1292dabea6209dfd83006ff1b66eba24a74 Jul 23 15:42:38.278332 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:38.278300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" event={"ID":"4040c126-f7bd-4244-a0b8-751beaf737be","Type":"ContainerStarted","Data":"3183d414b76f9328f5b74c911625896967ded5c4a57dc9abd6864cab5f337711"} Jul 23 15:42:38.278710 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:38.278347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" event={"ID":"4040c126-f7bd-4244-a0b8-751beaf737be","Type":"ContainerStarted","Data":"3de7b277a1336f2f9d7df4c53b3cc1292dabea6209dfd83006ff1b66eba24a74"} Jul 23 15:42:38.278710 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:38.278431 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:38.296200 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:38.296149 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" podStartSLOduration=1.296132976 podStartE2EDuration="1.296132976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:42:38.294045311 +0000 UTC m=+3003.315734557" watchObservedRunningTime="2026-07-23 15:42:38.296132976 +0000 UTC m=+3003.317822222" Jul 23 15:42:40.052443 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:40.052411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppnjm_478b56c0-4902-4247-a906-24dc67389619/dns/0.log" Jul 23 15:42:40.070229 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:40.070204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppnjm_478b56c0-4902-4247-a906-24dc67389619/kube-rbac-proxy/0.log" Jul 23 15:42:40.136473 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:40.136444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mqcc_7d03f826-75df-4581-9466-53365b7d93f8/dns-node-resolver/0.log" Jul 23 15:42:40.707003 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:40.706968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bb5db57f7-gnwhz_ea182948-84ac-4c85-8fd0-0f9c7ccc4888/registry/0.log" Jul 23 15:42:40.749211 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:40.749182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-92mv7_422b5e09-2b02-4079-b8aa-6a63ac6efb21/node-ca/0.log" Jul 23 15:42:41.661001 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:41.660971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xckq2_768b4776-d08d-4931-8c69-0f5fb55144e4/istio-proxy/0.log" Jul 23 15:42:41.790857 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:41.790823 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wh84_0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1/discovery/0.log" Jul 23 15:42:41.865701 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:41.865663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/0.log" Jul 23 15:42:41.891312 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:41.891282 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/1.log" Jul 23 15:42:42.687509 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:42.687484 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6fpr_8e7721c1-393c-45d9-ab76-413a751ea1ae/serve-healthcheck-canary/0.log" Jul 23 15:42:43.386151 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:43.386122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8mqw_925f273f-56ff-4442-81be-943ea2f28e69/kube-rbac-proxy/0.log" Jul 23 15:42:43.404952 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:43.404925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8mqw_925f273f-56ff-4442-81be-943ea2f28e69/exporter/0.log" Jul 23 15:42:43.423272 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:43.423245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8mqw_925f273f-56ff-4442-81be-943ea2f28e69/extractor/0.log" Jul 23 15:42:44.292996 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:44.292967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8lzsc/perf-node-gather-daemonset-7b48c" Jul 23 15:42:46.004634 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:46.004602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b97c94c-jgfcb_3f120a71-d344-49a4-b01a-4ef173654c2e/manager/0.log" Jul 23 15:42:46.022515 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:46.022486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b97c94c-jgfcb_3f120a71-d344-49a4-b01a-4ef173654c2e/copy-manifests/0.log" Jul 23 15:42:47.507849 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:47.507769 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5857c6d56c-5qgk9_5c34b7d1-c9f2-4b81-abd9-d0317796fbac/manager/0.log" Jul 23 15:42:47.562988 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:47.562958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mgqr4_9ea67747-297b-402b-82cb-e46c4d98706d/openshift-lws-operator/0.log" Jul 23 15:42:47.825812 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:47.825777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xckq2_768b4776-d08d-4931-8c69-0f5fb55144e4/istio-proxy/0.log" Jul 23 15:42:47.948306 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:47.948272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wh84_0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1/discovery/0.log" Jul 23 15:42:48.003639 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:48.003606 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/0.log" Jul 23 15:42:48.029020 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:48.028983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/1.log" Jul 23 15:42:49.289989 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:49.289963 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xckq2_768b4776-d08d-4931-8c69-0f5fb55144e4/istio-proxy/0.log" Jul 23 15:42:49.409327 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:49.409238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wh84_0285d0d1-90b0-4cd2-8a6e-d69b8d9957c1/discovery/0.log" Jul 23 15:42:49.459971 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:49.459943 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/0.log" Jul 23 15:42:49.489104 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:49.489075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9plnp_aee84856-0629-4f4a-a7a8-fb04045e8437/istio-proxy/1.log" Jul 23 15:42:54.096340 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.096262 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/kube-multus-additional-cni-plugins/0.log" Jul 23 15:42:54.114418 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.114391 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/egress-router-binary-copy/0.log" Jul 23 15:42:54.131217 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.131188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/cni-plugins/0.log" Jul 23 15:42:54.148608 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.148585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/bond-cni-plugin/0.log" Jul 23 15:42:54.164981 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.164960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/routeoverride-cni/0.log" Jul 23 15:42:54.181973 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.181946 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/whereabouts-cni-bincopy/0.log" Jul 23 15:42:54.198602 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.198574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbdqk_65dc477b-a2a8-422b-be42-89291a8247b0/whereabouts-cni/0.log" Jul 23 15:42:54.225116 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.225094 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nmv9p_f6bcd55a-87d2-4bab-9056-75e18b6349ff/kube-multus/0.log" Jul 23 15:42:54.367520 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.367441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z4b8d_b2e85229-b5e7-41ba-a710-969494798b89/network-metrics-daemon/0.log" Jul 23 15:42:54.388705 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:54.388676 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z4b8d_b2e85229-b5e7-41ba-a710-969494798b89/kube-rbac-proxy/0.log" Jul 23 15:42:55.396428 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.396398 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-controller/0.log" Jul 23 15:42:55.411621 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.411596 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/1.log" Jul 23 15:42:55.411743 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.411615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovn-acl-logging/0.log" Jul 23 15:42:55.429134 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.429108 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/kube-rbac-proxy-node/0.log" Jul 23 15:42:55.446834 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.446810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 15:42:55.462746 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.462718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/northd/0.log" Jul 23 15:42:55.481841 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.481814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/nbdb/0.log" Jul 23 15:42:55.500013 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.499987 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/sbdb/0.log" Jul 23 15:42:55.547442 ip-10-0-143-139 kubenswrapper[2576]: I0723 15:42:55.547407 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mb4z4_92c8e82b-75bf-4aad-8415-16cb3074b738/ovnkube-controller/0.log"