Jul 05 11:51:43.639111 ip-10-0-136-198 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 05 11:51:43.639124 ip-10-0-136-198 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 05 11:51:43.639130 ip-10-0-136-198 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 05 11:51:43.639387 ip-10-0-136-198 systemd[1]: Failed to start Kubernetes Kubelet. Jul 05 11:51:53.690531 ip-10-0-136-198 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 05 11:51:53.690545 ip-10-0-136-198 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9a3881f628d746168237f5f38e97990f -- Jul 05 11:53:41.146105 ip-10-0-136-198 systemd[1]: Starting Kubernetes Kubelet... Jul 05 11:53:41.510351 ip-10-0-136-198 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 11:53:41.510351 ip-10-0-136-198 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 11:53:41.510351 ip-10-0-136-198 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 11:53:41.510351 ip-10-0-136-198 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 11:53:41.510351 ip-10-0-136-198 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 11:53:41.511875 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.511753 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517128 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517150 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517155 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517158 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517161 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517164 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 11:53:41.517156 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517167 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517170 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517173 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517175 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517178 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517181 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517183 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517186 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517189 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517191 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517194 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517196 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517199 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517201 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517204 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517207 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517209 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517212 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517215 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 11:53:41.517426 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517217 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517220 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517225 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517228 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517230 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517233 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517235 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517238 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517241 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517244 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517246 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517248 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517251 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517253 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517256 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517259 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517262 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517265 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517267 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517270 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 11:53:41.517866 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517273 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517276 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517279 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517282 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517284 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517287 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517290 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517292 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517295 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517297 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517299 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517302 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517305 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517307 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517310 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517314 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517316 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517319 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517321 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517323 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 11:53:41.518388 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517328 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517333 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517337 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517340 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517343 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517346 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517349 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517352 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517355 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517358 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517361 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517363 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517366 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517368 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517371 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517373 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517376 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517378 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517381 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517384 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 11:53:41.518870 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517386 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517389 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517391 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517394 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517396 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517399 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517401 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517403 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517406 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517410 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517413 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517415 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517418 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 11:53:41.519366 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.517421 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519481 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519490 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519497 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519500 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519503 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519506 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519509 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519511 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519514 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519516 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519519 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519521 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519524 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519526 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519529 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519532 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519535 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519538 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 11:53:41.519679 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519540 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519543 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519545 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519548 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519550 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519553 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519555 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519559 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519563 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519565 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519568 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519570 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519573 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519576 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519580 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519583 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519585 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519588 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519591 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 11:53:41.520212 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519593 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519596 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519598 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519601 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519605 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519608 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519611 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519614 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519616 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519619 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519621 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519624 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519628 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519630 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519633 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519635 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519638 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519640 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519643 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519645 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 11:53:41.520689 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519648 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519650 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519652 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519655 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519658 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519660 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519665 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519669 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519673 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519675 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519678 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519681 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519683 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519686 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519689 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519692 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519696 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519698 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519700 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519705 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 11:53:41.521182 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519707 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519710 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519712 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519715 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519717 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519721 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519723 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519726 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519728 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519731 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519734 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519736 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519739 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519741 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519744 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519746 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519749 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519752 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519754 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 11:53:41.521663 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519758 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.519760 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520159 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520165 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520168 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520171 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520174 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520176 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520179 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520182 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520185 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520187 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520190 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520192 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520195 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520197 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520200 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520202 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520205 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520208 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 11:53:41.522132 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520211 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520213 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520216 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520218 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520221 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520224 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520227 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520229 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520232 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520235 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520237 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520240 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520243 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520245 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520248 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520250 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520253 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520255 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520258 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520260 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 11:53:41.522615 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520263 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520265 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520267 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520270 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520272 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520275 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520277 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520280 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520282 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520285 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520288 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520291 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520293 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520296 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520298 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520301 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520303 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520306 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520308 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520311 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 11:53:41.523102 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520313 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520316 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520318 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520323 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520326 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520330 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520333 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520336 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520339 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520342 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520345 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520347 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520351 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520354 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520356 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520358 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520361 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520364 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 11:53:41.523589 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520366 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520370 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520373 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520376 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520378 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520381 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520384 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520386 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520389 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520391 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520394 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520396 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520401 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520403 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520406 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520409 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520411 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520414 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520417 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 11:53:41.524019 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520421 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520424 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520427 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.520429 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520516 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520532 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520542 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520548 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520552 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520556 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520560 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520564 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520567 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520571 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520574 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520577 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520580 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520583 2578 flags.go:64] FLAG: --cgroup-root="" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520586 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520589 2578 flags.go:64] FLAG: --client-ca-file="" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520593 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520596 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520601 2578 flags.go:64] FLAG: --cluster-domain="" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520603 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 11:53:41.524495 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520606 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520610 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520613 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520617 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520621 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520624 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520627 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520630 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520634 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520636 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520640 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520643 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520647 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520650 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520653 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520656 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520658 2578 flags.go:64] FLAG: --enable-server="true" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520661 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520666 2578 flags.go:64] FLAG: --event-burst="100" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520669 2578 flags.go:64] FLAG: --event-qps="50" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520672 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520675 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520678 2578 flags.go:64] FLAG: --eviction-hard="" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520682 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 11:53:41.525089 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520685 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520688 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520691 2578 flags.go:64] FLAG: --eviction-soft="" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520694 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520697 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520701 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520704 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520707 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520710 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520713 2578 flags.go:64] FLAG: --feature-gates="" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520717 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520720 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520723 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520726 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520729 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520733 2578 flags.go:64] FLAG: --help="false" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520736 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520739 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520741 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520744 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520747 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520751 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520754 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 11:53:41.525653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520756 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520759 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520762 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520765 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520768 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520770 2578 flags.go:64] FLAG: --kube-reserved="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520773 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520776 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520779 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520782 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520784 2578 flags.go:64] FLAG: --lock-file="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520787 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520790 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520793 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520799 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520803 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520805 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520808 2578 flags.go:64] FLAG: --logging-format="text" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520811 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520814 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520817 2578 flags.go:64] FLAG: --manifest-url="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520822 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520827 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520830 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520834 2578 flags.go:64] FLAG: --max-pods="110" Jul 05 11:53:41.526286 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520838 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520841 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520843 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520846 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520849 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520852 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520855 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520863 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520866 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520869 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520872 2578 flags.go:64] FLAG: --pod-cidr="" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520875 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520880 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520883 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520886 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520889 2578 flags.go:64] FLAG: --port="10250" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520892 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520895 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cda4dbd6bbc7b452" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520899 2578 flags.go:64] FLAG: --qos-reserved="" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520902 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520905 2578 flags.go:64] FLAG: --register-node="true" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520908 2578 flags.go:64] FLAG: --register-with-taints="" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520911 2578 flags.go:64] FLAG: --registry-burst="10" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520915 2578 flags.go:64] FLAG: --registry-qps="5" Jul 05 11:53:41.526886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520918 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520921 2578 flags.go:64] FLAG: --reserved-memory="" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520924 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520927 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520930 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520934 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520937 2578 flags.go:64] FLAG: --runonce="false" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520940 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520943 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520946 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520949 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520952 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520955 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520958 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520961 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520964 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520967 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520970 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520973 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520976 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520979 2578 flags.go:64] FLAG: --system-cgroups="" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520982 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520987 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520989 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520992 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 11:53:41.527516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520996 2578 flags.go:64] FLAG: --tls-min-version="" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.520999 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521002 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521004 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521007 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521010 2578 flags.go:64] FLAG: --v="2" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521014 2578 flags.go:64] FLAG: --version="false" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521019 2578 flags.go:64] FLAG: --vmodule="" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521023 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.521027 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521160 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521165 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521170 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521173 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521176 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521178 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521181 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521184 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521187 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521190 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521193 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521196 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 11:53:41.528193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521199 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521202 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521204 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521207 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521210 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521212 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521215 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521218 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521220 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521223 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521225 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521228 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521230 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521233 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521236 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521239 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521241 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521243 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521248 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521251 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 11:53:41.528720 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521253 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521256 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521260 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521263 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521265 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521268 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521270 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521273 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521275 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521278 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521282 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521286 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521289 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521292 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521295 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521298 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521300 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521303 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521305 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521308 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 11:53:41.529232 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521310 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521313 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521315 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521318 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521320 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521323 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521325 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521328 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521330 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521333 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521337 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521340 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521342 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521345 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521349 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521351 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521354 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521356 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521359 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521361 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 11:53:41.529757 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521364 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521366 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521369 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521371 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521374 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521378 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521381 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521384 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521387 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521389 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521392 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521395 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521397 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521400 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521402 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521405 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521407 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521410 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521413 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521416 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 11:53:41.530256 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521419 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521421 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521425 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521427 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521430 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521434 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.521439 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.522070 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.529446 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 11:53:41.530740 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.529468 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 11:53:41.531113 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.531101 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 11:53:41.531149 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.531113 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 11:53:41.531193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531184 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 11:53:41.531193 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531193 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531197 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531200 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531203 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531213 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531216 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531219 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531222 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531225 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531227 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531230 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531233 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531235 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531238 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531240 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531243 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531246 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531248 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531251 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531253 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 11:53:41.531252 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531256 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531259 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531262 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531265 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531268 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531270 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531273 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531276 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531285 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531287 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531290 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531293 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531295 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531298 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531301 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531303 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531306 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531308 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531311 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 11:53:41.531732 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531313 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531316 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531318 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531321 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531324 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531326 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531328 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531331 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531333 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531336 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531338 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531341 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531343 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531346 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531349 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531352 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531355 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531357 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531360 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 11:53:41.532205 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531364 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531368 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531371 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531380 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531384 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531386 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531389 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531391 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531394 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531396 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531399 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531402 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531404 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531407 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531410 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531412 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531415 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531418 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531420 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531423 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 11:53:41.532653 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531425 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531428 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531430 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531433 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531435 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531438 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531441 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531443 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531447 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531449 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531452 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531455 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531457 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531460 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531464 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531467 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531476 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531480 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531483 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 11:53:41.533215 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531487 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.531492 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531659 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531665 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531668 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531672 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531675 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531678 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531681 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531683 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531686 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531689 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531692 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531694 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531697 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 11:53:41.533685 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531699 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531702 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531705 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531707 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531710 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531713 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531716 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531719 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531721 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531724 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531726 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531729 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531731 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531734 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531736 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531745 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531748 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531751 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531753 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531755 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 11:53:41.534065 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531758 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531760 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531763 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531765 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531768 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531770 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531772 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531775 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531778 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531780 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531783 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531787 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531794 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531797 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531800 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531802 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531805 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531807 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531810 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 11:53:41.534556 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531813 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531816 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531818 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531821 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531824 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531826 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531829 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531831 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531839 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531842 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531845 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531847 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531851 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531854 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531857 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531860 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531862 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531865 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531868 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 11:53:41.535043 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531871 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531873 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531876 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531878 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531881 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531883 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531886 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531889 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531891 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531894 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531897 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531899 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531903 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531905 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531908 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531910 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531913 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531915 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531918 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 11:53:41.535570 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531921 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531924 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531928 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531936 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531939 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531942 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531944 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:41.531947 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.531951 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.532104 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 11:53:41.536059 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.535390 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 11:53:41.536711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.536699 2578 server.go:1019] "Starting client certificate rotation" Jul 05 11:53:41.536818 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.536803 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 11:53:41.536865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.536856 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 11:53:41.539463 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.539443 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 11:53:41.544204 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.544179 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 11:53:41.550099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.550081 2578 log.go:25] "Validated CRI v1 runtime API" Jul 05 11:53:41.552318 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.552300 2578 log.go:25] "Validated CRI v1 image API" Jul 05 11:53:41.555439 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.555426 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 11:53:41.557645 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.557627 2578 fs.go:135] Filesystem UUIDs: map[24f26b78-2c7e-4f07-8c8f-c817ffc47d32:/dev/nvme0n1p3 583e0af2-b62a-4227-b511-2b4e95a3a0fa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 05 11:53:41.557688 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.557646 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 11:53:41.563246 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.563115 2578 manager.go:216] Machine: {Timestamp:2026-07-05 11:53:41.56199684 +0000 UTC m=+0.300534350 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098268 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2abee1336807096d000f74a9dc4b69 SystemUUID:ec2abee1-3368-0709-6d00-0f74a9dc4b69 BootID:9a3881f6-28d7-4616-8237-f5f38e97990f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:01:fd:24:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:01:fd:24:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:67:88:f4:08:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 11:53:41.563246 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.563241 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 11:53:41.563373 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.563362 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 11:53:41.566215 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.566194 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 11:53:41.566215 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.566191 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 11:53:41.566376 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.566223 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 11:53:41.567396 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.567385 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 11:53:41.567441 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.567398 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 11:53:41.567441 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.567405 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 11:53:41.567938 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.567928 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 11:53:41.569412 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.569401 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 11:53:41.573231 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573218 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 05 11:53:41.573356 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573347 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 11:53:41.573393 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573386 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 05 11:53:41.573422 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573398 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 11:53:41.573422 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573418 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 11:53:41.573483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573438 2578 kubelet.go:398] "Adding apiserver pod source" Jul 05 11:53:41.573483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573446 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 11:53:41.573814 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573802 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 11:53:41.573851 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.573821 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 11:53:41.576350 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.576333 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 11:53:41.578314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.578300 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 11:53:41.578382 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.578329 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 11:53:41.579409 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579396 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 11:53:41.579457 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579416 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 11:53:41.579457 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579429 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 11:53:41.579457 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579435 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 11:53:41.579457 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579451 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 11:53:41.579457 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579458 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 11:53:41.579580 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579467 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 11:53:41.579580 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579473 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 11:53:41.579580 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579479 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 11:53:41.579580 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579485 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 11:53:41.579580 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579493 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 11:53:41.579580 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.579499 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 11:53:41.580806 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.580796 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 11:53:41.580806 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.580806 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 11:53:41.583774 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.583755 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 11:53:41.583871 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.583795 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 11:53:41.583920 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.583871 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 11:53:41.584245 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.584232 2578 server.go:1268] "Started kubelet" Jul 05 11:53:41.585222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.584823 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 11:53:41.585222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.584657 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 11:53:41.585357 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.585269 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 11:53:41.585394 ip-10-0-136-198 systemd[1]: Started Kubernetes Kubelet. Jul 05 11:53:41.591122 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.590919 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 11:53:41.591405 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.591350 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltkb4" Jul 05 11:53:41.593129 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.593105 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltkb4" Jul 05 11:53:41.593414 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.593391 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 11:53:41.594211 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.594195 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 05 11:53:41.595368 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.594619 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-198.ec2.internal.18bf62a11d61b3af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-198.ec2.internal,UID:ip-10-0-136-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-198.ec2.internal,},FirstTimestamp:2026-07-05 11:53:41.584204719 +0000 UTC m=+0.322742227,LastTimestamp:2026-07-05 11:53:41.584204719 +0000 UTC m=+0.322742227,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-198.ec2.internal,}" Jul 05 11:53:41.598138 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598116 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 11:53:41.598138 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598129 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 11:53:41.598269 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.598202 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:41.598654 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598620 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 11:53:41.598737 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598704 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 11:53:41.598737 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598720 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 11:53:41.598891 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598806 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 05 11:53:41.598891 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.598817 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 05 11:53:41.599059 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599035 2578 factory.go:55] Registering systemd factory Jul 05 11:53:41.599109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599065 2578 factory.go:223] Registration of the systemd container factory successfully Jul 05 11:53:41.599410 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599393 2578 factory.go:153] Registering CRI-O factory Jul 05 11:53:41.599476 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599412 2578 factory.go:223] Registration of the crio container factory successfully Jul 05 11:53:41.599476 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599463 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 11:53:41.599550 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599488 2578 factory.go:103] Registering Raw factory Jul 05 11:53:41.599550 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599503 2578 manager.go:1196] Started watching for new ooms in manager Jul 05 11:53:41.599826 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.599816 2578 manager.go:349] Starting recovery of all containers Jul 05 11:53:41.608493 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.608470 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 11:53:41.610171 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.610154 2578 manager.go:354] Recovery completed Jul 05 11:53:41.611071 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.611039 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-198.ec2.internal\" not found" node="ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.611638 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.611579 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 05 11:53:41.614659 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.614646 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.616751 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.616735 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.616824 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.616766 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.616824 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.616789 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.617310 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.617294 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 11:53:41.617389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.617309 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 11:53:41.617389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.617331 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 05 11:53:41.617389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.617336 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.618162 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.618144 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.618243 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.618173 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.618243 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.618183 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.619678 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.619665 2578 policy_none.go:49] "None policy: Start" Jul 05 11:53:41.619734 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.619682 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 11:53:41.619734 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.619694 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 11:53:41.621869 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.621855 2578 policy_none.go:47] "Start" Jul 05 11:53:41.655734 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.655718 2578 manager.go:337] "Starting Device Plugin manager" Jul 05 11:53:41.655848 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.655753 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 11:53:41.655848 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.655765 2578 server.go:87] "Starting device plugin registration server" Jul 05 11:53:41.656005 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.655992 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 11:53:41.656043 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.656010 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 11:53:41.656142 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.656108 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 11:53:41.656215 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.656198 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 11:53:41.656259 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.656216 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 11:53:41.656746 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.656726 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 11:53:41.656842 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.656782 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:41.737790 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.737746 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 11:53:41.740222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.739172 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 11:53:41.740222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.739222 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 11:53:41.740222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.739309 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 11:53:41.740222 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.739348 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 11:53:41.741907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.741886 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 11:53:41.756993 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.756974 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.757967 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.757953 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.758031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.757982 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.758031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.757994 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.758031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.758018 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.763678 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.763634 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.763678 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.763660 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-198.ec2.internal\": node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:41.781106 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.781060 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:41.840102 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.840043 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal"] Jul 05 11:53:41.840293 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.840159 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.841995 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.841976 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.842098 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.842018 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.842098 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.842043 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.844579 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.844566 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.844749 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.844735 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.844788 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.844765 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.845479 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.845459 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.845547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.845489 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.845547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.845510 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.845547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.845510 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.845547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.845532 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.845547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.845544 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.847907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.847892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.847994 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.847917 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 11:53:41.848688 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.848674 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" Jul 05 11:53:41.848764 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.848706 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 11:53:41.848764 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.848723 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" Jul 05 11:53:41.869933 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.869907 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-198.ec2.internal\" not found" node="ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.874575 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.874557 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-198.ec2.internal\" not found" node="ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.882056 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.882040 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:41.901254 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.901233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bb0963c382b2442e093109581c52883-config\") pod \"kube-apiserver-proxy-ip-10-0-136-198.ec2.internal\" (UID: \"4bb0963c382b2442e093109581c52883\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.901320 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.901264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf58a048dec5ee7c100028553997da99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"bf58a048dec5ee7c100028553997da99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.901320 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:41.901285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf58a048dec5ee7c100028553997da99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"bf58a048dec5ee7c100028553997da99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:41.983701 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:41.983662 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.002411 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.002370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf58a048dec5ee7c100028553997da99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"bf58a048dec5ee7c100028553997da99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.002411 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.002417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bb0963c382b2442e093109581c52883-config\") pod \"kube-apiserver-proxy-ip-10-0-136-198.ec2.internal\" (UID: \"4bb0963c382b2442e093109581c52883\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.002526 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.002441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf58a048dec5ee7c100028553997da99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"bf58a048dec5ee7c100028553997da99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.002526 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.002486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf58a048dec5ee7c100028553997da99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"bf58a048dec5ee7c100028553997da99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.002526 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.002502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bb0963c382b2442e093109581c52883-config\") pod \"kube-apiserver-proxy-ip-10-0-136-198.ec2.internal\" (UID: \"4bb0963c382b2442e093109581c52883\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.002635 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.002546 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf58a048dec5ee7c100028553997da99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"bf58a048dec5ee7c100028553997da99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.084000 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.083920 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.174117 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.174084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.177830 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.177811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.184878 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.184860 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.290932 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.290888 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.391299 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.391217 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.491724 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.491689 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.535777 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.535737 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 11:53:42.536257 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.535908 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 11:53:42.536257 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.535915 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 11:53:42.592079 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.592042 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.599589 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.598970 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 11:48:41 +0000 UTC" deadline="2028-04-02 13:37:35.387109094 +0000 UTC" Jul 05 11:53:42.599589 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.598998 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15289h43m52.788114689s" Jul 05 11:53:42.692416 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.692332 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.740115 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:42.740078 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf58a048dec5ee7c100028553997da99.slice/crio-ca38e5212c1d8ea406db7decd4c690b5cfea2d310b682d029d4cfcdc0ba5f3a6 WatchSource:0}: Error finding container ca38e5212c1d8ea406db7decd4c690b5cfea2d310b682d029d4cfcdc0ba5f3a6: Status 404 returned error can't find the container with id ca38e5212c1d8ea406db7decd4c690b5cfea2d310b682d029d4cfcdc0ba5f3a6 Jul 05 11:53:42.740928 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:42.740895 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb0963c382b2442e093109581c52883.slice/crio-c255e6354ef9cec11e48db60f6cdcd0384d359d3b907d4b4e2c01bc680a5408a WatchSource:0}: Error finding container c255e6354ef9cec11e48db60f6cdcd0384d359d3b907d4b4e2c01bc680a5408a: Status 404 returned error can't find the container with id c255e6354ef9cec11e48db60f6cdcd0384d359d3b907d4b4e2c01bc680a5408a Jul 05 11:53:42.748512 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.748497 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 11:53:42.793165 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.793121 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.886239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.886211 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 11:53:42.894095 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:42.894072 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" Jul 05 11:53:42.896168 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.896148 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 11:53:42.898566 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.898553 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.909342 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.909325 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 11:53:42.910186 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.910173 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" Jul 05 11:53:42.919123 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:42.919099 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 11:53:43.575575 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.575532 2578 apiserver.go:52] "Watching apiserver" Jul 05 11:53:43.586390 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.585478 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 11:53:43.586713 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.586682 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-c2vkk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal","openshift-multus/multus-additional-cni-plugins-c62wx","openshift-multus/network-metrics-daemon-4kqfb","openshift-network-diagnostics/network-check-target-dkpl9","openshift-network-operator/iptables-alerter-z4mdd","kube-system/global-pull-secret-syncer-nkq5j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l","openshift-cluster-node-tuning-operator/tuned-mzvcp","openshift-image-registry/node-ca-ktxnk","openshift-multus/multus-zrx7v","openshift-ovn-kubernetes/ovnkube-node-sgt4q","kube-system/konnectivity-agent-stwmn","kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal"] Jul 05 11:53:43.589871 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.589849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.589987 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.589936 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:43.592949 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.592924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.595712 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.595692 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 11:53:43.596007 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.595984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.596130 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.596098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6c8mp\"" Jul 05 11:53:43.596387 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.595994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 11:53:43.598439 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.598178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:43.598439 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.598248 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:43.598814 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.598797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 11:53:43.598951 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.598933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g5qcq\"" Jul 05 11:53:43.599043 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.598895 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 11:53:43.599043 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.598980 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 11:53:43.599188 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.599161 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.599337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.599323 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 11:53:43.599620 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.598844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.600775 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.600664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:43.600775 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.600727 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:43.604341 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.603396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.605858 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.605477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.605858 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.605639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 11:53:43.606037 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.606022 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.606166 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.606146 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.606246 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.606205 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t6ct2\"" Jul 05 11:53:43.607874 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.607850 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.608252 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.608230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.608399 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.608384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jql6j\"" Jul 05 11:53:43.608709 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.608688 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.610072 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f46348ea-412d-42fd-b501-302d85d984dc-agent-certs\") pod \"konnectivity-agent-stwmn\" (UID: \"f46348ea-412d-42fd-b501-302d85d984dc\") " pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.610196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-cnibin\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-cni-binary-copy\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgc79\" (UniqueName: \"kubernetes.io/projected/a2a8c44b-1654-420e-99f7-bd1bae029a24-kube-api-access-dgc79\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-kubelet-config\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f46348ea-412d-42fd-b501-302d85d984dc-konnectivity-ca\") pod \"konnectivity-agent-stwmn\" (UID: \"f46348ea-412d-42fd-b501-302d85d984dc\") " pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-system-cni-dir\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610430 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610754 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwx99\" (UniqueName: \"kubernetes.io/projected/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-kube-api-access-mwx99\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:43.610754 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-dbus\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.610754 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-os-release\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610754 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.610968 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610800 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.610968 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610839 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.610968 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.610945 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nl7dm\"" Jul 05 11:53:43.611772 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.611172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.614045 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.613706 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.614045 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.613709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t6sz5\"" Jul 05 11:53:43.614045 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.613812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.614045 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.613845 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.614045 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.613916 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 11:53:43.614045 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.613709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 11:53:43.616396 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.616369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.616594 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.616576 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jfpp7\"" Jul 05 11:53:43.616756 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.616736 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 11:53:43.616851 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.616742 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.616851 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.616836 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.618705 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.618684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.619248 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.619211 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 11:53:43.619802 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.619784 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rh2dl\"" Jul 05 11:53:43.621411 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.621357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 11:53:43.621481 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.621441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 11:53:43.621958 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.621559 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 11:53:43.621958 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.621763 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 11:53:43.621958 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.621764 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 11:53:43.622596 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.622558 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c9qhj\"" Jul 05 11:53:43.622596 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.622584 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 11:53:43.634539 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.634243 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-862vn" Jul 05 11:53:43.640816 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.640788 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-862vn" Jul 05 11:53:43.699374 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.699343 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 11:53:43.711333 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-cnibin\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.711483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-lib-modules\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.711483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sss52\" (UniqueName: \"kubernetes.io/projected/3f5659d9-2af0-4bdf-845b-d7087d5a983f-kube-api-access-sss52\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.711483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-dbus\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.711483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.711483 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-device-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxlct\" (UniqueName: \"kubernetes.io/projected/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-kube-api-access-zxlct\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-env-overrides\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65a7db95-68c2-481c-89b5-1df722115e67-ovn-node-metrics-cert\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-kubernetes\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-dbus\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-systemd\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgc79\" (UniqueName: \"kubernetes.io/projected/a2a8c44b-1654-420e-99f7-bd1bae029a24-kube-api-access-dgc79\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-cni-multus\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f5659d9-2af0-4bdf-845b-d7087d5a983f-serviceca\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.711771 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-hosts-file\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.711904 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.711910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jrz\" (UniqueName: \"kubernetes.io/projected/0d686916-19f8-464a-8e1c-e252b17a35df-kube-api-access-h4jrz\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.712008 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:44.211968313 +0000 UTC m=+2.950505810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-modprobe-d\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712052 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-run\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-os-release\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-conf-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.712237 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-log-socket\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-iptables-alerter-script\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-hostroot\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-systemd-units\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-ovn\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-cni-netd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysctl-d\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.712518 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-socket-dir-parent\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.712624 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:44.212604486 +0000 UTC m=+2.951141997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:43.712695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d686916-19f8-464a-8e1c-e252b17a35df-multus-daemon-config\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgdwb\" (UniqueName: \"kubernetes.io/projected/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-kube-api-access-lgdwb\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-etc-kubernetes\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-etc-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-ovnkube-config\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-ovnkube-script-lib\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-host\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-kubelet-config\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-system-cni-dir\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.712983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysctl-conf\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-kubelet-config\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-os-release\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-cni-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-os-release\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d686916-19f8-464a-8e1c-e252b17a35df-cni-binary-copy\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713098 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-system-cni-dir\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.713305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-cni-bin\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-node-log\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysconfig\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-sys\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f5659d9-2af0-4bdf-845b-d7087d5a983f-host\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f46348ea-412d-42fd-b501-302d85d984dc-agent-certs\") pod \"konnectivity-agent-stwmn\" (UID: \"f46348ea-412d-42fd-b501-302d85d984dc\") " pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-cnibin\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-cni-binary-copy\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-cnibin\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-registration-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-sys-fs\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-netns\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-multus-certs\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713810 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-run-netns\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714049 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-var-lib-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-cni-bin\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-tuned\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-cni-binary-copy\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.713988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f46348ea-412d-42fd-b501-302d85d984dc-konnectivity-ca\") pod \"konnectivity-agent-stwmn\" (UID: \"f46348ea-412d-42fd-b501-302d85d984dc\") " pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-host-slash\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66kgb\" (UniqueName: \"kubernetes.io/projected/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-kube-api-access-66kgb\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-kubelet\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-slash\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-systemd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-kubelet\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxvd\" (UniqueName: \"kubernetes.io/projected/65a7db95-68c2-481c-89b5-1df722115e67-kube-api-access-wtxvd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvt9x\" (UniqueName: \"kubernetes.io/projected/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-kube-api-access-nvt9x\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-socket-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.714865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-k8s-cni-cncf-io\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-tmp\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-tmp-dir\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-system-cni-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-var-lib-kubelet\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a8c44b-1654-420e-99f7-bd1bae029a24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714752 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f46348ea-412d-42fd-b501-302d85d984dc-konnectivity-ca\") pod \"konnectivity-agent-stwmn\" (UID: \"f46348ea-412d-42fd-b501-302d85d984dc\") " pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwx99\" (UniqueName: \"kubernetes.io/projected/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-kube-api-access-mwx99\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:43.715477 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.714840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a8c44b-1654-420e-99f7-bd1bae029a24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.718031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.718001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f46348ea-412d-42fd-b501-302d85d984dc-agent-certs\") pod \"konnectivity-agent-stwmn\" (UID: \"f46348ea-412d-42fd-b501-302d85d984dc\") " pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.720175 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.720088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgc79\" (UniqueName: \"kubernetes.io/projected/a2a8c44b-1654-420e-99f7-bd1bae029a24-kube-api-access-dgc79\") pod \"multus-additional-cni-plugins-c62wx\" (UID: \"a2a8c44b-1654-420e-99f7-bd1bae029a24\") " pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.721684 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.721666 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:53:43.721780 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.721681 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 11:53:43.721780 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.721691 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:53:43.721780 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.721730 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:43.721951 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:43.721815 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:44.22177936 +0000 UTC m=+2.960316857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:43.725705 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.725683 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwx99\" (UniqueName: \"kubernetes.io/projected/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-kube-api-access-mwx99\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:43.745555 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.745486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" event={"ID":"bf58a048dec5ee7c100028553997da99","Type":"ContainerStarted","Data":"ca38e5212c1d8ea406db7decd4c690b5cfea2d310b682d029d4cfcdc0ba5f3a6"} Jul 05 11:53:43.746993 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.746964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" event={"ID":"4bb0963c382b2442e093109581c52883","Type":"ContainerStarted","Data":"c255e6354ef9cec11e48db60f6cdcd0384d359d3b907d4b4e2c01bc680a5408a"} Jul 05 11:53:43.816031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.815995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sss52\" (UniqueName: \"kubernetes.io/projected/3f5659d9-2af0-4bdf-845b-d7087d5a983f-kube-api-access-sss52\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.816031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-device-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.816031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxlct\" (UniqueName: \"kubernetes.io/projected/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-kube-api-access-zxlct\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-env-overrides\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65a7db95-68c2-481c-89b5-1df722115e67-ovn-node-metrics-cert\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-kubernetes\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-systemd\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-systemd\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-device-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.816337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-kubernetes\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-cni-multus\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f5659d9-2af0-4bdf-845b-d7087d5a983f-serviceca\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-hosts-file\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-cni-multus\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-hosts-file\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jrz\" (UniqueName: \"kubernetes.io/projected/0d686916-19f8-464a-8e1c-e252b17a35df-kube-api-access-h4jrz\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-modprobe-d\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-run\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-run\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-os-release\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.816711 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-conf-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-env-overrides\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-log-socket\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-modprobe-d\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-log-socket\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-os-release\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-conf-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-iptables-alerter-script\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f5659d9-2af0-4bdf-845b-d7087d5a983f-serviceca\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-hostroot\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-hostroot\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.816978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-systemd-units\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-ovn\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-cni-netd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysctl-d\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.817305 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-ovn\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-cni-netd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-systemd-units\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-socket-dir-parent\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysctl-d\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d686916-19f8-464a-8e1c-e252b17a35df-multus-daemon-config\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdwb\" (UniqueName: \"kubernetes.io/projected/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-kube-api-access-lgdwb\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-socket-dir-parent\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-etc-kubernetes\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-etc-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-ovnkube-config\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-ovnkube-script-lib\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-host\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysctl-conf\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-cni-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d686916-19f8-464a-8e1c-e252b17a35df-cni-binary-copy\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-iptables-alerter-script\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-cni-bin\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818069 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-cni-bin\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-multus-cni-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysctl-conf\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d686916-19f8-464a-8e1c-e252b17a35df-multus-daemon-config\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-ovnkube-config\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-host\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-etc-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-node-log\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-node-log\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysconfig\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-sys\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.817999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-sysconfig\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f5659d9-2af0-4bdf-845b-d7087d5a983f-host\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-etc-kubernetes\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-registration-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-sys-fs\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818079 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-sys\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.818893 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818114 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d686916-19f8-464a-8e1c-e252b17a35df-cni-binary-copy\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-registration-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f5659d9-2af0-4bdf-845b-d7087d5a983f-host\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-netns\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-multus-certs\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818226 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-sys-fs\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65a7db95-68c2-481c-89b5-1df722115e67-ovnkube-script-lib\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-run-netns\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-netns\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-multus-certs\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-var-lib-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-var-lib-openvswitch\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-cni-bin\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-tuned\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-cni-bin\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.819759 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818349 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-run-netns\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-host-slash\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-host-slash\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66kgb\" (UniqueName: \"kubernetes.io/projected/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-kube-api-access-66kgb\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-kubelet\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-slash\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-systemd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-kubelet\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxvd\" (UniqueName: \"kubernetes.io/projected/65a7db95-68c2-481c-89b5-1df722115e67-kube-api-access-wtxvd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvt9x\" (UniqueName: \"kubernetes.io/projected/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-kube-api-access-nvt9x\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-socket-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-k8s-cni-cncf-io\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-tmp\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-kubelet\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-tmp-dir\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-system-cni-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.820676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-var-lib-kubelet\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-cnibin\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-lib-modules\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-run-systemd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-lib-modules\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-tmp-dir\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.818994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-slash\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-var-lib-kubelet\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-system-cni-dir\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-var-lib-kubelet\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819098 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-cnibin\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-socket-dir\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65a7db95-68c2-481c-89b5-1df722115e67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d686916-19f8-464a-8e1c-e252b17a35df-host-run-k8s-cni-cncf-io\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.819437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65a7db95-68c2-481c-89b5-1df722115e67-ovn-node-metrics-cert\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.820676 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-etc-tuned\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.821595 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.821154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-tmp\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.825079 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.825051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jrz\" (UniqueName: \"kubernetes.io/projected/0d686916-19f8-464a-8e1c-e252b17a35df-kube-api-access-h4jrz\") pod \"multus-zrx7v\" (UID: \"0d686916-19f8-464a-8e1c-e252b17a35df\") " pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.825358 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.825312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxlct\" (UniqueName: \"kubernetes.io/projected/7ecbd435-c39a-47b9-b6b5-703f531e3bf0-kube-api-access-zxlct\") pod \"aws-ebs-csi-driver-node-7v24l\" (UID: \"7ecbd435-c39a-47b9-b6b5-703f531e3bf0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.825456 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.825350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sss52\" (UniqueName: \"kubernetes.io/projected/3f5659d9-2af0-4bdf-845b-d7087d5a983f-kube-api-access-sss52\") pod \"node-ca-ktxnk\" (UID: \"3f5659d9-2af0-4bdf-845b-d7087d5a983f\") " pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.825779 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.825729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgdwb\" (UniqueName: \"kubernetes.io/projected/e533d37f-f1e5-487a-8d3a-aa0ae443b7c3-kube-api-access-lgdwb\") pod \"tuned-mzvcp\" (UID: \"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3\") " pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.827113 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.827044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66kgb\" (UniqueName: \"kubernetes.io/projected/9890b779-e513-4aa4-9c0e-2c48eacbc0ff-kube-api-access-66kgb\") pod \"iptables-alerter-z4mdd\" (UID: \"9890b779-e513-4aa4-9c0e-2c48eacbc0ff\") " pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.827337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.827319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvt9x\" (UniqueName: \"kubernetes.io/projected/d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7-kube-api-access-nvt9x\") pod \"node-resolver-c2vkk\" (UID: \"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7\") " pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.827429 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.827405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxvd\" (UniqueName: \"kubernetes.io/projected/65a7db95-68c2-481c-89b5-1df722115e67-kube-api-access-wtxvd\") pod \"ovnkube-node-sgt4q\" (UID: \"65a7db95-68c2-481c-89b5-1df722115e67\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:43.852665 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.852629 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 11:53:43.907901 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.907865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:53:43.916478 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.916449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c62wx" Jul 05 11:53:43.928080 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.928039 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4mdd" Jul 05 11:53:43.937793 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.937766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" Jul 05 11:53:43.945432 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.945410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2vkk" Jul 05 11:53:43.954157 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.954125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" Jul 05 11:53:43.963239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.963212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktxnk" Jul 05 11:53:43.970224 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.970203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrx7v" Jul 05 11:53:43.976084 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:43.976053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:53:44.222106 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.222005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:44.222106 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.222078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.222130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222248 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222263 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222283 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222299 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222326 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:45.222305482 +0000 UTC m=+3.960842987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222248 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:44.222350 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222345 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:45.222334804 +0000 UTC m=+3.960872301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:44.222726 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.222363 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:45.222352361 +0000 UTC m=+3.960889861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:44.644804 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.644732 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 11:48:43 +0000 UTC" deadline="2028-01-08 11:07:52.892765382 +0000 UTC" Jul 05 11:53:44.644804 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.644760 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13247h14m8.248008167s" Jul 05 11:53:44.714830 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.714801 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecbd435_c39a_47b9_b6b5_703f531e3bf0.slice/crio-5d8a1a8099d805fd469fbce97f3a9cb2b17b9bfbf89b3c517a33abd4e6246fe9 WatchSource:0}: Error finding container 5d8a1a8099d805fd469fbce97f3a9cb2b17b9bfbf89b3c517a33abd4e6246fe9: Status 404 returned error can't find the container with id 5d8a1a8099d805fd469fbce97f3a9cb2b17b9bfbf89b3c517a33abd4e6246fe9 Jul 05 11:53:44.716943 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.716913 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46348ea_412d_42fd_b501_302d85d984dc.slice/crio-1be098a67ae573e00d44d0efc3111377a680ccade701b9e9647b76224bb89b66 WatchSource:0}: Error finding container 1be098a67ae573e00d44d0efc3111377a680ccade701b9e9647b76224bb89b66: Status 404 returned error can't find the container with id 1be098a67ae573e00d44d0efc3111377a680ccade701b9e9647b76224bb89b66 Jul 05 11:53:44.717576 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.717390 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b7aed2_c9e7_4060_a03c_4d99c49dc0e7.slice/crio-349f16cdd0bf0587555f11e8067d27ea28a8657cd37f34660ee2b215c81754fa WatchSource:0}: Error finding container 349f16cdd0bf0587555f11e8067d27ea28a8657cd37f34660ee2b215c81754fa: Status 404 returned error can't find the container with id 349f16cdd0bf0587555f11e8067d27ea28a8657cd37f34660ee2b215c81754fa Jul 05 11:53:44.721161 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.721133 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5659d9_2af0_4bdf_845b_d7087d5a983f.slice/crio-9e7b9659698e76d339bf89865e7ba3311ad169d8fbeae30284838e7f91fb5980 WatchSource:0}: Error finding container 9e7b9659698e76d339bf89865e7ba3311ad169d8fbeae30284838e7f91fb5980: Status 404 returned error can't find the container with id 9e7b9659698e76d339bf89865e7ba3311ad169d8fbeae30284838e7f91fb5980 Jul 05 11:53:44.721893 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.721877 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode533d37f_f1e5_487a_8d3a_aa0ae443b7c3.slice/crio-93e4ab9950ddd4b0133dabc27b3d00c60fa7877babb6d325acdc11fe04192374 WatchSource:0}: Error finding container 93e4ab9950ddd4b0133dabc27b3d00c60fa7877babb6d325acdc11fe04192374: Status 404 returned error can't find the container with id 93e4ab9950ddd4b0133dabc27b3d00c60fa7877babb6d325acdc11fe04192374 Jul 05 11:53:44.726642 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.726617 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d686916_19f8_464a_8e1c_e252b17a35df.slice/crio-3967baa4957cbaedbb261a1c2bddce05c58919201723c47e82fc6cfba2fb258c WatchSource:0}: Error finding container 3967baa4957cbaedbb261a1c2bddce05c58919201723c47e82fc6cfba2fb258c: Status 404 returned error can't find the container with id 3967baa4957cbaedbb261a1c2bddce05c58919201723c47e82fc6cfba2fb258c Jul 05 11:53:44.727529 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.727508 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a8c44b_1654_420e_99f7_bd1bae029a24.slice/crio-a6ab5d0df0960c9185046c557790a7d34f428ae61ef18ef3cd4cd057ca17f934 WatchSource:0}: Error finding container a6ab5d0df0960c9185046c557790a7d34f428ae61ef18ef3cd4cd057ca17f934: Status 404 returned error can't find the container with id a6ab5d0df0960c9185046c557790a7d34f428ae61ef18ef3cd4cd057ca17f934 Jul 05 11:53:44.728451 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:53:44.728322 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a7db95_68c2_481c_89b5_1df722115e67.slice/crio-891fc0eb7255ae5d3ab203782969a86c185bbde778c3937dd0a9579c4a87f5e5 WatchSource:0}: Error finding container 891fc0eb7255ae5d3ab203782969a86c185bbde778c3937dd0a9579c4a87f5e5: Status 404 returned error can't find the container with id 891fc0eb7255ae5d3ab203782969a86c185bbde778c3937dd0a9579c4a87f5e5 Jul 05 11:53:44.739625 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.739603 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:44.739709 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.739603 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:44.739745 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.739707 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:44.739798 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.739782 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:44.739838 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.739615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:44.739924 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:44.739859 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:44.749188 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.749161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrx7v" event={"ID":"0d686916-19f8-464a-8e1c-e252b17a35df","Type":"ContainerStarted","Data":"3967baa4957cbaedbb261a1c2bddce05c58919201723c47e82fc6cfba2fb258c"} Jul 05 11:53:44.750558 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.750523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" event={"ID":"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3","Type":"ContainerStarted","Data":"93e4ab9950ddd4b0133dabc27b3d00c60fa7877babb6d325acdc11fe04192374"} Jul 05 11:53:44.751906 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.751880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktxnk" event={"ID":"3f5659d9-2af0-4bdf-845b-d7087d5a983f","Type":"ContainerStarted","Data":"9e7b9659698e76d339bf89865e7ba3311ad169d8fbeae30284838e7f91fb5980"} Jul 05 11:53:44.753075 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.753040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4mdd" event={"ID":"9890b779-e513-4aa4-9c0e-2c48eacbc0ff","Type":"ContainerStarted","Data":"2425735c1914a9afa23d040958554b72c62a69d0633f1f5f8d534b767ecea168"} Jul 05 11:53:44.754220 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.754191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerStarted","Data":"a6ab5d0df0960c9185046c557790a7d34f428ae61ef18ef3cd4cd057ca17f934"} Jul 05 11:53:44.755221 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.755201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2vkk" event={"ID":"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7","Type":"ContainerStarted","Data":"349f16cdd0bf0587555f11e8067d27ea28a8657cd37f34660ee2b215c81754fa"} Jul 05 11:53:44.756224 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.756190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stwmn" event={"ID":"f46348ea-412d-42fd-b501-302d85d984dc","Type":"ContainerStarted","Data":"1be098a67ae573e00d44d0efc3111377a680ccade701b9e9647b76224bb89b66"} Jul 05 11:53:44.757379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.757350 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" event={"ID":"7ecbd435-c39a-47b9-b6b5-703f531e3bf0","Type":"ContainerStarted","Data":"5d8a1a8099d805fd469fbce97f3a9cb2b17b9bfbf89b3c517a33abd4e6246fe9"} Jul 05 11:53:44.759274 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:44.759245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"891fc0eb7255ae5d3ab203782969a86c185bbde778c3937dd0a9579c4a87f5e5"} Jul 05 11:53:45.228656 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.228337 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:53:45.228656 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.228618 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:53:45.228656 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.228636 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:45.228953 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.228705 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:47.228684201 +0000 UTC m=+5.967221721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:45.229092 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.228178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:45.229227 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.229206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:45.229290 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.229260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:45.229389 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.229374 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:45.229450 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.229432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:47.229415519 +0000 UTC m=+5.967953018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:45.229512 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.229500 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:45.229570 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:45.229535 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:47.229523461 +0000 UTC m=+5.968060964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:45.645389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.645260 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 11:48:43 +0000 UTC" deadline="2028-02-21 15:40:18.355182356 +0000 UTC" Jul 05 11:53:45.645389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.645331 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14307h46m32.709855777s" Jul 05 11:53:45.782412 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.781710 2578 generic.go:356] "Generic (PLEG): container finished" podID="bf58a048dec5ee7c100028553997da99" containerID="990428031f3249c011d603d7feff61805719b3ea1278ebddb0e9efe2ce272050" exitCode=0 Jul 05 11:53:45.782412 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.781823 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" event={"ID":"bf58a048dec5ee7c100028553997da99","Type":"ContainerDied","Data":"990428031f3249c011d603d7feff61805719b3ea1278ebddb0e9efe2ce272050"} Jul 05 11:53:45.801727 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:45.801681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" event={"ID":"4bb0963c382b2442e093109581c52883","Type":"ContainerStarted","Data":"eca72eab5aa883efff77a2a1b6a42f89d3fa5e96b7dc676e2a1d70e7e4088706"} Jul 05 11:53:46.740758 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:46.739912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:46.740758 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:46.740076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:46.740758 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:46.740489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:46.740758 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:46.740594 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:46.740758 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:46.740651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:46.740758 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:46.740716 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:46.822145 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:46.822110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" event={"ID":"bf58a048dec5ee7c100028553997da99","Type":"ContainerStarted","Data":"197f8bcc364c61e6f01167b3b5fb4a3b6be0beab89ce08064e810f1fcd53a007"} Jul 05 11:53:46.834724 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:46.834667 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" podStartSLOduration=3.834645548 podStartE2EDuration="3.834645548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:53:45.816667399 +0000 UTC m=+4.555204920" watchObservedRunningTime="2026-07-05 11:53:46.834645548 +0000 UTC m=+5.573183068" Jul 05 11:53:47.247632 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:47.247589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:47.247811 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:47.247659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:47.247811 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:47.247695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:47.247940 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.247878 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:53:47.247940 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.247901 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:53:47.247940 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.247914 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:47.248124 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.247971 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:51.247954037 +0000 UTC m=+9.986491535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:47.248394 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.248371 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:47.248469 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.248428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:51.248414524 +0000 UTC m=+9.986952022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:47.248543 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.248486 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:47.248543 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:47.248518 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:51.24850769 +0000 UTC m=+9.987045188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:48.739520 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:48.739487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:48.740000 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:48.739623 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:48.740000 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:48.739885 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:48.740000 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:48.739977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:48.740000 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:48.739979 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:48.740225 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:48.740110 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:50.740123 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:50.739827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:50.740123 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:50.739861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:50.740123 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:50.739975 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:50.740123 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:50.740008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:50.740753 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:50.740133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:50.740753 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:50.740228 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:51.285666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:51.285627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:51.285840 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:51.285685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:51.285840 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:51.285719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:51.285960 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.285854 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:53:51.285960 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.285875 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:53:51.285960 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.285888 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:51.285960 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.285946 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:59.28592699 +0000 UTC m=+18.024464505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:51.286399 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.286289 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:51.286399 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.286349 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:51.286399 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.286354 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:59.286336256 +0000 UTC m=+18.024873756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:51.286619 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:51.286415 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:53:59.286400391 +0000 UTC m=+18.024937892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:52.739677 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:52.739636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:52.740085 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:52.739782 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:52.740292 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:52.740263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:52.740423 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:52.740359 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:52.740423 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:52.740263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:52.740521 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:52.740467 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:54.740101 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:54.740026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:54.740101 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:54.740081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:54.740686 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:54.740158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:54.740686 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:54.740174 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:54.740686 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:54.740253 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:54.740686 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:54.740315 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:56.739835 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:56.739796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:56.740317 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:56.739846 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:56.740317 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:56.739849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:56.740317 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:56.739937 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:56.740317 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:56.740030 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:56.740317 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:56.740145 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:58.739655 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:58.739618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:58.740179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:58.739732 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:58.740179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:58.739745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:58.740179 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:58.739741 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:53:58.740179 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:58.739857 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:53:58.740179 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:58.739954 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:53:59.349222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:59.349174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:53:59.349427 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:59.349239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:53:59.349427 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:53:59.349273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:53:59.349427 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349369 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:59.349427 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349418 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:53:59.349639 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349422 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:59.349639 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349437 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:53:59.349639 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349453 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:53:59.349639 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349455 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:15.349433152 +0000 UTC m=+34.087970648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:53:59.349639 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349516 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:15.349499383 +0000 UTC m=+34.088036883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:53:59.349639 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:53:59.349534 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:15.349523453 +0000 UTC m=+34.088060952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:54:00.740234 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:00.740188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:00.740234 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:00.740221 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:00.740234 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:00.740232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:00.740772 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:00.740324 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:00.740772 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:00.740396 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:00.740772 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:00.740508 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:02.740408 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:02.740373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:02.740826 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:02.740385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:02.740826 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:02.740502 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:02.740826 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:02.740527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:02.740826 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:02.740612 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:02.740826 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:02.740681 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:04.740654 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.740451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:04.741521 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.740508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:04.741521 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:04.740756 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:04.741521 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:04.740859 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:04.741521 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.740509 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:04.741521 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:04.740952 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:04.869918 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.869836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"df367cd4ef8f92fab3c1d98ddf5fa3f4bb9833853b0c16a1909d738b81136e94"} Jul 05 11:54:04.869918 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.869911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"cb436fd55ad636651ec4671fb054a631a8610c89d9321c0d349bb17b1c1113f9"} Jul 05 11:54:04.870161 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.869954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"281ac901fbb3acc6732c0aff099212a61bfea58dbf3136d43cc03ae5864b70aa"} Jul 05 11:54:04.870161 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.869985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"aa1098f946fb58d815d69e80051ac5c575bb3ec54c9d543db3e99cf74329eba2"} Jul 05 11:54:04.870161 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.870031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"a73919928edee6bbf97f959316ad26e94de77aded339da7e5e8d8890a5fdfa17"} Jul 05 11:54:04.870161 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.870088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"4318a5327c46f6a3bb93f1c7b69a7d0012d3d71007850f19f37b7c3675da041a"} Jul 05 11:54:04.871219 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.871191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrx7v" event={"ID":"0d686916-19f8-464a-8e1c-e252b17a35df","Type":"ContainerStarted","Data":"7edc08b77d4335ada9b2850aca7d633d26655f489ac3237380eae8740bb59acd"} Jul 05 11:54:04.872634 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.872606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" event={"ID":"e533d37f-f1e5-487a-8d3a-aa0ae443b7c3","Type":"ContainerStarted","Data":"549b4e58b87834e99b731e8d981e56851b2cae802d32ffe95cc3bbf640bcbd6d"} Jul 05 11:54:04.873951 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.873926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktxnk" event={"ID":"3f5659d9-2af0-4bdf-845b-d7087d5a983f","Type":"ContainerStarted","Data":"da0258e408f12456a8225229c7a91d64a21fe82e132e057d7a357437ff217314"} Jul 05 11:54:04.875364 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.875344 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2a8c44b-1654-420e-99f7-bd1bae029a24" containerID="6fec2b6d12cdbfb7abb5901d6fd71e804e787321b3ddea950284fa1d9873edd9" exitCode=0 Jul 05 11:54:04.875475 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.875410 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerDied","Data":"6fec2b6d12cdbfb7abb5901d6fd71e804e787321b3ddea950284fa1d9873edd9"} Jul 05 11:54:04.876836 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.876815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2vkk" event={"ID":"d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7","Type":"ContainerStarted","Data":"846059dd0dee8605a0bd79f058366466a12f10a22d0d5f74295c7a1c8298c9b2"} Jul 05 11:54:04.878258 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.878239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stwmn" event={"ID":"f46348ea-412d-42fd-b501-302d85d984dc","Type":"ContainerStarted","Data":"41a7fba8cc7338940474d97a2398bc0c8761fe949dbb46f885ab8bb884c72757"} Jul 05 11:54:04.879527 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.879509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" event={"ID":"7ecbd435-c39a-47b9-b6b5-703f531e3bf0","Type":"ContainerStarted","Data":"c932d669f7a0cc8622927dbf173354d635e7c02b7b94123967da157b74f829e1"} Jul 05 11:54:04.887536 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.887501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" podStartSLOduration=21.887491074 podStartE2EDuration="21.887491074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:53:46.835981821 +0000 UTC m=+5.574519340" watchObservedRunningTime="2026-07-05 11:54:04.887491074 +0000 UTC m=+23.626028590" Jul 05 11:54:04.887913 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.887891 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zrx7v" podStartSLOduration=3.763600164 podStartE2EDuration="22.887884353s" totalImagesPullingTime="19.124284189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:04.887374162 +0000 UTC m=+23.625911680" watchObservedRunningTime="2026-07-05 11:54:04.887884353 +0000 UTC m=+23.626421869" Jul 05 11:54:04.902628 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.902591 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c2vkk" podStartSLOduration=3.823880238 podStartE2EDuration="22.902577097s" totalImagesPullingTime="19.078696859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:04.902270234 +0000 UTC m=+23.640807750" watchObservedRunningTime="2026-07-05 11:54:04.902577097 +0000 UTC m=+23.641114611" Jul 05 11:54:04.915110 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.915078 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ktxnk" podStartSLOduration=3.843078786 podStartE2EDuration="22.915068657s" totalImagesPullingTime="19.071989871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:04.914520734 +0000 UTC m=+23.653058270" watchObservedRunningTime="2026-07-05 11:54:04.915068657 +0000 UTC m=+23.653606164" Jul 05 11:54:04.927209 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.927177 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-stwmn" podStartSLOduration=8.173793616 podStartE2EDuration="22.927170606s" totalImagesPullingTime="14.75337699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:04.926841329 +0000 UTC m=+23.665378863" watchObservedRunningTime="2026-07-05 11:54:04.927170606 +0000 UTC m=+23.665708123" Jul 05 11:54:04.973192 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:04.973146 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mzvcp" podStartSLOduration=3.884096403 podStartE2EDuration="22.973130249s" totalImagesPullingTime="19.089033846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:04.973095045 +0000 UTC m=+23.711632562" watchObservedRunningTime="2026-07-05 11:54:04.973130249 +0000 UTC m=+23.711667766" Jul 05 11:54:05.348335 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.348304 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 11:54:05.668206 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.668033 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T11:54:05.348328621Z","UUID":"6f09c829-6946-445c-8ae3-06508f8c9765","Handler":null,"Name":"","Endpoint":""} Jul 05 11:54:05.669627 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.669606 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 11:54:05.669751 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.669646 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 11:54:05.884408 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.884365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" event={"ID":"7ecbd435-c39a-47b9-b6b5-703f531e3bf0","Type":"ContainerStarted","Data":"7ba779881e8afd222724d91ce1f07714df8c4b3694c79aa480383d3853e5c5a2"} Jul 05 11:54:05.886222 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.886178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4mdd" event={"ID":"9890b779-e513-4aa4-9c0e-2c48eacbc0ff","Type":"ContainerStarted","Data":"868aa6cffe64a1d3af5be981275be01017cc647c1b43e0c53d0eb02ea647dec0"} Jul 05 11:54:05.902616 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:05.902532 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z4mdd" podStartSLOduration=4.836061347 podStartE2EDuration="23.902512381s" totalImagesPullingTime="19.066451034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:05.901760965 +0000 UTC m=+24.640298522" watchObservedRunningTime="2026-07-05 11:54:05.902512381 +0000 UTC m=+24.641049899" Jul 05 11:54:06.168912 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.168816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:54:06.666437 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.666407 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:54:06.667090 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.667066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:54:06.740282 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.740248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:06.740282 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.740274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:06.740472 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.740278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:06.740472 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:06.740371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:06.740472 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:06.740428 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:06.740619 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:06.740496 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:06.891280 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.891246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" event={"ID":"7ecbd435-c39a-47b9-b6b5-703f531e3bf0","Type":"ContainerStarted","Data":"326d972a659d93455b22b5355be1ca15e880ec90dbfcd2f9fc2aec76f5fae031"} Jul 05 11:54:06.895556 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.895515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"42b3b61b64228dc289f026c2ac5fd84bd08e59d9ff6809b7595841a2ebb6c969"} Jul 05 11:54:06.896351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.896326 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-stwmn" Jul 05 11:54:06.907142 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:06.907089 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v24l" podStartSLOduration=3.565449377 podStartE2EDuration="24.90706975s" totalImagesPullingTime="21.341620373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:06.906658751 +0000 UTC m=+25.645196300" watchObservedRunningTime="2026-07-05 11:54:06.90706975 +0000 UTC m=+25.645607265" Jul 05 11:54:07.684447 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:07.684420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2vkk_d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7/dns-node-resolver/0.log" Jul 05 11:54:08.457165 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:08.456947 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktxnk_3f5659d9-2af0-4bdf-845b-d7087d5a983f/node-ca/0.log" Jul 05 11:54:08.739981 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:08.739889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:08.740173 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:08.740012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:08.740173 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:08.740020 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:08.740173 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:08.740066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:08.740305 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:08.740178 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:08.740305 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:08.740270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:09.903353 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.903271 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2a8c44b-1654-420e-99f7-bd1bae029a24" containerID="ecb42c06438bf3e4d8e8b370980307eb762bb931ce579ba0419b3cd3b94ce1c9" exitCode=0 Jul 05 11:54:09.904186 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.903357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerDied","Data":"ecb42c06438bf3e4d8e8b370980307eb762bb931ce579ba0419b3cd3b94ce1c9"} Jul 05 11:54:09.907230 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.907209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" event={"ID":"65a7db95-68c2-481c-89b5-1df722115e67","Type":"ContainerStarted","Data":"d0580e8b75133d61adab462a24a717a0de0f2c7dcf7a9f314f1230c864e897f4"} Jul 05 11:54:09.907553 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.907523 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:54:09.907652 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.907585 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:54:09.907652 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.907634 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:54:09.923499 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.923344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:54:09.923625 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.923582 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:54:09.949406 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:09.949363 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" podStartSLOduration=8.81334217 podStartE2EDuration="27.949350206s" totalImagesPullingTime="19.136008036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:09.948925953 +0000 UTC m=+28.687463489" watchObservedRunningTime="2026-07-05 11:54:09.949350206 +0000 UTC m=+28.687887722" Jul 05 11:54:10.739533 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:10.739492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:10.739533 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:10.739534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:10.739806 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:10.739504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:10.739806 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:10.739606 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:10.739806 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:10.739685 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:10.739806 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:10.739746 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:10.910955 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:10.910917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerStarted","Data":"3b4c94d04b53359b3cbb401bf19e078c621120ed4b6b1ab07b4c92736bb77394"} Jul 05 11:54:11.914973 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:11.914934 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2a8c44b-1654-420e-99f7-bd1bae029a24" containerID="3b4c94d04b53359b3cbb401bf19e078c621120ed4b6b1ab07b4c92736bb77394" exitCode=0 Jul 05 11:54:11.915371 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:11.915021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerDied","Data":"3b4c94d04b53359b3cbb401bf19e078c621120ed4b6b1ab07b4c92736bb77394"} Jul 05 11:54:12.740459 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:12.740427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:12.740619 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:12.740536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:12.740619 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:12.740546 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:12.740619 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:12.740572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:12.740779 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:12.740674 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:12.740779 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:12.740768 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:12.919790 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:12.919746 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2a8c44b-1654-420e-99f7-bd1bae029a24" containerID="61e78dea110ebdf318a55ac44547e99a11e3bf666d5bf170ed382dcc8cfa7f9f" exitCode=0 Jul 05 11:54:12.919790 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:12.919783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerDied","Data":"61e78dea110ebdf318a55ac44547e99a11e3bf666d5bf170ed382dcc8cfa7f9f"} Jul 05 11:54:14.740153 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:14.740114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:14.740576 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:14.740114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:14.740576 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:14.740241 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:14.740576 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:14.740329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:14.740576 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:14.740114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:14.740576 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:14.740412 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:15.365919 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:15.365885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:15.365938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:15.365973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366029 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366093 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366091 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366107 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 11:54:15.366118 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366121 2578 projected.go:196] Error preparing data for projected volume kube-api-access-b8x8b for pod openshift-network-diagnostics/network-check-target-dkpl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:54:15.366442 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366110 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret podName:0bcd4e58-3a9a-46ac-ac35-ee78766dfe09 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:47.366089763 +0000 UTC m=+66.104627272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret") pod "global-pull-secret-syncer-nkq5j" (UID: "0bcd4e58-3a9a-46ac-ac35-ee78766dfe09") : object "kube-system"/"original-pull-secret" not registered Jul 05 11:54:15.366442 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366163 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs podName:6a9269d7-98c4-4f56-9c35-d0d44b0d17b4 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:47.366150218 +0000 UTC m=+66.104687714 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs") pod "network-metrics-daemon-4kqfb" (UID: "6a9269d7-98c4-4f56-9c35-d0d44b0d17b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 11:54:15.366442 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:15.366185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b podName:68d9d500-7490-48eb-98fb-2d504574ab83 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:47.366175273 +0000 UTC m=+66.104712768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8x8b" (UniqueName: "kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b") pod "network-check-target-dkpl9" (UID: "68d9d500-7490-48eb-98fb-2d504574ab83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 11:54:16.739715 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:16.739677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:16.740210 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:16.739728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:16.740210 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:16.739792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:16.740210 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:16.739814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:16.740210 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:16.739907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:16.740210 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:16.739992 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:17.934238 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:17.934206 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2a8c44b-1654-420e-99f7-bd1bae029a24" containerID="78765af30b6e778f05b1a2838e3943ce09ff2d0900cc821ef6775a43a1e712d3" exitCode=0 Jul 05 11:54:17.934713 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:17.934264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerDied","Data":"78765af30b6e778f05b1a2838e3943ce09ff2d0900cc821ef6775a43a1e712d3"} Jul 05 11:54:18.740068 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:18.740029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:18.740233 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:18.740161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:18.740233 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:18.740172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:18.740233 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:18.740191 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:18.740339 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:18.740275 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:18.740373 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:18.740344 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:18.938958 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:18.938923 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2a8c44b-1654-420e-99f7-bd1bae029a24" containerID="7f92b3f07d5c6356400bd65006bb424ac2738eae0e5a234544fc7a283d769651" exitCode=0 Jul 05 11:54:18.939397 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:18.938972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerDied","Data":"7f92b3f07d5c6356400bd65006bb424ac2738eae0e5a234544fc7a283d769651"} Jul 05 11:54:19.943939 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:19.943905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c62wx" event={"ID":"a2a8c44b-1654-420e-99f7-bd1bae029a24","Type":"ContainerStarted","Data":"9e691a25b5a810b90c8a3ca20dd3fecd3d5d96a2e54df051627a77e16956d657"} Jul 05 11:54:19.964649 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:19.964599 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c62wx" podStartSLOduration=8.688417781 podStartE2EDuration="37.96458149s" totalImagesPullingTime="29.276163709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:19.964375936 +0000 UTC m=+38.702913468" watchObservedRunningTime="2026-07-05 11:54:19.96458149 +0000 UTC m=+38.703119007" Jul 05 11:54:20.740300 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:20.740266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:20.740441 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:20.740363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:20.740441 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:20.740371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:20.740441 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:20.740395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:20.740557 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:20.740469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:20.740557 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:20.740527 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:22.739819 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:22.739783 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:22.739819 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:22.739790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:22.740294 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:22.739958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:22.740294 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:22.739973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:22.740294 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:22.740038 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:22.740294 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:22.740139 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:24.739598 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:24.739567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:24.740005 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:24.739656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:24.740005 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:24.739662 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:24.740005 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:24.739685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:24.740005 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:24.739738 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:24.740005 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:24.739794 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:26.739905 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:26.739876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:26.739905 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:26.739894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:26.740348 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:26.739876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:26.740348 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:26.739978 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:26.740348 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:26.740073 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:26.740348 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:26.740157 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:27.378822 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:27.378645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nkq5j"] Jul 05 11:54:27.379031 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:27.378901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:27.379031 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:27.379013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:27.382521 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:27.382485 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkpl9"] Jul 05 11:54:27.382653 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:27.382583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:27.382715 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:27.382675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:27.383245 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:27.383222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kqfb"] Jul 05 11:54:27.383363 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:27.383309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:27.383431 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:27.383410 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:28.740304 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:28.740267 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:28.740787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:28.740268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:28.740787 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:28.740381 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:28.740787 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:28.740445 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:28.740787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:28.740268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:28.740787 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:28.740517 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:30.739855 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:30.739810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:30.740349 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:30.739909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:30.740349 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:30.739914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:30.740349 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:30.739912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkpl9" podUID="68d9d500-7490-48eb-98fb-2d504574ab83" Jul 05 11:54:30.740349 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:30.740034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kqfb" podUID="6a9269d7-98c4-4f56-9c35-d0d44b0d17b4" Jul 05 11:54:30.740349 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:30.740133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkq5j" podUID="0bcd4e58-3a9a-46ac-ac35-ee78766dfe09" Jul 05 11:54:31.607805 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.607779 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeReady" Jul 05 11:54:31.607974 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.607909 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 11:54:31.649449 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.649417 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lrlcj"] Jul 05 11:54:31.658592 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.658562 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lk98l"] Jul 05 11:54:31.658739 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.658688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.661100 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.661069 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 11:54:31.661252 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.661139 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gbwbs\"" Jul 05 11:54:31.661252 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.661183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 11:54:31.671061 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.671016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrlcj"] Jul 05 11:54:31.671211 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.671087 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lk98l"] Jul 05 11:54:31.671211 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.671115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.671211 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.671122 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z6d9g"] Jul 05 11:54:31.673552 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.673529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 11:54:31.673552 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.673538 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxxhf\"" Jul 05 11:54:31.673722 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.673634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 11:54:31.673868 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.673854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 11:54:31.673947 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.673933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 11:54:31.681858 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.681837 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z6d9g"] Jul 05 11:54:31.681972 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.681916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.683989 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.683967 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c4hs5\"" Jul 05 11:54:31.684148 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.684108 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 11:54:31.684246 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.684224 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 11:54:31.684416 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.684358 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 11:54:31.789159 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4345a3d8-4dd1-468e-96b1-98afa67aa93c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.789159 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdf5f\" (UniqueName: \"kubernetes.io/projected/4345a3d8-4dd1-468e-96b1-98afa67aa93c-kube-api-access-mdf5f\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-metrics-tls\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66428\" (UniqueName: \"kubernetes.io/projected/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-kube-api-access-66428\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4345a3d8-4dd1-468e-96b1-98afa67aa93c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6df6e597-063e-4f13-9751-4c5f399c6c53-cert\") pod \"ingress-canary-z6d9g\" (UID: \"6df6e597-063e-4f13-9751-4c5f399c6c53\") " pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-config-volume\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4345a3d8-4dd1-468e-96b1-98afa67aa93c-crio-socket\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbzz7\" (UniqueName: \"kubernetes.io/projected/6df6e597-063e-4f13-9751-4c5f399c6c53-kube-api-access-xbzz7\") pod \"ingress-canary-z6d9g\" (UID: \"6df6e597-063e-4f13-9751-4c5f399c6c53\") " pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-tmp-dir\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.789808 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.789409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4345a3d8-4dd1-468e-96b1-98afa67aa93c-data-volume\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890062 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.889955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66428\" (UniqueName: \"kubernetes.io/projected/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-kube-api-access-66428\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.890062 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.889993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4345a3d8-4dd1-468e-96b1-98afa67aa93c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890062 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6df6e597-063e-4f13-9751-4c5f399c6c53-cert\") pod \"ingress-canary-z6d9g\" (UID: \"6df6e597-063e-4f13-9751-4c5f399c6c53\") " pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.890062 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-config-volume\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.890062 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4345a3d8-4dd1-468e-96b1-98afa67aa93c-crio-socket\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbzz7\" (UniqueName: \"kubernetes.io/projected/6df6e597-063e-4f13-9751-4c5f399c6c53-kube-api-access-xbzz7\") pod \"ingress-canary-z6d9g\" (UID: \"6df6e597-063e-4f13-9751-4c5f399c6c53\") " pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-tmp-dir\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4345a3d8-4dd1-468e-96b1-98afa67aa93c-data-volume\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4345a3d8-4dd1-468e-96b1-98afa67aa93c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdf5f\" (UniqueName: \"kubernetes.io/projected/4345a3d8-4dd1-468e-96b1-98afa67aa93c-kube-api-access-mdf5f\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-metrics-tls\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.890435 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4345a3d8-4dd1-468e-96b1-98afa67aa93c-crio-socket\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890755 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-tmp-dir\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.890755 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4345a3d8-4dd1-468e-96b1-98afa67aa93c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.890755 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.890733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-config-volume\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.894119 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.894090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4345a3d8-4dd1-468e-96b1-98afa67aa93c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.894225 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.894168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-metrics-tls\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.894316 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.894300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6df6e597-063e-4f13-9751-4c5f399c6c53-cert\") pod \"ingress-canary-z6d9g\" (UID: \"6df6e597-063e-4f13-9751-4c5f399c6c53\") " pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.895757 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.895743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4345a3d8-4dd1-468e-96b1-98afa67aa93c-data-volume\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.898526 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.898508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdf5f\" (UniqueName: \"kubernetes.io/projected/4345a3d8-4dd1-468e-96b1-98afa67aa93c-kube-api-access-mdf5f\") pod \"insights-runtime-extractor-lk98l\" (UID: \"4345a3d8-4dd1-468e-96b1-98afa67aa93c\") " pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.898664 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.898523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66428\" (UniqueName: \"kubernetes.io/projected/bbab0bc4-4d70-4988-913b-be2d0a8e7fd2-kube-api-access-66428\") pod \"dns-default-lrlcj\" (UID: \"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2\") " pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.898726 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.898664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbzz7\" (UniqueName: \"kubernetes.io/projected/6df6e597-063e-4f13-9751-4c5f399c6c53-kube-api-access-xbzz7\") pod \"ingress-canary-z6d9g\" (UID: \"6df6e597-063e-4f13-9751-4c5f399c6c53\") " pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:31.971442 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.971409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:31.980700 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.980671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lk98l" Jul 05 11:54:31.990126 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:31.990110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z6d9g" Jul 05 11:54:32.152573 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.152347 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z6d9g"] Jul 05 11:54:32.155191 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.155063 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrlcj"] Jul 05 11:54:32.156626 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:32.156593 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df6e597_063e_4f13_9751_4c5f399c6c53.slice/crio-14c11b56dceaa47cc7a97c22b46d5a9f764b005694bc1f41223d2e709ef9ec25 WatchSource:0}: Error finding container 14c11b56dceaa47cc7a97c22b46d5a9f764b005694bc1f41223d2e709ef9ec25: Status 404 returned error can't find the container with id 14c11b56dceaa47cc7a97c22b46d5a9f764b005694bc1f41223d2e709ef9ec25 Jul 05 11:54:32.158770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.158698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lk98l"] Jul 05 11:54:32.167501 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:32.167474 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbab0bc4_4d70_4988_913b_be2d0a8e7fd2.slice/crio-ef45ffbc5f58bb3bf044cc141c6cfe02c441bc5c5918faeef30728ce0300729f WatchSource:0}: Error finding container ef45ffbc5f58bb3bf044cc141c6cfe02c441bc5c5918faeef30728ce0300729f: Status 404 returned error can't find the container with id ef45ffbc5f58bb3bf044cc141c6cfe02c441bc5c5918faeef30728ce0300729f Jul 05 11:54:32.740514 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.740481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:32.740720 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.740704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:32.740785 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.740765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:32.744349 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.744326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-759jc\"" Jul 05 11:54:32.744562 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.744329 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 11:54:32.744562 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.744558 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 11:54:32.744676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.744632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsspw\"" Jul 05 11:54:32.744676 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.744634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 11:54:32.744785 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.744678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 11:54:32.977770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.977732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z6d9g" event={"ID":"6df6e597-063e-4f13-9751-4c5f399c6c53","Type":"ContainerStarted","Data":"14c11b56dceaa47cc7a97c22b46d5a9f764b005694bc1f41223d2e709ef9ec25"} Jul 05 11:54:32.980360 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.980330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrlcj" event={"ID":"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2","Type":"ContainerStarted","Data":"ef45ffbc5f58bb3bf044cc141c6cfe02c441bc5c5918faeef30728ce0300729f"} Jul 05 11:54:32.982325 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:32.982299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk98l" event={"ID":"4345a3d8-4dd1-468e-96b1-98afa67aa93c","Type":"ContainerStarted","Data":"789a9d40be4f71939dd5927e1c47871f60b1fe818d52e60aeea3efa9d7092389"} Jul 05 11:54:36.774734 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.774702 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8"] Jul 05 11:54:36.794469 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.794436 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8"] Jul 05 11:54:36.794635 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.794567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:36.796884 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.796858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 05 11:54:36.796884 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.796881 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7w4gg\"" Jul 05 11:54:36.832481 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.832451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m5br8\" (UID: \"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:36.933783 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:36.933743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m5br8\" (UID: \"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:36.933962 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:36.933892 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 05 11:54:36.933962 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:36.933961 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates podName:ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:37.433944754 +0000 UTC m=+56.172482260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-m5br8" (UID: "ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4") : secret "prometheus-operator-admission-webhook-tls" not found Jul 05 11:54:37.438357 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:37.438319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m5br8\" (UID: \"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:37.438540 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:37.438500 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 05 11:54:37.438600 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:37.438590 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates podName:ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:38.438571129 +0000 UTC m=+57.177108649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-m5br8" (UID: "ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4") : secret "prometheus-operator-admission-webhook-tls" not found Jul 05 11:54:37.997532 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:37.997503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z6d9g" event={"ID":"6df6e597-063e-4f13-9751-4c5f399c6c53","Type":"ContainerStarted","Data":"f62cf196dc88f52130c6b0e7bbc5383c2388b6d6f18f32b57262353caec9a1e5"} Jul 05 11:54:37.999135 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:37.999111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrlcj" event={"ID":"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2","Type":"ContainerStarted","Data":"7029a9c975ef7682083ca827c5ecc3c1abd4bd3c3e7f7969cd6c935b48821392"} Jul 05 11:54:38.011911 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.011858 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z6d9g" podStartSLOduration=1.449795684 podStartE2EDuration="7.011837797s" totalImagesPullingTime="5.562042113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:38.010643388 +0000 UTC m=+56.749180939" watchObservedRunningTime="2026-07-05 11:54:38.011837797 +0000 UTC m=+56.750375317" Jul 05 11:54:38.174363 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.174326 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58cf69b765-2nmds"] Jul 05 11:54:38.191752 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.191722 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cf69b765-2nmds"] Jul 05 11:54:38.191892 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.191812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.194415 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 05 11:54:38.194547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 05 11:54:38.194844 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 05 11:54:38.194844 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194703 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 05 11:54:38.194844 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194729 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tz7xq\"" Jul 05 11:54:38.194844 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194751 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 05 11:54:38.194844 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194752 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 05 11:54:38.194844 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.194834 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 05 11:54:38.244326 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.244248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5bb\" (UniqueName: \"kubernetes.io/projected/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-kube-api-access-hb5bb\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.244326 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.244306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-serving-cert\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.244501 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.244379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-oauth-config\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.244501 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.244411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-service-ca\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.244501 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.244454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-config\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.244501 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.244489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-oauth-serving-cert\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.345321 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.345280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-service-ca\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.345503 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.345334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-config\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.345503 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.345352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-oauth-serving-cert\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.345503 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.345380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5bb\" (UniqueName: \"kubernetes.io/projected/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-kube-api-access-hb5bb\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.345636 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.345504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-serving-cert\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.345636 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.345581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-oauth-config\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.346199 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.346172 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-config\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.346199 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.346193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-oauth-serving-cert\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.346357 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.346193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-service-ca\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.349143 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.349113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-serving-cert\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.349143 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.349122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-oauth-config\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.352220 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.352204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5bb\" (UniqueName: \"kubernetes.io/projected/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-kube-api-access-hb5bb\") pod \"console-58cf69b765-2nmds\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.446421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.446383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m5br8\" (UID: \"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:38.448681 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.448658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m5br8\" (UID: \"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:38.501347 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.501266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:38.605439 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.605386 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:38.640791 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.640762 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cf69b765-2nmds"] Jul 05 11:54:38.741592 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:38.741561 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb6a3a9_14c5_4a85_9527_bbe8be406d77.slice/crio-9d4ad208ebe5867651ac95d5c1d1c64e5fbcdcf5fd9cf40138982bcfd547ea83 WatchSource:0}: Error finding container 9d4ad208ebe5867651ac95d5c1d1c64e5fbcdcf5fd9cf40138982bcfd547ea83: Status 404 returned error can't find the container with id 9d4ad208ebe5867651ac95d5c1d1c64e5fbcdcf5fd9cf40138982bcfd547ea83 Jul 05 11:54:38.855953 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:38.855924 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8"] Jul 05 11:54:38.860203 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:38.860161 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9c1bdd_778d_45cf_b4d8_dbf3f8f0acc4.slice/crio-f1507d0625ab3d20235e09c94bd56d87dbed67aa1ae5e6da3b2a22c4f07c8278 WatchSource:0}: Error finding container f1507d0625ab3d20235e09c94bd56d87dbed67aa1ae5e6da3b2a22c4f07c8278: Status 404 returned error can't find the container with id f1507d0625ab3d20235e09c94bd56d87dbed67aa1ae5e6da3b2a22c4f07c8278 Jul 05 11:54:39.003736 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:39.003702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrlcj" event={"ID":"bbab0bc4-4d70-4988-913b-be2d0a8e7fd2","Type":"ContainerStarted","Data":"3a8ff04b1ae24a097a63b2c25189b0099ce669063e05c768379a155a178a7d3e"} Jul 05 11:54:39.004163 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:39.003839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:39.005012 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:39.004988 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" event={"ID":"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4","Type":"ContainerStarted","Data":"f1507d0625ab3d20235e09c94bd56d87dbed67aa1ae5e6da3b2a22c4f07c8278"} Jul 05 11:54:39.006088 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:39.006069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf69b765-2nmds" event={"ID":"8eb6a3a9-14c5-4a85-9527-bbe8be406d77","Type":"ContainerStarted","Data":"9d4ad208ebe5867651ac95d5c1d1c64e5fbcdcf5fd9cf40138982bcfd547ea83"} Jul 05 11:54:39.007310 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:39.007279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk98l" event={"ID":"4345a3d8-4dd1-468e-96b1-98afa67aa93c","Type":"ContainerStarted","Data":"e1afe5b3bce916cf1b75484f61739d6afbcbb2038efd889675073ecf6632c172"} Jul 05 11:54:39.019432 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:39.019396 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lrlcj" podStartSLOduration=2.467699502 podStartE2EDuration="8.019382529s" totalImagesPullingTime="5.551683027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:39.018327692 +0000 UTC m=+57.756865234" watchObservedRunningTime="2026-07-05 11:54:39.019382529 +0000 UTC m=+57.757920045" Jul 05 11:54:40.013146 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:40.013108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk98l" event={"ID":"4345a3d8-4dd1-468e-96b1-98afa67aa93c","Type":"ContainerStarted","Data":"c880c256d8c3382ca24012d088e41f728626f61d1a80bc973e9bc22d906c0cfe"} Jul 05 11:54:41.017992 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.017909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" event={"ID":"ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4","Type":"ContainerStarted","Data":"2ac3525538c3d400df3bd97e06729b63d31c9f93d133ffc2b98a5e54c7d87b56"} Jul 05 11:54:41.018439 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.018066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:41.024276 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.024250 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" Jul 05 11:54:41.031886 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.031844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m5br8" podStartSLOduration=3.428390126 podStartE2EDuration="5.031826622s" totalImagesPullingTime="1.603436496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:41.031257795 +0000 UTC m=+59.769795333" watchObservedRunningTime="2026-07-05 11:54:41.031826622 +0000 UTC m=+59.770364184" Jul 05 11:54:41.838311 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.838268 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf"] Jul 05 11:54:41.851505 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.851466 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf"] Jul 05 11:54:41.851674 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.851589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.854157 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.854090 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 11:54:41.854157 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.854105 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 05 11:54:41.854473 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.854158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 11:54:41.854473 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.854158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 11:54:41.854473 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.854090 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 05 11:54:41.854958 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.854942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v4h8n\"" Jul 05 11:54:41.873425 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.873391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.873572 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.873446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9jd\" (UniqueName: \"kubernetes.io/projected/62bf920b-5130-4f31-92ad-949557a15df1-kube-api-access-rh9jd\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.873572 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.873535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bf920b-5130-4f31-92ad-949557a15df1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.873802 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.873587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.926027 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.925993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgt4q" Jul 05 11:54:41.974324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.974290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.974324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.974328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.974565 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.974362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9jd\" (UniqueName: \"kubernetes.io/projected/62bf920b-5130-4f31-92ad-949557a15df1-kube-api-access-rh9jd\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.974565 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.974468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bf920b-5130-4f31-92ad-949557a15df1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.974694 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:41.974583 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 05 11:54:41.974694 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:41.974653 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-tls podName:62bf920b-5130-4f31-92ad-949557a15df1 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:42.474633018 +0000 UTC m=+61.213170514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-pcfsf" (UID: "62bf920b-5130-4f31-92ad-949557a15df1") : secret "prometheus-operator-tls" not found Jul 05 11:54:41.975199 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.975167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bf920b-5130-4f31-92ad-949557a15df1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.977038 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.977012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:41.984634 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:41.984611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9jd\" (UniqueName: \"kubernetes.io/projected/62bf920b-5130-4f31-92ad-949557a15df1-kube-api-access-rh9jd\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:42.478514 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:42.478475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:42.481386 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:42.481356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62bf920b-5130-4f31-92ad-949557a15df1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-pcfsf\" (UID: \"62bf920b-5130-4f31-92ad-949557a15df1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:42.762727 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:42.762650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" Jul 05 11:54:43.088068 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:43.088016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf"] Jul 05 11:54:43.091296 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:43.091271 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bf920b_5130_4f31_92ad_949557a15df1.slice/crio-7da8e3c4db8e17529afcefe5d6eda2a58a26b45ace04f16ea2f1f35e59f3e31a WatchSource:0}: Error finding container 7da8e3c4db8e17529afcefe5d6eda2a58a26b45ace04f16ea2f1f35e59f3e31a: Status 404 returned error can't find the container with id 7da8e3c4db8e17529afcefe5d6eda2a58a26b45ace04f16ea2f1f35e59f3e31a Jul 05 11:54:44.031139 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:44.031092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lk98l" event={"ID":"4345a3d8-4dd1-468e-96b1-98afa67aa93c","Type":"ContainerStarted","Data":"e7c3a0f5a7ae3f5bcf801533038c7ddcf6461e32ccddc1eaeef8de479889a28a"} Jul 05 11:54:44.032732 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:44.032704 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf69b765-2nmds" event={"ID":"8eb6a3a9-14c5-4a85-9527-bbe8be406d77","Type":"ContainerStarted","Data":"96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e"} Jul 05 11:54:44.034085 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:44.034044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" event={"ID":"62bf920b-5130-4f31-92ad-949557a15df1","Type":"ContainerStarted","Data":"7da8e3c4db8e17529afcefe5d6eda2a58a26b45ace04f16ea2f1f35e59f3e31a"} Jul 05 11:54:44.048559 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:44.048514 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lk98l" podStartSLOduration=2.495671049 podStartE2EDuration="13.048500823s" totalImagesPullingTime="10.552829774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:54:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:44.047905742 +0000 UTC m=+62.786443285" watchObservedRunningTime="2026-07-05 11:54:44.048500823 +0000 UTC m=+62.787038397" Jul 05 11:54:44.063501 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:44.063450 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58cf69b765-2nmds" podStartSLOduration=1.841314109 podStartE2EDuration="6.063435592s" totalImagesPullingTime="4.222121483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:44.062391714 +0000 UTC m=+62.800929251" watchObservedRunningTime="2026-07-05 11:54:44.063435592 +0000 UTC m=+62.801973109" Jul 05 11:54:45.038823 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:45.038781 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" event={"ID":"62bf920b-5130-4f31-92ad-949557a15df1","Type":"ContainerStarted","Data":"e5ec8b7369824f3bee363511c67fc53faf6a16d97213638520c13e745cb2b2c9"} Jul 05 11:54:45.039254 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:45.038848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" event={"ID":"62bf920b-5130-4f31-92ad-949557a15df1","Type":"ContainerStarted","Data":"a9e9cf27ab2395ece031932f6776af5d840d5c3fcda675870b17410191df6baf"} Jul 05 11:54:45.055057 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:45.055000 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-pcfsf" podStartSLOduration=2.6965740609999997 podStartE2EDuration="4.0549849s" totalImagesPullingTime="1.358410839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:45.05420366 +0000 UTC m=+63.792741177" watchObservedRunningTime="2026-07-05 11:54:45.0549849 +0000 UTC m=+63.793522418" Jul 05 11:54:47.182753 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.182719 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654"] Jul 05 11:54:47.215384 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.215349 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654"] Jul 05 11:54:47.215384 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.215386 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qdpmb"] Jul 05 11:54:47.215608 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.215480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.217485 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.217465 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c66rn\"" Jul 05 11:54:47.217617 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.217466 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 05 11:54:47.217827 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.217812 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 05 11:54:47.217936 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.217919 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 05 11:54:47.242531 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.242505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.244944 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.244921 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 11:54:47.245110 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.245008 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 11:54:47.245110 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.245007 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mqzr7\"" Jul 05 11:54:47.245110 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.245007 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 11:54:47.314319 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5376af6-771f-4042-a1f4-cce13f52a975-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.314491 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.314491 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n62wp\" (UniqueName: \"kubernetes.io/projected/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-kube-api-access-n62wp\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314491 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-textfile\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314491 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314621 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.314621 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-sys\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314621 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314621 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c5376af6-771f-4042-a1f4-cce13f52a975-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.314744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.314744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-root\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dzf\" (UniqueName: \"kubernetes.io/projected/c5376af6-771f-4042-a1f4-cce13f52a975-kube-api-access-62dzf\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.314744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-metrics-client-ca\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-tls\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.314744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.314736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-wtmp\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.416130 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.416302 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.416302 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-sys\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.416423 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.416423 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:47.416423 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-sys\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.416423 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:47.416578 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c5376af6-771f-4042-a1f4-cce13f52a975-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.416578 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:47.416578 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.416764 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.416959 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.416959 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c5376af6-771f-4042-a1f4-cce13f52a975-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.417109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.416997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-root\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62dzf\" (UniqueName: \"kubernetes.io/projected/c5376af6-771f-4042-a1f4-cce13f52a975-kube-api-access-62dzf\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.417109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-metrics-client-ca\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-tls\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-root\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-wtmp\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5376af6-771f-4042-a1f4-cce13f52a975-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n62wp\" (UniqueName: \"kubernetes.io/projected/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-kube-api-access-n62wp\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:47.417207 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-textfile\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-wtmp\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:47.417269 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-tls podName:415a2ae5-db0d-41ce-bee4-242b0b7f3e9a nodeName:}" failed. No retries permitted until 2026-07-05 11:54:47.917252253 +0000 UTC m=+66.655789755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-tls") pod "node-exporter-qdpmb" (UID: "415a2ae5-db0d-41ce-bee4-242b0b7f3e9a") : secret "node-exporter-tls" not found Jul 05 11:54:47.417344 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:47.417336 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 05 11:54:47.417774 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:47.417383 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-tls podName:c5376af6-771f-4042-a1f4-cce13f52a975 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:47.917368062 +0000 UTC m=+66.655905563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-f9654" (UID: "c5376af6-771f-4042-a1f4-cce13f52a975") : secret "kube-state-metrics-tls" not found Jul 05 11:54:47.417774 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-textfile\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417774 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-metrics-client-ca\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.417966 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.417949 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5376af6-771f-4042-a1f4-cce13f52a975-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.418691 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.418660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 11:54:47.418691 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.418688 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 11:54:47.418857 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.418823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 11:54:47.419107 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.419076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.419380 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.419359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.427714 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.427689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n62wp\" (UniqueName: \"kubernetes.io/projected/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-kube-api-access-n62wp\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.428409 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.428385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dzf\" (UniqueName: \"kubernetes.io/projected/c5376af6-771f-4042-a1f4-cce13f52a975-kube-api-access-62dzf\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.428688 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.428665 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 11:54:47.429235 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.429210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bcd4e58-3a9a-46ac-ac35-ee78766dfe09-original-pull-secret\") pod \"global-pull-secret-syncer-nkq5j\" (UID: \"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09\") " pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:47.429434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.429411 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9269d7-98c4-4f56-9c35-d0d44b0d17b4-metrics-certs\") pod \"network-metrics-daemon-4kqfb\" (UID: \"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4\") " pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:47.439629 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.439571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8x8b\" (UniqueName: \"kubernetes.io/projected/68d9d500-7490-48eb-98fb-2d504574ab83-kube-api-access-b8x8b\") pod \"network-check-target-dkpl9\" (UID: \"68d9d500-7490-48eb-98fb-2d504574ab83\") " pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:47.457490 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.457466 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-759jc\"" Jul 05 11:54:47.466232 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.466212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kqfb" Jul 05 11:54:47.467420 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.467402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkq5j" Jul 05 11:54:47.476437 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.476420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsspw\"" Jul 05 11:54:47.485324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.485305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:47.633919 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.633785 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kqfb"] Jul 05 11:54:47.637271 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:47.637238 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9269d7_98c4_4f56_9c35_d0d44b0d17b4.slice/crio-6451dcba4459ed6506423c7d2e6387f71951b47a43e428dd3d35d603bd15e8f3 WatchSource:0}: Error finding container 6451dcba4459ed6506423c7d2e6387f71951b47a43e428dd3d35d603bd15e8f3: Status 404 returned error can't find the container with id 6451dcba4459ed6506423c7d2e6387f71951b47a43e428dd3d35d603bd15e8f3 Jul 05 11:54:47.668840 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.668808 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nkq5j"] Jul 05 11:54:47.673480 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:47.673454 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcd4e58_3a9a_46ac_ac35_ee78766dfe09.slice/crio-b0c78c69893c50fda442f472ad919b4f7288e9b8fd73810ec04e0ea629c93731 WatchSource:0}: Error finding container b0c78c69893c50fda442f472ad919b4f7288e9b8fd73810ec04e0ea629c93731: Status 404 returned error can't find the container with id b0c78c69893c50fda442f472ad919b4f7288e9b8fd73810ec04e0ea629c93731 Jul 05 11:54:47.699003 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.698915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkpl9"] Jul 05 11:54:47.702133 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:47.702108 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d9d500_7490_48eb_98fb_2d504574ab83.slice/crio-c6c5eb75d17c71e8813fa6e73de378ed37b89fb38e936dc58599bc6d687bf0ca WatchSource:0}: Error finding container c6c5eb75d17c71e8813fa6e73de378ed37b89fb38e936dc58599bc6d687bf0ca: Status 404 returned error can't find the container with id c6c5eb75d17c71e8813fa6e73de378ed37b89fb38e936dc58599bc6d687bf0ca Jul 05 11:54:47.921315 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.921281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-tls\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.921500 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.921329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:47.923754 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.923726 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/415a2ae5-db0d-41ce-bee4-242b0b7f3e9a-node-exporter-tls\") pod \"node-exporter-qdpmb\" (UID: \"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a\") " pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:47.923866 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:47.923781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5376af6-771f-4042-a1f4-cce13f52a975-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-f9654\" (UID: \"c5376af6-771f-4042-a1f4-cce13f52a975\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:48.050035 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.049945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kqfb" event={"ID":"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4","Type":"ContainerStarted","Data":"6451dcba4459ed6506423c7d2e6387f71951b47a43e428dd3d35d603bd15e8f3"} Jul 05 11:54:48.051358 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.051322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkpl9" event={"ID":"68d9d500-7490-48eb-98fb-2d504574ab83","Type":"ContainerStarted","Data":"c6c5eb75d17c71e8813fa6e73de378ed37b89fb38e936dc58599bc6d687bf0ca"} Jul 05 11:54:48.052607 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.052578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nkq5j" event={"ID":"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09","Type":"ContainerStarted","Data":"b0c78c69893c50fda442f472ad919b4f7288e9b8fd73810ec04e0ea629c93731"} Jul 05 11:54:48.124615 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.124505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" Jul 05 11:54:48.151189 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.150931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qdpmb" Jul 05 11:54:48.166740 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:48.166701 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415a2ae5_db0d_41ce_bee4_242b0b7f3e9a.slice/crio-2dfe72cce73ef013baa557b623a4d4cbf3da7b366116a3a4dc81764658f5d1a0 WatchSource:0}: Error finding container 2dfe72cce73ef013baa557b623a4d4cbf3da7b366116a3a4dc81764658f5d1a0: Status 404 returned error can't find the container with id 2dfe72cce73ef013baa557b623a4d4cbf3da7b366116a3a4dc81764658f5d1a0 Jul 05 11:54:48.234165 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.234127 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:54:48.238507 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.238406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.243275 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.242745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 05 11:54:48.243275 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.242989 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 05 11:54:48.243454 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.243433 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 05 11:54:48.244773 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.243641 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 05 11:54:48.244773 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.243754 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 05 11:54:48.244773 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.243824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 05 11:54:48.244773 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.244043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 05 11:54:48.244773 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.244260 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 05 11:54:48.244773 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.244613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vrp42\"" Jul 05 11:54:48.245494 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.245231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 05 11:54:48.250240 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.250220 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:54:48.299929 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.299819 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654"] Jul 05 11:54:48.306114 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:48.306025 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5376af6_771f_4042_a1f4_cce13f52a975.slice/crio-c1754c4a983718e86d3fbd578ac7d11ae2ac1a513276c758e8fe35422d5a2c27 WatchSource:0}: Error finding container c1754c4a983718e86d3fbd578ac7d11ae2ac1a513276c758e8fe35422d5a2c27: Status 404 returned error can't find the container with id c1754c4a983718e86d3fbd578ac7d11ae2ac1a513276c758e8fe35422d5a2c27 Jul 05 11:54:48.324698 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66pr7\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-kube-api-access-66pr7\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.324698 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.324907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.324907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.324907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.324907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.324907 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.325189 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.325189 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.324999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-config-out\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.325189 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.325066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.325189 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.325097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.325189 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.325124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.325449 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.325201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-web-config\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426642 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-web-config\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426778 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66pr7\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-kube-api-access-66pr7\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426778 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426778 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426778 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426985 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426985 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426985 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426985 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426985 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-config-out\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.426985 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.427306 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.426990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.427306 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.427016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.427306 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:48.427149 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 05 11:54:48.427449 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:48.427402 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls podName:c153af35-179d-4d09-b038-d56af1f13d7e nodeName:}" failed. No retries permitted until 2026-07-05 11:54:48.9271948 +0000 UTC m=+67.665732314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e") : secret "alertmanager-main-tls" not found Jul 05 11:54:48.429876 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.428666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.429876 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.429328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.431284 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:48.431266 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle podName:c153af35-179d-4d09-b038-d56af1f13d7e nodeName:}" failed. No retries permitted until 2026-07-05 11:54:48.931247548 +0000 UTC m=+67.669785046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e") : configmap references non-existent config key: ca-bundle.crt Jul 05 11:54:48.432845 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.432827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.433278 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.433239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.433881 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.433383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-config-out\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.433881 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.433755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-web-config\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.435119 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.434083 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.435596 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.435539 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.435960 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.435915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.435960 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.435918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.438443 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.438405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66pr7\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-kube-api-access-66pr7\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.501721 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.501566 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:48.501721 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.501682 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:48.508266 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.508230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:48.933082 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.932328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.933082 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.932404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.934131 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.934072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:48.940568 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:48.940520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:49.015864 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.015133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lrlcj" Jul 05 11:54:49.066272 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.065380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kqfb" event={"ID":"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4","Type":"ContainerStarted","Data":"a13c910739e99a754f73562bbb64359114db042dc0af33edfed8cca8062993bd"} Jul 05 11:54:49.066272 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.065449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kqfb" event={"ID":"6a9269d7-98c4-4f56-9c35-d0d44b0d17b4","Type":"ContainerStarted","Data":"7cc35e894d8cf1a852cf86a7dd62502e7b68514d3973fa72a9b0143489b88be1"} Jul 05 11:54:49.068080 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.067967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" event={"ID":"c5376af6-771f-4042-a1f4-cce13f52a975","Type":"ContainerStarted","Data":"c1754c4a983718e86d3fbd578ac7d11ae2ac1a513276c758e8fe35422d5a2c27"} Jul 05 11:54:49.070410 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.070378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qdpmb" event={"ID":"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a","Type":"ContainerStarted","Data":"2dfe72cce73ef013baa557b623a4d4cbf3da7b366116a3a4dc81764658f5d1a0"} Jul 05 11:54:49.077225 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.077152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:54:49.087443 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.086603 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4kqfb" podStartSLOduration=65.988327759 podStartE2EDuration="1m7.086585555s" totalImagesPullingTime="1.098257796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:49.085616082 +0000 UTC m=+67.824153615" watchObservedRunningTime="2026-07-05 11:54:49.086585555 +0000 UTC m=+67.825123073" Jul 05 11:54:49.157929 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.157680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:54:49.637674 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:49.637621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:54:49.971409 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:54:49.971370 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc153af35_179d_4d09_b038_d56af1f13d7e.slice/crio-08f106d7f8f436b74ab9955a6899a9858016bd238006b1c516873204be48f737 WatchSource:0}: Error finding container 08f106d7f8f436b74ab9955a6899a9858016bd238006b1c516873204be48f737: Status 404 returned error can't find the container with id 08f106d7f8f436b74ab9955a6899a9858016bd238006b1c516873204be48f737 Jul 05 11:54:50.079643 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:50.079607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"08f106d7f8f436b74ab9955a6899a9858016bd238006b1c516873204be48f737"} Jul 05 11:54:50.082276 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:50.082170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qdpmb" event={"ID":"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a","Type":"ContainerStarted","Data":"406b75bdba20fcf4d88a89c37698591cb0c2e474b129430a259fcde93257ca04"} Jul 05 11:54:51.088041 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.088002 2578 generic.go:356] "Generic (PLEG): container finished" podID="415a2ae5-db0d-41ce-bee4-242b0b7f3e9a" containerID="406b75bdba20fcf4d88a89c37698591cb0c2e474b129430a259fcde93257ca04" exitCode=0 Jul 05 11:54:51.088530 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.088087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qdpmb" event={"ID":"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a","Type":"ContainerDied","Data":"406b75bdba20fcf4d88a89c37698591cb0c2e474b129430a259fcde93257ca04"} Jul 05 11:54:51.090770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.090704 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" event={"ID":"c5376af6-771f-4042-a1f4-cce13f52a975","Type":"ContainerStarted","Data":"ec5db244f2aa40f4ea7c2c51832ea0ae43af480d82a321262b5b9a64ac42ef46"} Jul 05 11:54:51.090770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.090762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" event={"ID":"c5376af6-771f-4042-a1f4-cce13f52a975","Type":"ContainerStarted","Data":"acae5c37478a90019b203e0bbef2a1a7cb40f99bdfebabfe1fc4dd63311490c8"} Jul 05 11:54:51.090923 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.090794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" event={"ID":"c5376af6-771f-4042-a1f4-cce13f52a975","Type":"ContainerStarted","Data":"1cb484cef0e0ca94add1d9928865ef2f3a55fcf6fa0983f1b39e197ea4e04bf0"} Jul 05 11:54:51.121775 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.121728 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-f9654" podStartSLOduration=2.407647785 podStartE2EDuration="4.121710607s" totalImagesPullingTime="1.714062822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:51.120635442 +0000 UTC m=+69.859172961" watchObservedRunningTime="2026-07-05 11:54:51.121710607 +0000 UTC m=+69.860248120" Jul 05 11:54:51.484965 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.484874 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-686b9ff667-hpcxj"] Jul 05 11:54:51.489716 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.489691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.491796 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.491774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 05 11:54:51.491988 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.491936 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fzhqx\"" Jul 05 11:54:51.492159 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.492143 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 05 11:54:51.492885 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.492859 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 05 11:54:51.492997 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.492864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-as5ut87ah1g7p\"" Jul 05 11:54:51.492997 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.492942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 05 11:54:51.496516 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.495980 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-686b9ff667-hpcxj"] Jul 05 11:54:51.560466 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-secret-metrics-server-client-certs\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.560466 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaa0c15d-260c-4788-96a2-c3d9f121937f-metrics-server-audit-profiles\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.560692 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa0c15d-260c-4788-96a2-c3d9f121937f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.560692 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-secret-metrics-server-tls\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.560692 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-client-ca-bundle\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.560692 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaa0c15d-260c-4788-96a2-c3d9f121937f-audit-log\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.560692 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.560679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5nkd\" (UniqueName: \"kubernetes.io/projected/eaa0c15d-260c-4788-96a2-c3d9f121937f-kube-api-access-l5nkd\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661126 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-secret-metrics-server-client-certs\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661126 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaa0c15d-260c-4788-96a2-c3d9f121937f-metrics-server-audit-profiles\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa0c15d-260c-4788-96a2-c3d9f121937f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-secret-metrics-server-tls\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-client-ca-bundle\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaa0c15d-260c-4788-96a2-c3d9f121937f-audit-log\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.661379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.661287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5nkd\" (UniqueName: \"kubernetes.io/projected/eaa0c15d-260c-4788-96a2-c3d9f121937f-kube-api-access-l5nkd\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.662076 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.662006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaa0c15d-260c-4788-96a2-c3d9f121937f-audit-log\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.662421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.662389 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa0c15d-260c-4788-96a2-c3d9f121937f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.662632 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.662590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaa0c15d-260c-4788-96a2-c3d9f121937f-metrics-server-audit-profiles\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.664459 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.664411 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-secret-metrics-server-tls\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.664459 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.664425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-client-ca-bundle\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.664939 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.664870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaa0c15d-260c-4788-96a2-c3d9f121937f-secret-metrics-server-client-certs\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.669310 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.669286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5nkd\" (UniqueName: \"kubernetes.io/projected/eaa0c15d-260c-4788-96a2-c3d9f121937f-kube-api-access-l5nkd\") pod \"metrics-server-686b9ff667-hpcxj\" (UID: \"eaa0c15d-260c-4788-96a2-c3d9f121937f\") " pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.802363 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.802275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:54:51.962767 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.962727 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz"] Jul 05 11:54:51.965661 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.965638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:51.967812 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.967787 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 05 11:54:51.967925 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.967854 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tvmx8\"" Jul 05 11:54:51.974964 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:51.974943 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz"] Jul 05 11:54:52.064505 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.064412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vz94\" (UniqueName: \"kubernetes.io/projected/8b9b43f8-c987-4c66-ad32-2e4bde513104-kube-api-access-4vz94\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.064677 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.064561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b9b43f8-c987-4c66-ad32-2e4bde513104-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.165252 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.165201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b9b43f8-c987-4c66-ad32-2e4bde513104-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.165725 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:52.165362 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 05 11:54:52.165725 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:54:52.165457 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b9b43f8-c987-4c66-ad32-2e4bde513104-monitoring-plugin-cert podName:8b9b43f8-c987-4c66-ad32-2e4bde513104 nodeName:}" failed. No retries permitted until 2026-07-05 11:54:52.665433745 +0000 UTC m=+71.403971248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8b9b43f8-c987-4c66-ad32-2e4bde513104-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-gwvnz" (UID: "8b9b43f8-c987-4c66-ad32-2e4bde513104") : secret "monitoring-plugin-cert" not found Jul 05 11:54:52.165725 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.165496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vz94\" (UniqueName: \"kubernetes.io/projected/8b9b43f8-c987-4c66-ad32-2e4bde513104-kube-api-access-4vz94\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.174442 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.174414 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vz94\" (UniqueName: \"kubernetes.io/projected/8b9b43f8-c987-4c66-ad32-2e4bde513104-kube-api-access-4vz94\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.669546 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.669505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b9b43f8-c987-4c66-ad32-2e4bde513104-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.672243 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.672215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b9b43f8-c987-4c66-ad32-2e4bde513104-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwvnz\" (UID: \"8b9b43f8-c987-4c66-ad32-2e4bde513104\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:52.876909 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:52.876878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:53.005197 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.005114 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-674d746d9d-2dfvz"] Jul 05 11:54:53.008593 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.008565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.016184 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.016154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 05 11:54:53.017879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.017815 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674d746d9d-2dfvz"] Jul 05 11:54:53.073748 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.073714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-oauth-serving-cert\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.073748 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.073751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-oauth-config\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.073979 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.073772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-config\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.073979 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.073842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-service-ca\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.073979 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.073886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-serving-cert\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.074106 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.073999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-trusted-ca-bundle\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.074106 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.074042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658pt\" (UniqueName: \"kubernetes.io/projected/14ad6fbc-7e59-456e-8e26-c37f45491f2e-kube-api-access-658pt\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.174817 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-trusted-ca-bundle\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.174817 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-658pt\" (UniqueName: \"kubernetes.io/projected/14ad6fbc-7e59-456e-8e26-c37f45491f2e-kube-api-access-658pt\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.174817 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-oauth-serving-cert\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.174817 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-oauth-config\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-config\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-service-ca\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.174899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-serving-cert\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.176160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-oauth-serving-cert\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.177097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-trusted-ca-bundle\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.177721 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-config\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.180787 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.180212 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-service-ca\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.182627 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.182138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-serving-cert\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.183980 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.183933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-oauth-config\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.190853 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.190761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-658pt\" (UniqueName: \"kubernetes.io/projected/14ad6fbc-7e59-456e-8e26-c37f45491f2e-kube-api-access-658pt\") pod \"console-674d746d9d-2dfvz\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.320842 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.320536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:54:53.386191 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.386113 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz"] Jul 05 11:54:53.410920 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.409326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-686b9ff667-hpcxj"] Jul 05 11:54:53.509594 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:53.509164 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674d746d9d-2dfvz"] Jul 05 11:54:54.106315 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.106092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkpl9" event={"ID":"68d9d500-7490-48eb-98fb-2d504574ab83","Type":"ContainerStarted","Data":"eb54cc6d584deed56852d73d04403094eee931ec7e56dd7b2673a8d00d0c996f"} Jul 05 11:54:54.106315 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.106225 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:54:54.107823 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.107786 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777" exitCode=0 Jul 05 11:54:54.107968 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.107867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777"} Jul 05 11:54:54.110010 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.109970 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d746d9d-2dfvz" event={"ID":"14ad6fbc-7e59-456e-8e26-c37f45491f2e","Type":"ContainerStarted","Data":"92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851"} Jul 05 11:54:54.110127 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.110010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d746d9d-2dfvz" event={"ID":"14ad6fbc-7e59-456e-8e26-c37f45491f2e","Type":"ContainerStarted","Data":"c070dd8b793d717289dc6ebd7feb8debf1e8ff2f6c74274c86884deba805f300"} Jul 05 11:54:54.111379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.111357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" event={"ID":"8b9b43f8-c987-4c66-ad32-2e4bde513104","Type":"ContainerStarted","Data":"ff7f526026b4cf0a5a1ede4913ab97a4ca54a5736f01940c99988f8ba878222c"} Jul 05 11:54:54.113040 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.113017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nkq5j" event={"ID":"0bcd4e58-3a9a-46ac-ac35-ee78766dfe09","Type":"ContainerStarted","Data":"70adc6ce3621459885c6e70d3e04eabfe461c60a2e1caf76a69479f2c9f7f78c"} Jul 05 11:54:54.115384 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.115364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qdpmb" event={"ID":"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a","Type":"ContainerStarted","Data":"e061cdaa21e65d3beb2912b23de876323b592a527a3056332e99d41e7311ced0"} Jul 05 11:54:54.115489 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.115405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qdpmb" event={"ID":"415a2ae5-db0d-41ce-bee4-242b0b7f3e9a","Type":"ContainerStarted","Data":"6613ddbbed8e6a9f2cc98ca2117cbfff044f7f4ce59106545bbce88f910391d6"} Jul 05 11:54:54.118042 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.118009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" event={"ID":"eaa0c15d-260c-4788-96a2-c3d9f121937f","Type":"ContainerStarted","Data":"139620432cca3eb2af7ab2e4f80bcdf0ebce21aadb624fee23e67992db5abe36"} Jul 05 11:54:54.121816 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.121765 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dkpl9" podStartSLOduration=66.690624752 podStartE2EDuration="1m12.121747407s" totalImagesPullingTime="5.431122655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:54.120729172 +0000 UTC m=+72.859266690" watchObservedRunningTime="2026-07-05 11:54:54.121747407 +0000 UTC m=+72.860284928" Jul 05 11:54:54.179111 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.178798 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-674d746d9d-2dfvz" podStartSLOduration=2.178775154 podStartE2EDuration="2.178775154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:54.161002008 +0000 UTC m=+72.899539526" watchObservedRunningTime="2026-07-05 11:54:54.178775154 +0000 UTC m=+72.917312673" Jul 05 11:54:54.180068 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.180009 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qdpmb" podStartSLOduration=5.736118849 podStartE2EDuration="7.179992654s" totalImagesPullingTime="1.355450404s" totalInitContainerRuntime="88.423401ms" isStatefulPod=true podCreationTimestamp="2026-07-05 11:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:54.178615948 +0000 UTC m=+72.917153466" watchObservedRunningTime="2026-07-05 11:54:54.179992654 +0000 UTC m=+72.918530172" Jul 05 11:54:54.191999 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:54.191947 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nkq5j" podStartSLOduration=66.707737488 podStartE2EDuration="1m12.191927536s" totalImagesPullingTime="5.484190048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 11:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:54.19118586 +0000 UTC m=+72.929723378" watchObservedRunningTime="2026-07-05 11:54:54.191927536 +0000 UTC m=+72.930465057" Jul 05 11:54:56.130184 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.129912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" event={"ID":"8b9b43f8-c987-4c66-ad32-2e4bde513104","Type":"ContainerStarted","Data":"2bf863cc7cbc3b0dbf8bc1cc388f1f1f78eb2ef9edeff43e864a245cb7643cf3"} Jul 05 11:54:56.130184 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.130000 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:56.132285 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.132218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" event={"ID":"eaa0c15d-260c-4788-96a2-c3d9f121937f","Type":"ContainerStarted","Data":"827b707a75c32a33653545908a9d8e8f0d14ce0925b0776285a8d18c9e2b8548"} Jul 05 11:54:56.135797 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.135758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e"} Jul 05 11:54:56.135905 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.135829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992"} Jul 05 11:54:56.135905 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.135872 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d"} Jul 05 11:54:56.136243 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.136227 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" Jul 05 11:54:56.147130 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.147088 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwvnz" podStartSLOduration=3.411764502 podStartE2EDuration="5.147073586s" totalImagesPullingTime="1.735309084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:56.145808077 +0000 UTC m=+74.884345595" watchObservedRunningTime="2026-07-05 11:54:56.147073586 +0000 UTC m=+74.885611100" Jul 05 11:54:56.163557 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:56.163508 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" podStartSLOduration=3.430984401 podStartE2EDuration="5.163492865s" totalImagesPullingTime="1.732508464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:56.161703361 +0000 UTC m=+74.900240891" watchObservedRunningTime="2026-07-05 11:54:56.163492865 +0000 UTC m=+74.902030429" Jul 05 11:54:57.143915 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:57.143881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc"} Jul 05 11:54:57.144225 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:57.143976 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9"} Jul 05 11:54:58.151005 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:58.150968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerStarted","Data":"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2"} Jul 05 11:54:58.175908 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:54:58.175849 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.39275819 podStartE2EDuration="10.175826318s" totalImagesPullingTime="5.764043494s" totalInitContainerRuntime="19.024634ms" isStatefulPod=false podCreationTimestamp="2026-07-05 11:54:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:54:58.175365595 +0000 UTC m=+76.913903137" watchObservedRunningTime="2026-07-05 11:54:58.175826318 +0000 UTC m=+76.914363836" Jul 05 11:55:03.322023 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:03.321874 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:55:03.322023 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:03.321981 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:55:03.326603 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:03.326580 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:55:04.177919 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:04.177893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:55:04.220157 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:04.220120 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cf69b765-2nmds"] Jul 05 11:55:11.803000 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:11.802961 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:55:11.803462 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:11.803029 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:55:25.125835 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:25.125805 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dkpl9" Jul 05 11:55:29.241326 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.241267 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58cf69b765-2nmds" podUID="8eb6a3a9-14c5-4a85-9527-bbe8be406d77" containerName="console" containerID="cri-o://96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e" gracePeriod=15 Jul 05 11:55:29.479888 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.479864 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:55:29.497164 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497099 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-oauth-serving-cert\") pod \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " Jul 05 11:55:29.497164 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-serving-cert\") pod \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " Jul 05 11:55:29.497337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497191 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-oauth-config\") pod \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " Jul 05 11:55:29.497337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497207 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-config\") pod \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " Jul 05 11:55:29.497337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497248 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb5bb\" (UniqueName: \"kubernetes.io/projected/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-kube-api-access-hb5bb\") pod \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " Jul 05 11:55:29.497337 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497280 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-service-ca\") pod \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\" (UID: \"8eb6a3a9-14c5-4a85-9527-bbe8be406d77\") " Jul 05 11:55:29.497530 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497501 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8eb6a3a9-14c5-4a85-9527-bbe8be406d77" (UID: "8eb6a3a9-14c5-4a85-9527-bbe8be406d77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:55:29.497896 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497869 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-service-ca" (OuterVolumeSpecName: "service-ca") pod "8eb6a3a9-14c5-4a85-9527-bbe8be406d77" (UID: "8eb6a3a9-14c5-4a85-9527-bbe8be406d77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:55:29.498003 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.497920 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-config" (OuterVolumeSpecName: "console-config") pod "8eb6a3a9-14c5-4a85-9527-bbe8be406d77" (UID: "8eb6a3a9-14c5-4a85-9527-bbe8be406d77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:55:29.500101 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.500072 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8eb6a3a9-14c5-4a85-9527-bbe8be406d77" (UID: "8eb6a3a9-14c5-4a85-9527-bbe8be406d77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:55:29.500199 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.500095 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-kube-api-access-hb5bb" (OuterVolumeSpecName: "kube-api-access-hb5bb") pod "8eb6a3a9-14c5-4a85-9527-bbe8be406d77" (UID: "8eb6a3a9-14c5-4a85-9527-bbe8be406d77"). InnerVolumeSpecName "kube-api-access-hb5bb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:55:29.500199 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.500118 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8eb6a3a9-14c5-4a85-9527-bbe8be406d77" (UID: "8eb6a3a9-14c5-4a85-9527-bbe8be406d77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:55:29.598879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.598840 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-oauth-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:55:29.598879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.598872 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:55:29.598879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.598884 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-oauth-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:55:29.599151 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.598895 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-console-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:55:29.599151 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.598904 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb5bb\" (UniqueName: \"kubernetes.io/projected/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-kube-api-access-hb5bb\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:55:29.599151 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:29.598912 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6a3a9-14c5-4a85-9527-bbe8be406d77-service-ca\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:55:30.271436 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.271406 2578 generic.go:356] "Generic (PLEG): container finished" podID="8eb6a3a9-14c5-4a85-9527-bbe8be406d77" containerID="96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e" exitCode=0 Jul 05 11:55:30.271812 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.271448 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cf69b765-2nmds" Jul 05 11:55:30.271812 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.271488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf69b765-2nmds" event={"ID":"8eb6a3a9-14c5-4a85-9527-bbe8be406d77","Type":"ContainerDied","Data":"96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e"} Jul 05 11:55:30.271812 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.271539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cf69b765-2nmds" event={"ID":"8eb6a3a9-14c5-4a85-9527-bbe8be406d77","Type":"ContainerDied","Data":"9d4ad208ebe5867651ac95d5c1d1c64e5fbcdcf5fd9cf40138982bcfd547ea83"} Jul 05 11:55:30.271812 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.271573 2578 scope.go:117] "RemoveContainer" containerID="96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e" Jul 05 11:55:30.279833 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.279817 2578 scope.go:117] "RemoveContainer" containerID="96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e" Jul 05 11:55:30.280119 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:55:30.280099 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e\": container with ID starting with 96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e not found: ID does not exist" containerID="96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e" Jul 05 11:55:30.280170 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.280128 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e"} err="failed to get container status \"96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e\": rpc error: code = NotFound desc = could not find container \"96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e\": container with ID starting with 96dc9580d52d488e76654568fbef00468c180c50fded0be5ab2fd63a654ec63e not found: ID does not exist" Jul 05 11:55:30.287726 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.287704 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cf69b765-2nmds"] Jul 05 11:55:30.291239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:30.291220 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58cf69b765-2nmds"] Jul 05 11:55:31.745239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:31.745208 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb6a3a9-14c5-4a85-9527-bbe8be406d77" path="/var/lib/kubelet/pods/8eb6a3a9-14c5-4a85-9527-bbe8be406d77/volumes" Jul 05 11:55:31.807899 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:31.807871 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:55:31.811522 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:55:31.811498 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-686b9ff667-hpcxj" Jul 05 11:56:07.450265 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450201 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:56:07.450827 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450555 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="alertmanager" containerID="cri-o://dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d" gracePeriod=120 Jul 05 11:56:07.450827 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450599 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-metric" containerID="cri-o://c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc" gracePeriod=120 Jul 05 11:56:07.450827 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450613 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-web" containerID="cri-o://ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e" gracePeriod=120 Jul 05 11:56:07.450827 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450574 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy" containerID="cri-o://e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9" gracePeriod=120 Jul 05 11:56:07.450827 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450627 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="config-reloader" containerID="cri-o://e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992" gracePeriod=120 Jul 05 11:56:07.451150 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:07.450949 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="prom-label-proxy" containerID="cri-o://e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2" gracePeriod=120 Jul 05 11:56:08.415176 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415142 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2" exitCode=0 Jul 05 11:56:08.415176 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415164 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9" exitCode=0 Jul 05 11:56:08.415176 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415173 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992" exitCode=0 Jul 05 11:56:08.415176 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415180 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d" exitCode=0 Jul 05 11:56:08.415433 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2"} Jul 05 11:56:08.415433 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9"} Jul 05 11:56:08.415433 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992"} Jul 05 11:56:08.415433 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.415321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d"} Jul 05 11:56:08.692490 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.692466 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:08.833132 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833093 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833132 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833135 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833152 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833174 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66pr7\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-kube-api-access-66pr7\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833193 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-config-out\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833241 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-main-db\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833276 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-web-config\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833307 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-tls-assets\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833354 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833402 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-metrics-client-ca\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833425 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-config-volume\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833452 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-cluster-tls-config\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833479 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls\") pod \"c153af35-179d-4d09-b038-d56af1f13d7e\" (UID: \"c153af35-179d-4d09-b038-d56af1f13d7e\") " Jul 05 11:56:08.833666 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833615 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:56:08.834307 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833878 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.834307 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.833874 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:56:08.834307 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.834131 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:56:08.836357 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.836319 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-kube-api-access-66pr7" (OuterVolumeSpecName: "kube-api-access-66pr7") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "kube-api-access-66pr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:56:08.836708 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.836683 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-config-out" (OuterVolumeSpecName: "config-out") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:56:08.836708 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.836680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.836905 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.836833 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-config-volume" (OuterVolumeSpecName: "config-volume") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.837026 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.837005 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:56:08.837113 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.837030 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.837165 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.837141 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.838029 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.837999 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.841537 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.841511 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.847465 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.847433 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-web-config" (OuterVolumeSpecName: "web-config") pod "c153af35-179d-4d09-b038-d56af1f13d7e" (UID: "c153af35-179d-4d09-b038-d56af1f13d7e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.934945 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-tls-assets\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.934976 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.934987 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c153af35-179d-4d09-b038-d56af1f13d7e-metrics-client-ca\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.934998 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-config-volume\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935006 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-cluster-tls-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935015 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-main-tls\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935024 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935033 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935036 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935042 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66pr7\" (UniqueName: \"kubernetes.io/projected/c153af35-179d-4d09-b038-d56af1f13d7e-kube-api-access-66pr7\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935076 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-config-out\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935088 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c153af35-179d-4d09-b038-d56af1f13d7e-alertmanager-main-db\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:08.935434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:08.935099 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c153af35-179d-4d09-b038-d56af1f13d7e-web-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:09.421316 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421285 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc" exitCode=0 Jul 05 11:56:09.421316 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421308 2578 generic.go:356] "Generic (PLEG): container finished" podID="c153af35-179d-4d09-b038-d56af1f13d7e" containerID="ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e" exitCode=0 Jul 05 11:56:09.421518 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421328 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc"} Jul 05 11:56:09.421518 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421360 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.421518 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421385 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e"} Jul 05 11:56:09.421518 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c153af35-179d-4d09-b038-d56af1f13d7e","Type":"ContainerDied","Data":"08f106d7f8f436b74ab9955a6899a9858016bd238006b1c516873204be48f737"} Jul 05 11:56:09.421518 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.421442 2578 scope.go:117] "RemoveContainer" containerID="e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2" Jul 05 11:56:09.429414 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.429393 2578 scope.go:117] "RemoveContainer" containerID="c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc" Jul 05 11:56:09.441236 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.441209 2578 scope.go:117] "RemoveContainer" containerID="e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9" Jul 05 11:56:09.443668 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.443642 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:56:09.448106 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.448084 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:56:09.449786 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.449767 2578 scope.go:117] "RemoveContainer" containerID="ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e" Jul 05 11:56:09.456344 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.456327 2578 scope.go:117] "RemoveContainer" containerID="e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992" Jul 05 11:56:09.463348 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.463332 2578 scope.go:117] "RemoveContainer" containerID="dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d" Jul 05 11:56:09.470753 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.470729 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:56:09.470992 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.470972 2578 scope.go:117] "RemoveContainer" containerID="be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777" Jul 05 11:56:09.471073 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471042 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="init-config-reloader" Jul 05 11:56:09.471118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471076 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="init-config-reloader" Jul 05 11:56:09.471118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471088 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy" Jul 05 11:56:09.471118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471094 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy" Jul 05 11:56:09.471118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471102 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="alertmanager" Jul 05 11:56:09.471118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471108 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="alertmanager" Jul 05 11:56:09.471118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471118 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="prom-label-proxy" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471123 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="prom-label-proxy" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471139 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="config-reloader" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471146 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="config-reloader" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471156 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-web" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471164 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-web" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471170 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-metric" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471175 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-metric" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471183 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6a3a9-14c5-4a85-9527-bbe8be406d77" containerName="console" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471188 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6a3a9-14c5-4a85-9527-bbe8be406d77" containerName="console" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471232 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-web" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471239 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="alertmanager" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471244 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471250 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="prom-label-proxy" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471256 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6a3a9-14c5-4a85-9527-bbe8be406d77" containerName="console" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471261 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="kube-rbac-proxy-metric" Jul 05 11:56:09.471314 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.471266 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" containerName="config-reloader" Jul 05 11:56:09.476602 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.476584 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.478401 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.478380 2578 scope.go:117] "RemoveContainer" containerID="e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2" Jul 05 11:56:09.478710 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.478684 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2\": container with ID starting with e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2 not found: ID does not exist" containerID="e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2" Jul 05 11:56:09.478807 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.478717 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2"} err="failed to get container status \"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2\": rpc error: code = NotFound desc = could not find container \"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2\": container with ID starting with e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2 not found: ID does not exist" Jul 05 11:56:09.478807 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.478742 2578 scope.go:117] "RemoveContainer" containerID="c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc" Jul 05 11:56:09.478928 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.478805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 05 11:56:09.478928 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.478852 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 05 11:56:09.479025 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 05 11:56:09.479255 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 05 11:56:09.479378 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.479359 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc\": container with ID starting with c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc not found: ID does not exist" containerID="c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc" Jul 05 11:56:09.479434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479388 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc"} err="failed to get container status \"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc\": rpc error: code = NotFound desc = could not find container \"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc\": container with ID starting with c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc not found: ID does not exist" Jul 05 11:56:09.479434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479411 2578 scope.go:117] "RemoveContainer" containerID="e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9" Jul 05 11:56:09.479533 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 05 11:56:09.479533 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479493 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 05 11:56:09.479626 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 05 11:56:09.479626 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479584 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 05 11:56:09.479724 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479692 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vrp42\"" Jul 05 11:56:09.479724 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.479708 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9\": container with ID starting with e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9 not found: ID does not exist" containerID="e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9" Jul 05 11:56:09.479821 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479735 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9"} err="failed to get container status \"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9\": rpc error: code = NotFound desc = could not find container \"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9\": container with ID starting with e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9 not found: ID does not exist" Jul 05 11:56:09.479821 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.479757 2578 scope.go:117] "RemoveContainer" containerID="ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e" Jul 05 11:56:09.480082 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.480038 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e\": container with ID starting with ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e not found: ID does not exist" containerID="ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e" Jul 05 11:56:09.480200 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480085 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e"} err="failed to get container status \"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e\": rpc error: code = NotFound desc = could not find container \"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e\": container with ID starting with ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e not found: ID does not exist" Jul 05 11:56:09.480200 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480101 2578 scope.go:117] "RemoveContainer" containerID="e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992" Jul 05 11:56:09.480341 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.480324 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992\": container with ID starting with e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992 not found: ID does not exist" containerID="e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992" Jul 05 11:56:09.480405 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480346 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992"} err="failed to get container status \"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992\": rpc error: code = NotFound desc = could not find container \"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992\": container with ID starting with e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992 not found: ID does not exist" Jul 05 11:56:09.480405 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480361 2578 scope.go:117] "RemoveContainer" containerID="dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d" Jul 05 11:56:09.480650 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.480621 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d\": container with ID starting with dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d not found: ID does not exist" containerID="dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d" Jul 05 11:56:09.480728 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480655 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d"} err="failed to get container status \"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d\": rpc error: code = NotFound desc = could not find container \"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d\": container with ID starting with dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d not found: ID does not exist" Jul 05 11:56:09.480728 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480669 2578 scope.go:117] "RemoveContainer" containerID="be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777" Jul 05 11:56:09.480942 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:09.480925 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777\": container with ID starting with be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777 not found: ID does not exist" containerID="be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777" Jul 05 11:56:09.481002 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480950 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777"} err="failed to get container status \"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777\": rpc error: code = NotFound desc = could not find container \"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777\": container with ID starting with be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777 not found: ID does not exist" Jul 05 11:56:09.481002 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.480970 2578 scope.go:117] "RemoveContainer" containerID="e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2" Jul 05 11:56:09.481295 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.481272 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2"} err="failed to get container status \"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2\": rpc error: code = NotFound desc = could not find container \"e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2\": container with ID starting with e69300da2353f255f7cc6de6df9ddacc251528f69dc0a18fd1ccb385a0fc89d2 not found: ID does not exist" Jul 05 11:56:09.481392 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.481296 2578 scope.go:117] "RemoveContainer" containerID="c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc" Jul 05 11:56:09.481575 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.481553 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc"} err="failed to get container status \"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc\": rpc error: code = NotFound desc = could not find container \"c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc\": container with ID starting with c4a8a6896d68b942f8dc17a4d805ecd300fbbf22492122106ec07e6972c9c4fc not found: ID does not exist" Jul 05 11:56:09.481674 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.481579 2578 scope.go:117] "RemoveContainer" containerID="e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9" Jul 05 11:56:09.481883 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.481863 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9"} err="failed to get container status \"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9\": rpc error: code = NotFound desc = could not find container \"e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9\": container with ID starting with e2d99d4570dfbfb3933fc43b2c4ae0b595077dd9720624ffd7e04802a7872aa9 not found: ID does not exist" Jul 05 11:56:09.481883 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.481883 2578 scope.go:117] "RemoveContainer" containerID="ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e" Jul 05 11:56:09.482139 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482121 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e"} err="failed to get container status \"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e\": rpc error: code = NotFound desc = could not find container \"ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e\": container with ID starting with ae03fe9c2ae41f73f2d283509132da77d179602257a2c8ad68bc8955d0eaf32e not found: ID does not exist" Jul 05 11:56:09.482139 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482139 2578 scope.go:117] "RemoveContainer" containerID="e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992" Jul 05 11:56:09.482379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482358 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992"} err="failed to get container status \"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992\": rpc error: code = NotFound desc = could not find container \"e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992\": container with ID starting with e1b69e92c0553de2d606ca0da801e25af9221d3fce28bca21b29af780dbf2992 not found: ID does not exist" Jul 05 11:56:09.482379 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482379 2578 scope.go:117] "RemoveContainer" containerID="dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d" Jul 05 11:56:09.482644 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482617 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d"} err="failed to get container status \"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d\": rpc error: code = NotFound desc = could not find container \"dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d\": container with ID starting with dcf6e0c7a04e9d1c139dfc3e858367cd6d5c289ad2c48de1f06d4731396e5a0d not found: ID does not exist" Jul 05 11:56:09.482715 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482646 2578 scope.go:117] "RemoveContainer" containerID="be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777" Jul 05 11:56:09.482898 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.482875 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777"} err="failed to get container status \"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777\": rpc error: code = NotFound desc = could not find container \"be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777\": container with ID starting with be28fc94b146d98ed1565326d65665586b866874cea646569ea2184d065fa777 not found: ID does not exist" Jul 05 11:56:09.485566 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.485545 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 05 11:56:09.486411 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.486390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:56:09.640003 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.639952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a58b950e-d556-4579-859a-1a5bc45da1bc-config-out\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640003 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58b950e-d556-4579-859a-1a5bc45da1bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a58b950e-d556-4579-859a-1a5bc45da1bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a58b950e-d556-4579-859a-1a5bc45da1bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640239 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-web-config\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a58b950e-d556-4579-859a-1a5bc45da1bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjpc5\" (UniqueName: \"kubernetes.io/projected/a58b950e-d556-4579-859a-1a5bc45da1bc-kube-api-access-jjpc5\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.640389 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.640368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.741605 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a58b950e-d556-4579-859a-1a5bc45da1bc-config-out\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.741605 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58b950e-d556-4579-859a-1a5bc45da1bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a58b950e-d556-4579-859a-1a5bc45da1bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a58b950e-d556-4579-859a-1a5bc45da1bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-web-config\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a58b950e-d556-4579-859a-1a5bc45da1bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjpc5\" (UniqueName: \"kubernetes.io/projected/a58b950e-d556-4579-859a-1a5bc45da1bc-kube-api-access-jjpc5\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.741926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742624 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.742123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a58b950e-d556-4579-859a-1a5bc45da1bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742705 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.742681 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58b950e-d556-4579-859a-1a5bc45da1bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.742781 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.742705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a58b950e-d556-4579-859a-1a5bc45da1bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.744459 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.744430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a58b950e-d556-4579-859a-1a5bc45da1bc-config-out\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.744628 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.744603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.744754 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.744733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a58b950e-d556-4579-859a-1a5bc45da1bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.745398 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.745356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.745600 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.745569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.745772 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.745748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.745834 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.745808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.746115 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.746092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.746872 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.746851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a58b950e-d556-4579-859a-1a5bc45da1bc-web-config\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.747215 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.747197 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c153af35-179d-4d09-b038-d56af1f13d7e" path="/var/lib/kubelet/pods/c153af35-179d-4d09-b038-d56af1f13d7e/volumes" Jul 05 11:56:09.750141 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.750122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjpc5\" (UniqueName: \"kubernetes.io/projected/a58b950e-d556-4579-859a-1a5bc45da1bc-kube-api-access-jjpc5\") pod \"alertmanager-main-0\" (UID: \"a58b950e-d556-4579-859a-1a5bc45da1bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.787990 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.787948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 11:56:09.923708 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:09.923668 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 11:56:09.926646 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:56:09.926623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58b950e_d556_4579_859a_1a5bc45da1bc.slice/crio-19ee784d5c2c8595902da4ba83abe363cbd12d657214fd84f9ed320695c90868 WatchSource:0}: Error finding container 19ee784d5c2c8595902da4ba83abe363cbd12d657214fd84f9ed320695c90868: Status 404 returned error can't find the container with id 19ee784d5c2c8595902da4ba83abe363cbd12d657214fd84f9ed320695c90868 Jul 05 11:56:10.427515 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:10.427483 2578 generic.go:356] "Generic (PLEG): container finished" podID="a58b950e-d556-4579-859a-1a5bc45da1bc" containerID="8f3405c350ef4482b294fe7b2840346a7cd0e613b9d1b8e31af2752fed81b33f" exitCode=0 Jul 05 11:56:10.427687 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:10.427521 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerDied","Data":"8f3405c350ef4482b294fe7b2840346a7cd0e613b9d1b8e31af2752fed81b33f"} Jul 05 11:56:10.427687 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:10.427572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"19ee784d5c2c8595902da4ba83abe363cbd12d657214fd84f9ed320695c90868"} Jul 05 11:56:11.435318 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.435283 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56cc9c6b89-7z49r"] Jul 05 11:56:11.439478 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"5c3d4feb63ef5e73d8bdadba5a650bfa231c8c38f7fc83f679e43fc0c781cd87"} Jul 05 11:56:11.439641 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"3cb9efcee636c6e2fb68a0b39bdfe57d3f5a266050d309368092f3ea0b582594"} Jul 05 11:56:11.439641 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"2d21d92a5ea0547b9640172783b0e7b3d7ce250e7102986d5d38c4b692067e6e"} Jul 05 11:56:11.439641 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"0881d0d8c9e4c4ce405cb5a25a76ae43f1628e40c628881ab93c8bdbab1c636b"} Jul 05 11:56:11.439790 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"d448d7cf415edaa47dd590200779bf16a28e2e229401e1c60b58639831caab4e"} Jul 05 11:56:11.439790 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a58b950e-d556-4579-859a-1a5bc45da1bc","Type":"ContainerStarted","Data":"11f227e12675a20e78c806c934afe97b6159bd3ddf46a859781905f93710a31e"} Jul 05 11:56:11.439790 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.439757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.444201 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.444174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 05 11:56:11.444324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.444219 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 05 11:56:11.444324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.444224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 05 11:56:11.444324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.444258 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 05 11:56:11.444324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.444174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xdzzl\"" Jul 05 11:56:11.444523 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.444457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 05 11:56:11.448652 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.448629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 05 11:56:11.449098 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.449074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56cc9c6b89-7z49r"] Jul 05 11:56:11.466692 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.466645 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.450842067 podStartE2EDuration="2.466628059s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.785992ms" isStatefulPod=false podCreationTimestamp="2026-07-05 11:56:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:56:11.46544646 +0000 UTC m=+150.203984028" watchObservedRunningTime="2026-07-05 11:56:11.466628059 +0000 UTC m=+150.205165575" Jul 05 11:56:11.558863 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.558821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-serving-certs-ca-bundle\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.558863 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.558864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-federate-client-tls\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.559151 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.558923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.559151 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.559109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.559151 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.559140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-secret-telemeter-client\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.559296 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.559192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-metrics-client-ca\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.559296 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.559215 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crhvn\" (UniqueName: \"kubernetes.io/projected/ebba0262-216a-404d-a914-539fc588b454-kube-api-access-crhvn\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.559296 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.559257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-telemeter-client-tls\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660075 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660075 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-secret-telemeter-client\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660272 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-metrics-client-ca\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660272 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crhvn\" (UniqueName: \"kubernetes.io/projected/ebba0262-216a-404d-a914-539fc588b454-kube-api-access-crhvn\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660272 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-telemeter-client-tls\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-serving-certs-ca-bundle\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-federate-client-tls\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.660889 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-metrics-client-ca\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.661012 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.660929 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-serving-certs-ca-bundle\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.661364 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.661331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebba0262-216a-404d-a914-539fc588b454-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.662798 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.662778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-secret-telemeter-client\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.662955 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.662934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-federate-client-tls\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.663121 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.663101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.663177 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.663163 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ebba0262-216a-404d-a914-539fc588b454-telemeter-client-tls\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.667168 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.667148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crhvn\" (UniqueName: \"kubernetes.io/projected/ebba0262-216a-404d-a914-539fc588b454-kube-api-access-crhvn\") pod \"telemeter-client-56cc9c6b89-7z49r\" (UID: \"ebba0262-216a-404d-a914-539fc588b454\") " pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.751130 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.751020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" Jul 05 11:56:11.901782 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:11.901748 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56cc9c6b89-7z49r"] Jul 05 11:56:11.906071 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:56:11.906017 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebba0262_216a_404d_a914_539fc588b454.slice/crio-93aa746d4253625897d8424f8cda517abae42a069a1a6388aff00aa7b610c2fe WatchSource:0}: Error finding container 93aa746d4253625897d8424f8cda517abae42a069a1a6388aff00aa7b610c2fe: Status 404 returned error can't find the container with id 93aa746d4253625897d8424f8cda517abae42a069a1a6388aff00aa7b610c2fe Jul 05 11:56:12.441067 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:12.441018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" event={"ID":"ebba0262-216a-404d-a914-539fc588b454","Type":"ContainerStarted","Data":"93aa746d4253625897d8424f8cda517abae42a069a1a6388aff00aa7b610c2fe"} Jul 05 11:56:14.450807 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:14.450772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" event={"ID":"ebba0262-216a-404d-a914-539fc588b454","Type":"ContainerStarted","Data":"122d6d494d50e51423356466f0107b7f86c20a8c381d4dee7e9d5a97a931d777"} Jul 05 11:56:14.451231 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:14.450828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" event={"ID":"ebba0262-216a-404d-a914-539fc588b454","Type":"ContainerStarted","Data":"e5aa2702e84c52e8e49422b3d75d76c38dbe4afac303994a465b2adfb2eaa3d6"} Jul 05 11:56:14.451231 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:14.450847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" event={"ID":"ebba0262-216a-404d-a914-539fc588b454","Type":"ContainerStarted","Data":"449dcf3591700a46586e3b6fea90d2ef8f0be8368ac403b9860e9986cdf1d790"} Jul 05 11:56:14.470634 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:14.470465 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56cc9c6b89-7z49r" podStartSLOduration=1.699336658 podStartE2EDuration="3.470446237s" totalImagesPullingTime="1.771109579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:56:14.469236925 +0000 UTC m=+153.207774441" watchObservedRunningTime="2026-07-05 11:56:14.470446237 +0000 UTC m=+153.208983754" Jul 05 11:56:15.210996 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.210958 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9d94b885-d6vht"] Jul 05 11:56:15.213110 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.213094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.224268 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.224241 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9d94b885-d6vht"] Jul 05 11:56:15.291947 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.291895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-console-config\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.291947 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.291960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-service-ca\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.292186 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.291984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-oauth-config\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.292186 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.292022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-oauth-serving-cert\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.292186 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.292113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-serving-cert\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.292289 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.292205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-trusted-ca-bundle\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.292289 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.292239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6wl\" (UniqueName: \"kubernetes.io/projected/7148cc84-730e-416b-9cb4-545261aa2b99-kube-api-access-nt6wl\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.392853 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.392803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-trusted-ca-bundle\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.392866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6wl\" (UniqueName: \"kubernetes.io/projected/7148cc84-730e-416b-9cb4-545261aa2b99-kube-api-access-nt6wl\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.392911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-console-config\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.392943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-service-ca\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.392966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-oauth-config\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.393015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-oauth-serving-cert\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393099 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.393073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-serving-cert\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393744 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.393721 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-console-config\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393855 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.393747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-service-ca\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393855 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.393795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-oauth-serving-cert\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.393968 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.393869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-trusted-ca-bundle\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.395462 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.395434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-serving-cert\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.395554 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.395508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-oauth-config\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.399788 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.399769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6wl\" (UniqueName: \"kubernetes.io/projected/7148cc84-730e-416b-9cb4-545261aa2b99-kube-api-access-nt6wl\") pod \"console-5d9d94b885-d6vht\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.523294 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.523197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:15.683977 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:15.683941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9d94b885-d6vht"] Jul 05 11:56:15.687813 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:56:15.687781 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7148cc84_730e_416b_9cb4_545261aa2b99.slice/crio-55a4dc5341b82b15285d28debb5d70e6371dcbd82f2d223ffb38edb6077471d4 WatchSource:0}: Error finding container 55a4dc5341b82b15285d28debb5d70e6371dcbd82f2d223ffb38edb6077471d4: Status 404 returned error can't find the container with id 55a4dc5341b82b15285d28debb5d70e6371dcbd82f2d223ffb38edb6077471d4 Jul 05 11:56:16.460542 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:16.460502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9d94b885-d6vht" event={"ID":"7148cc84-730e-416b-9cb4-545261aa2b99","Type":"ContainerStarted","Data":"43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4"} Jul 05 11:56:16.460715 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:16.460563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9d94b885-d6vht" event={"ID":"7148cc84-730e-416b-9cb4-545261aa2b99","Type":"ContainerStarted","Data":"55a4dc5341b82b15285d28debb5d70e6371dcbd82f2d223ffb38edb6077471d4"} Jul 05 11:56:16.476492 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:16.476442 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9d94b885-d6vht" podStartSLOduration=1.476425034 podStartE2EDuration="1.476425034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:56:16.475936949 +0000 UTC m=+155.214474500" watchObservedRunningTime="2026-07-05 11:56:16.476425034 +0000 UTC m=+155.214962551" Jul 05 11:56:25.524235 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:25.524197 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:25.524701 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:25.524288 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:25.528833 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:25.528810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:26.503024 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:26.502993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:56:26.543256 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:26.543224 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674d746d9d-2dfvz"] Jul 05 11:56:51.563447 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.563382 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-674d746d9d-2dfvz" podUID="14ad6fbc-7e59-456e-8e26-c37f45491f2e" containerName="console" containerID="cri-o://92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851" gracePeriod=15 Jul 05 11:56:51.808745 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.808721 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:56:51.911807 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.911765 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-serving-cert\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912017 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.911821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-service-ca\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912017 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.911895 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-trusted-ca-bundle\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912174 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912016 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-config\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912174 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912084 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-658pt\" (UniqueName: \"kubernetes.io/projected/14ad6fbc-7e59-456e-8e26-c37f45491f2e-kube-api-access-658pt\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912277 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912181 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-oauth-config\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912336 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912305 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-oauth-serving-cert\") pod \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\" (UID: \"14ad6fbc-7e59-456e-8e26-c37f45491f2e\") " Jul 05 11:56:51.912336 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912316 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-service-ca" (OuterVolumeSpecName: "service-ca") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:56:51.912440 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912368 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-config" (OuterVolumeSpecName: "console-config") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:56:51.912581 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912559 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-service-ca\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:51.912665 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912583 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:51.912665 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912651 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:56:51.912943 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.912697 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:56:51.914144 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.914123 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:51.914297 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.914277 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:56:51.914360 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:51.914308 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ad6fbc-7e59-456e-8e26-c37f45491f2e-kube-api-access-658pt" (OuterVolumeSpecName: "kube-api-access-658pt") pod "14ad6fbc-7e59-456e-8e26-c37f45491f2e" (UID: "14ad6fbc-7e59-456e-8e26-c37f45491f2e"). InnerVolumeSpecName "kube-api-access-658pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:56:52.013082 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.013037 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-trusted-ca-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:52.013082 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.013079 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-658pt\" (UniqueName: \"kubernetes.io/projected/14ad6fbc-7e59-456e-8e26-c37f45491f2e-kube-api-access-658pt\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:52.013082 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.013089 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-oauth-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:52.013295 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.013097 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ad6fbc-7e59-456e-8e26-c37f45491f2e-oauth-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:52.013295 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.013106 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ad6fbc-7e59-456e-8e26-c37f45491f2e-console-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:56:52.597830 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.597378 2578 generic.go:356] "Generic (PLEG): container finished" podID="14ad6fbc-7e59-456e-8e26-c37f45491f2e" containerID="92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851" exitCode=0 Jul 05 11:56:52.597830 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.597535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d746d9d-2dfvz" event={"ID":"14ad6fbc-7e59-456e-8e26-c37f45491f2e","Type":"ContainerDied","Data":"92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851"} Jul 05 11:56:52.597830 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.597550 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d746d9d-2dfvz" Jul 05 11:56:52.597830 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.597630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d746d9d-2dfvz" event={"ID":"14ad6fbc-7e59-456e-8e26-c37f45491f2e","Type":"ContainerDied","Data":"c070dd8b793d717289dc6ebd7feb8debf1e8ff2f6c74274c86884deba805f300"} Jul 05 11:56:52.597830 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.597661 2578 scope.go:117] "RemoveContainer" containerID="92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851" Jul 05 11:56:52.611077 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.611039 2578 scope.go:117] "RemoveContainer" containerID="92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851" Jul 05 11:56:52.611352 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:56:52.611321 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851\": container with ID starting with 92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851 not found: ID does not exist" containerID="92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851" Jul 05 11:56:52.611511 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.611358 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851"} err="failed to get container status \"92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851\": rpc error: code = NotFound desc = could not find container \"92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851\": container with ID starting with 92e5334cc867a6e37395873198db91ab6ff2340f92ca81214d4e9ac376723851 not found: ID does not exist" Jul 05 11:56:52.620391 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.620362 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674d746d9d-2dfvz"] Jul 05 11:56:52.623942 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:52.623917 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-674d746d9d-2dfvz"] Jul 05 11:56:53.744637 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:56:53.744603 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14ad6fbc-7e59-456e-8e26-c37f45491f2e" path="/var/lib/kubelet/pods/14ad6fbc-7e59-456e-8e26-c37f45491f2e/volumes" Jul 05 11:57:29.171654 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.171613 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69bcf68df8-zs9qp"] Jul 05 11:57:29.172269 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.172022 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ad6fbc-7e59-456e-8e26-c37f45491f2e" containerName="console" Jul 05 11:57:29.172269 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.172039 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ad6fbc-7e59-456e-8e26-c37f45491f2e" containerName="console" Jul 05 11:57:29.172269 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.172158 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ad6fbc-7e59-456e-8e26-c37f45491f2e" containerName="console" Jul 05 11:57:29.175118 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.175096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.184942 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.184917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69bcf68df8-zs9qp"] Jul 05 11:57:29.288100 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-oauth-config\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.288100 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-serving-cert\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.288356 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-config\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.288356 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-trusted-ca-bundle\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.288356 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-service-ca\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.288356 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzr2\" (UniqueName: \"kubernetes.io/projected/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-kube-api-access-bgzr2\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.288356 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.288297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-oauth-serving-cert\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389385 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-trusted-ca-bundle\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389570 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-service-ca\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389570 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzr2\" (UniqueName: \"kubernetes.io/projected/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-kube-api-access-bgzr2\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389570 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-oauth-serving-cert\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389570 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-oauth-config\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389570 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-serving-cert\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.389570 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.389553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-config\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.390287 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.390254 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-service-ca\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.390426 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.390259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-oauth-serving-cert\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.390426 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.390343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-trusted-ca-bundle\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.390426 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.390398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-config\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.392033 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.392012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-oauth-config\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.392190 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.392172 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-serving-cert\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.396402 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.396382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzr2\" (UniqueName: \"kubernetes.io/projected/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-kube-api-access-bgzr2\") pod \"console-69bcf68df8-zs9qp\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.484647 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.484564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:29.611361 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.611332 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69bcf68df8-zs9qp"] Jul 05 11:57:29.614389 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:57:29.614360 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e995af_dbc4_4dcb_a7d9_c5ecd8ae6523.slice/crio-1e2fbf182998c82fbceeeea739966849fab7130df27a2f51216ebbccdbbce64f WatchSource:0}: Error finding container 1e2fbf182998c82fbceeeea739966849fab7130df27a2f51216ebbccdbbce64f: Status 404 returned error can't find the container with id 1e2fbf182998c82fbceeeea739966849fab7130df27a2f51216ebbccdbbce64f Jul 05 11:57:29.732825 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.732791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bcf68df8-zs9qp" event={"ID":"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523","Type":"ContainerStarted","Data":"3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4"} Jul 05 11:57:29.732993 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.732848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bcf68df8-zs9qp" event={"ID":"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523","Type":"ContainerStarted","Data":"1e2fbf182998c82fbceeeea739966849fab7130df27a2f51216ebbccdbbce64f"} Jul 05 11:57:29.748174 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:29.748076 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69bcf68df8-zs9qp" podStartSLOduration=0.747999121 podStartE2EDuration="747.999121ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:57:29.746985239 +0000 UTC m=+228.485522759" watchObservedRunningTime="2026-07-05 11:57:29.747999121 +0000 UTC m=+228.486536639" Jul 05 11:57:39.485486 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:39.485445 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:39.485955 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:39.485540 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:39.490065 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:39.490029 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:39.774147 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:39.774070 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 11:57:39.816172 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:57:39.816140 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9d94b885-d6vht"] Jul 05 11:58:04.836733 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:04.836642 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d9d94b885-d6vht" podUID="7148cc84-730e-416b-9cb4-545261aa2b99" containerName="console" containerID="cri-o://43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4" gracePeriod=15 Jul 05 11:58:05.084794 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.084767 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:58:05.185679 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185592 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-trusted-ca-bundle\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.185679 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185627 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt6wl\" (UniqueName: \"kubernetes.io/projected/7148cc84-730e-416b-9cb4-545261aa2b99-kube-api-access-nt6wl\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.185679 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185658 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-oauth-serving-cert\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.185974 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185768 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-service-ca\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.185974 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185832 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-serving-cert\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.185974 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185876 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-console-config\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.185974 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.185906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-oauth-config\") pod \"7148cc84-730e-416b-9cb4-545261aa2b99\" (UID: \"7148cc84-730e-416b-9cb4-545261aa2b99\") " Jul 05 11:58:05.186190 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.186028 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:58:05.186251 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.186220 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:58:05.186308 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.186251 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-oauth-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.186308 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.186255 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-console-config" (OuterVolumeSpecName: "console-config") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:58:05.186308 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.186266 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-service-ca" (OuterVolumeSpecName: "service-ca") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 11:58:05.187837 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.187806 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7148cc84-730e-416b-9cb4-545261aa2b99-kube-api-access-nt6wl" (OuterVolumeSpecName: "kube-api-access-nt6wl") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "kube-api-access-nt6wl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:58:05.187954 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.187852 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:58:05.188011 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.187973 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7148cc84-730e-416b-9cb4-545261aa2b99" (UID: "7148cc84-730e-416b-9cb4-545261aa2b99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 11:58:05.286622 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.286578 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-service-ca\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.286622 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.286613 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.286622 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.286625 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-console-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.286865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.286636 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7148cc84-730e-416b-9cb4-545261aa2b99-console-oauth-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.286865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.286648 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7148cc84-730e-416b-9cb4-545261aa2b99-trusted-ca-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.286865 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.286659 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6wl\" (UniqueName: \"kubernetes.io/projected/7148cc84-730e-416b-9cb4-545261aa2b99-kube-api-access-nt6wl\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:05.866001 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.865971 2578 generic.go:356] "Generic (PLEG): container finished" podID="7148cc84-730e-416b-9cb4-545261aa2b99" containerID="43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4" exitCode=0 Jul 05 11:58:05.866390 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.866016 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9d94b885-d6vht" Jul 05 11:58:05.866390 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.866069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9d94b885-d6vht" event={"ID":"7148cc84-730e-416b-9cb4-545261aa2b99","Type":"ContainerDied","Data":"43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4"} Jul 05 11:58:05.866390 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.866127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9d94b885-d6vht" event={"ID":"7148cc84-730e-416b-9cb4-545261aa2b99","Type":"ContainerDied","Data":"55a4dc5341b82b15285d28debb5d70e6371dcbd82f2d223ffb38edb6077471d4"} Jul 05 11:58:05.866390 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.866154 2578 scope.go:117] "RemoveContainer" containerID="43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4" Jul 05 11:58:05.878690 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.878666 2578 scope.go:117] "RemoveContainer" containerID="43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4" Jul 05 11:58:05.878971 ip-10-0-136-198 kubenswrapper[2578]: E0705 11:58:05.878951 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4\": container with ID starting with 43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4 not found: ID does not exist" containerID="43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4" Jul 05 11:58:05.879017 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.878980 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4"} err="failed to get container status \"43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4\": rpc error: code = NotFound desc = could not find container \"43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4\": container with ID starting with 43640a9e8fd82434d2ed575ae89f4cb65ce74488919e8363a99a77115e64e4c4 not found: ID does not exist" Jul 05 11:58:05.885284 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.885259 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9d94b885-d6vht"] Jul 05 11:58:05.888743 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:05.888717 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d9d94b885-d6vht"] Jul 05 11:58:07.744706 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:07.744676 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7148cc84-730e-416b-9cb4-545261aa2b99" path="/var/lib/kubelet/pods/7148cc84-730e-416b-9cb4-545261aa2b99/volumes" Jul 05 11:58:37.043081 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.043030 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw"] Jul 05 11:58:37.043506 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.043325 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7148cc84-730e-416b-9cb4-545261aa2b99" containerName="console" Jul 05 11:58:37.043506 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.043336 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7148cc84-730e-416b-9cb4-545261aa2b99" containerName="console" Jul 05 11:58:37.043506 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.043386 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7148cc84-730e-416b-9cb4-545261aa2b99" containerName="console" Jul 05 11:58:37.046090 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.046073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.048432 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.048410 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 11:58:37.048546 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.048414 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nqt26\"" Jul 05 11:58:37.049308 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.049292 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 11:58:37.061363 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.061330 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw"] Jul 05 11:58:37.135845 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.135806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.136043 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.135860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.136043 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.135883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgmr\" (UniqueName: \"kubernetes.io/projected/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-kube-api-access-tzgmr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.237382 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.237338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.237382 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.237389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.237578 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.237412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgmr\" (UniqueName: \"kubernetes.io/projected/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-kube-api-access-tzgmr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.237735 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.237716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.237775 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.237741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.245475 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.245449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgmr\" (UniqueName: \"kubernetes.io/projected/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-kube-api-access-tzgmr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.359232 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.359196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:37.485115 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.484996 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw"] Jul 05 11:58:37.487863 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:58:37.487836 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b8195f_1f9c_458d_bfcf_b6a572882dc8.slice/crio-2f86f131801c67432a015a3757f4d2226ed4bc3acfd7a2229f3b2c37d3f64be8 WatchSource:0}: Error finding container 2f86f131801c67432a015a3757f4d2226ed4bc3acfd7a2229f3b2c37d3f64be8: Status 404 returned error can't find the container with id 2f86f131801c67432a015a3757f4d2226ed4bc3acfd7a2229f3b2c37d3f64be8 Jul 05 11:58:37.981352 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:37.981319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" event={"ID":"c7b8195f-1f9c-458d-bfcf-b6a572882dc8","Type":"ContainerStarted","Data":"2f86f131801c67432a015a3757f4d2226ed4bc3acfd7a2229f3b2c37d3f64be8"} Jul 05 11:58:43.464946 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:43.464918 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 11:58:44.009611 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:44.009578 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerID="5e4976e10bdce8d17b4104106a80724ce1d850f771f8c1acd38b245974cfbcb9" exitCode=0 Jul 05 11:58:44.009818 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:44.009625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" event={"ID":"c7b8195f-1f9c-458d-bfcf-b6a572882dc8","Type":"ContainerDied","Data":"5e4976e10bdce8d17b4104106a80724ce1d850f771f8c1acd38b245974cfbcb9"} Jul 05 11:58:44.010651 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:44.010633 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 11:58:46.019780 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:46.019743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" event={"ID":"c7b8195f-1f9c-458d-bfcf-b6a572882dc8","Type":"ContainerStarted","Data":"bbf0ff2a52a70c88bd64a419684d77c2a54f9d98c3dc2f1f8d56a26e5e7c1a33"} Jul 05 11:58:47.025381 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:47.025352 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerID="bbf0ff2a52a70c88bd64a419684d77c2a54f9d98c3dc2f1f8d56a26e5e7c1a33" exitCode=0 Jul 05 11:58:47.025762 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:47.025401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" event={"ID":"c7b8195f-1f9c-458d-bfcf-b6a572882dc8","Type":"ContainerDied","Data":"bbf0ff2a52a70c88bd64a419684d77c2a54f9d98c3dc2f1f8d56a26e5e7c1a33"} Jul 05 11:58:54.055624 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:54.055595 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerID="e6fa4d2b7e7016023eb9a32ba58c76ed50abf225a642d6d60d07d0d7256f83f7" exitCode=0 Jul 05 11:58:54.055939 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:54.055677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" event={"ID":"c7b8195f-1f9c-458d-bfcf-b6a572882dc8","Type":"ContainerDied","Data":"e6fa4d2b7e7016023eb9a32ba58c76ed50abf225a642d6d60d07d0d7256f83f7"} Jul 05 11:58:55.179025 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.179002 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:55.303194 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.303141 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-bundle\") pod \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " Jul 05 11:58:55.303374 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.303242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzgmr\" (UniqueName: \"kubernetes.io/projected/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-kube-api-access-tzgmr\") pod \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " Jul 05 11:58:55.303374 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.303270 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-util\") pod \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\" (UID: \"c7b8195f-1f9c-458d-bfcf-b6a572882dc8\") " Jul 05 11:58:55.304002 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.303975 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-bundle" (OuterVolumeSpecName: "bundle") pod "c7b8195f-1f9c-458d-bfcf-b6a572882dc8" (UID: "c7b8195f-1f9c-458d-bfcf-b6a572882dc8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:58:55.305451 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.305429 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-kube-api-access-tzgmr" (OuterVolumeSpecName: "kube-api-access-tzgmr") pod "c7b8195f-1f9c-458d-bfcf-b6a572882dc8" (UID: "c7b8195f-1f9c-458d-bfcf-b6a572882dc8"). InnerVolumeSpecName "kube-api-access-tzgmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:58:55.309166 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.309113 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-util" (OuterVolumeSpecName: "util") pod "c7b8195f-1f9c-458d-bfcf-b6a572882dc8" (UID: "c7b8195f-1f9c-458d-bfcf-b6a572882dc8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:58:55.404102 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.404064 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:55.404102 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.404096 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzgmr\" (UniqueName: \"kubernetes.io/projected/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-kube-api-access-tzgmr\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:55.404102 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:55.404109 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b8195f-1f9c-458d-bfcf-b6a572882dc8-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:58:56.064142 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:56.064065 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" Jul 05 11:58:56.064295 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:56.064037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wxnvw" event={"ID":"c7b8195f-1f9c-458d-bfcf-b6a572882dc8","Type":"ContainerDied","Data":"2f86f131801c67432a015a3757f4d2226ed4bc3acfd7a2229f3b2c37d3f64be8"} Jul 05 11:58:56.064295 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:56.064188 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f86f131801c67432a015a3757f4d2226ed4bc3acfd7a2229f3b2c37d3f64be8" Jul 05 11:58:59.915727 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.915695 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6"] Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.915984 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="util" Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.915996 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="util" Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.916006 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="pull" Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.916011 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="pull" Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.916019 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="extract" Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.916061 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="extract" Jul 05 11:58:59.916196 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.916117 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b8195f-1f9c-458d-bfcf-b6a572882dc8" containerName="extract" Jul 05 11:58:59.962174 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.962140 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6"] Jul 05 11:58:59.962349 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.962256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:58:59.964794 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.964770 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 05 11:58:59.964933 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.964818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pxjhw\"" Jul 05 11:58:59.964933 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:58:59.964853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 05 11:59:00.035299 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.035255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gttkn\" (UniqueName: \"kubernetes.io/projected/b6e933ff-325e-48e2-b8bc-0088654406d5-kube-api-access-gttkn\") pod \"cert-manager-operator-controller-manager-55c444bf86-ln2q6\" (UID: \"b6e933ff-325e-48e2-b8bc-0088654406d5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.035482 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.035313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6e933ff-325e-48e2-b8bc-0088654406d5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ln2q6\" (UID: \"b6e933ff-325e-48e2-b8bc-0088654406d5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.136550 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.136507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gttkn\" (UniqueName: \"kubernetes.io/projected/b6e933ff-325e-48e2-b8bc-0088654406d5-kube-api-access-gttkn\") pod \"cert-manager-operator-controller-manager-55c444bf86-ln2q6\" (UID: \"b6e933ff-325e-48e2-b8bc-0088654406d5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.136757 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.136578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6e933ff-325e-48e2-b8bc-0088654406d5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ln2q6\" (UID: \"b6e933ff-325e-48e2-b8bc-0088654406d5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.136988 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.136967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6e933ff-325e-48e2-b8bc-0088654406d5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ln2q6\" (UID: \"b6e933ff-325e-48e2-b8bc-0088654406d5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.144345 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.144312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gttkn\" (UniqueName: \"kubernetes.io/projected/b6e933ff-325e-48e2-b8bc-0088654406d5-kube-api-access-gttkn\") pod \"cert-manager-operator-controller-manager-55c444bf86-ln2q6\" (UID: \"b6e933ff-325e-48e2-b8bc-0088654406d5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.271560 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.271476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" Jul 05 11:59:00.420482 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:00.420450 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6"] Jul 05 11:59:00.423696 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:00.423672 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e933ff_325e_48e2_b8bc_0088654406d5.slice/crio-60431dae0fa0c1227234cb96b4608ad8192566eadb604142b5aecbb7b2bfe14f WatchSource:0}: Error finding container 60431dae0fa0c1227234cb96b4608ad8192566eadb604142b5aecbb7b2bfe14f: Status 404 returned error can't find the container with id 60431dae0fa0c1227234cb96b4608ad8192566eadb604142b5aecbb7b2bfe14f Jul 05 11:59:01.084443 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:01.084408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" event={"ID":"b6e933ff-325e-48e2-b8bc-0088654406d5","Type":"ContainerStarted","Data":"60431dae0fa0c1227234cb96b4608ad8192566eadb604142b5aecbb7b2bfe14f"} Jul 05 11:59:03.094165 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:03.094127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" event={"ID":"b6e933ff-325e-48e2-b8bc-0088654406d5","Type":"ContainerStarted","Data":"6b8b0f7e6efde1e55227684fb153d29fabc6c911f07974cfdc672a31de92cde1"} Jul 05 11:59:03.113494 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:03.113432 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ln2q6" podStartSLOduration=2.036623284 podStartE2EDuration="4.113410843s" totalImagesPullingTime="2.076787559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:59:03.111690819 +0000 UTC m=+321.850228340" watchObservedRunningTime="2026-07-05 11:59:03.113410843 +0000 UTC m=+321.851948361" Jul 05 11:59:04.236563 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.236504 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld"] Jul 05 11:59:04.249820 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.249786 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld"] Jul 05 11:59:04.249970 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.249896 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.252510 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.252479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 11:59:04.253396 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.253369 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nqt26\"" Jul 05 11:59:04.253545 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.253421 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 11:59:04.274346 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.274315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.274510 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.274352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhhj5\" (UniqueName: \"kubernetes.io/projected/33025ff3-fba2-4b6a-b476-f2651bf180ca-kube-api-access-hhhj5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.274510 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.274440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.375786 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.375747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.375965 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.375814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.375965 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.375848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhhj5\" (UniqueName: \"kubernetes.io/projected/33025ff3-fba2-4b6a-b476-f2651bf180ca-kube-api-access-hhhj5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.376206 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.376183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.376277 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.376216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.387496 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.387460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhhj5\" (UniqueName: \"kubernetes.io/projected/33025ff3-fba2-4b6a-b476-f2651bf180ca-kube-api-access-hhhj5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.404392 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.404360 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fjjdf"] Jul 05 11:59:04.421640 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.421603 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fjjdf"] Jul 05 11:59:04.421819 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.421696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.424105 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.424078 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6xqkm\"" Jul 05 11:59:04.424249 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.424124 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 05 11:59:04.424249 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.424162 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 05 11:59:04.476234 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.476197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3845d2a8-ffcb-4520-af64-bd6f0cf5498d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fjjdf\" (UID: \"3845d2a8-ffcb-4520-af64-bd6f0cf5498d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.476234 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.476241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g6c\" (UniqueName: \"kubernetes.io/projected/3845d2a8-ffcb-4520-af64-bd6f0cf5498d-kube-api-access-d4g6c\") pod \"cert-manager-webhook-6486ffd997-fjjdf\" (UID: \"3845d2a8-ffcb-4520-af64-bd6f0cf5498d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.559857 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.559765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:04.577411 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.577378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3845d2a8-ffcb-4520-af64-bd6f0cf5498d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fjjdf\" (UID: \"3845d2a8-ffcb-4520-af64-bd6f0cf5498d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.577411 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.577409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g6c\" (UniqueName: \"kubernetes.io/projected/3845d2a8-ffcb-4520-af64-bd6f0cf5498d-kube-api-access-d4g6c\") pod \"cert-manager-webhook-6486ffd997-fjjdf\" (UID: \"3845d2a8-ffcb-4520-af64-bd6f0cf5498d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.585107 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.585084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g6c\" (UniqueName: \"kubernetes.io/projected/3845d2a8-ffcb-4520-af64-bd6f0cf5498d-kube-api-access-d4g6c\") pod \"cert-manager-webhook-6486ffd997-fjjdf\" (UID: \"3845d2a8-ffcb-4520-af64-bd6f0cf5498d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.585214 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.585085 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3845d2a8-ffcb-4520-af64-bd6f0cf5498d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fjjdf\" (UID: \"3845d2a8-ffcb-4520-af64-bd6f0cf5498d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.705295 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.705263 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld"] Jul 05 11:59:04.708339 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:04.708313 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33025ff3_fba2_4b6a_b476_f2651bf180ca.slice/crio-1fcb9b5ab7942cf523c1d1fe23af5aa1e89abda37c77df5624762614ff1c2d3d WatchSource:0}: Error finding container 1fcb9b5ab7942cf523c1d1fe23af5aa1e89abda37c77df5624762614ff1c2d3d: Status 404 returned error can't find the container with id 1fcb9b5ab7942cf523c1d1fe23af5aa1e89abda37c77df5624762614ff1c2d3d Jul 05 11:59:04.752067 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.752031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:04.903501 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:04.903473 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fjjdf"] Jul 05 11:59:04.926939 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:04.926906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3845d2a8_ffcb_4520_af64_bd6f0cf5498d.slice/crio-7f55a84c90a548d4371db0522488c456d160876e6e33c2135483aec0e80abdfb WatchSource:0}: Error finding container 7f55a84c90a548d4371db0522488c456d160876e6e33c2135483aec0e80abdfb: Status 404 returned error can't find the container with id 7f55a84c90a548d4371db0522488c456d160876e6e33c2135483aec0e80abdfb Jul 05 11:59:05.105558 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:05.105525 2578 generic.go:356] "Generic (PLEG): container finished" podID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerID="36ddba8ff94b5c9baecb78ebfcc1956b754492284d9cb843fcfa8ec45f60533a" exitCode=0 Jul 05 11:59:05.105749 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:05.105609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" event={"ID":"33025ff3-fba2-4b6a-b476-f2651bf180ca","Type":"ContainerDied","Data":"36ddba8ff94b5c9baecb78ebfcc1956b754492284d9cb843fcfa8ec45f60533a"} Jul 05 11:59:05.105749 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:05.105660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" event={"ID":"33025ff3-fba2-4b6a-b476-f2651bf180ca","Type":"ContainerStarted","Data":"1fcb9b5ab7942cf523c1d1fe23af5aa1e89abda37c77df5624762614ff1c2d3d"} Jul 05 11:59:05.112170 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:05.112140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" event={"ID":"3845d2a8-ffcb-4520-af64-bd6f0cf5498d","Type":"ContainerStarted","Data":"7f55a84c90a548d4371db0522488c456d160876e6e33c2135483aec0e80abdfb"} Jul 05 11:59:08.654645 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.654609 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rdltj"] Jul 05 11:59:08.657772 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.657753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.660188 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.660168 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fjxm5\"" Jul 05 11:59:08.667072 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.667027 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rdltj"] Jul 05 11:59:08.713748 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.713709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qk6\" (UniqueName: \"kubernetes.io/projected/6a7b342e-f20d-45e0-818e-42c47a1ae318-kube-api-access-57qk6\") pod \"cert-manager-cainjector-559cdd8c87-rdltj\" (UID: \"6a7b342e-f20d-45e0-818e-42c47a1ae318\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.713930 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.713784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7b342e-f20d-45e0-818e-42c47a1ae318-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rdltj\" (UID: \"6a7b342e-f20d-45e0-818e-42c47a1ae318\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.814999 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.814965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7b342e-f20d-45e0-818e-42c47a1ae318-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rdltj\" (UID: \"6a7b342e-f20d-45e0-818e-42c47a1ae318\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.815191 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.815023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qk6\" (UniqueName: \"kubernetes.io/projected/6a7b342e-f20d-45e0-818e-42c47a1ae318-kube-api-access-57qk6\") pod \"cert-manager-cainjector-559cdd8c87-rdltj\" (UID: \"6a7b342e-f20d-45e0-818e-42c47a1ae318\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.822505 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.822472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7b342e-f20d-45e0-818e-42c47a1ae318-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rdltj\" (UID: \"6a7b342e-f20d-45e0-818e-42c47a1ae318\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.822695 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.822673 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qk6\" (UniqueName: \"kubernetes.io/projected/6a7b342e-f20d-45e0-818e-42c47a1ae318-kube-api-access-57qk6\") pod \"cert-manager-cainjector-559cdd8c87-rdltj\" (UID: \"6a7b342e-f20d-45e0-818e-42c47a1ae318\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:08.967261 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:08.967172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" Jul 05 11:59:09.097324 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.097285 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rdltj"] Jul 05 11:59:09.099755 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:09.099727 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a7b342e_f20d_45e0_818e_42c47a1ae318.slice/crio-68fdf2b488179967a832e1fd0f559d1680c7021d794598d948aa5cd1edccb4de WatchSource:0}: Error finding container 68fdf2b488179967a832e1fd0f559d1680c7021d794598d948aa5cd1edccb4de: Status 404 returned error can't find the container with id 68fdf2b488179967a832e1fd0f559d1680c7021d794598d948aa5cd1edccb4de Jul 05 11:59:09.132870 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.132834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" event={"ID":"6a7b342e-f20d-45e0-818e-42c47a1ae318","Type":"ContainerStarted","Data":"68fdf2b488179967a832e1fd0f559d1680c7021d794598d948aa5cd1edccb4de"} Jul 05 11:59:09.134659 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.134635 2578 generic.go:356] "Generic (PLEG): container finished" podID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerID="73badb53f1abafac04b266e0e4b7b9dd032e867284b404170d9abba38e87941f" exitCode=0 Jul 05 11:59:09.134807 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.134669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" event={"ID":"33025ff3-fba2-4b6a-b476-f2651bf180ca","Type":"ContainerDied","Data":"73badb53f1abafac04b266e0e4b7b9dd032e867284b404170d9abba38e87941f"} Jul 05 11:59:09.136207 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.136186 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" event={"ID":"3845d2a8-ffcb-4520-af64-bd6f0cf5498d","Type":"ContainerStarted","Data":"6aa997135c25c380dcccca07825c7ceaacdee0cf46fc504864c648fde389dfac"} Jul 05 11:59:09.136330 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.136318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:09.166757 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:09.166699 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" podStartSLOduration=1.7893256260000001 podStartE2EDuration="5.166677615s" totalImagesPullingTime="3.377351989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:59:09.16602598 +0000 UTC m=+327.904563515" watchObservedRunningTime="2026-07-05 11:59:09.166677615 +0000 UTC m=+327.905215133" Jul 05 11:59:10.142675 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:10.142648 2578 generic.go:356] "Generic (PLEG): container finished" podID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerID="1d85aa7adc21e267f3aa177be7a4995c155897dce876ed5b4792106fb7e153af" exitCode=0 Jul 05 11:59:10.143111 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:10.142735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" event={"ID":"33025ff3-fba2-4b6a-b476-f2651bf180ca","Type":"ContainerDied","Data":"1d85aa7adc21e267f3aa177be7a4995c155897dce876ed5b4792106fb7e153af"} Jul 05 11:59:10.144228 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:10.144198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" event={"ID":"6a7b342e-f20d-45e0-818e-42c47a1ae318","Type":"ContainerStarted","Data":"6025d1bf945d214f95d1c321e651a58785ca3bb791341508e8b9c1610a2adaa0"} Jul 05 11:59:10.171346 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:10.171295 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rdltj" podStartSLOduration=2.171272897 podStartE2EDuration="2.171272897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:59:10.170630853 +0000 UTC m=+328.909168383" watchObservedRunningTime="2026-07-05 11:59:10.171272897 +0000 UTC m=+328.909810415" Jul 05 11:59:11.275111 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.275087 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:11.335299 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.335267 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-util\") pod \"33025ff3-fba2-4b6a-b476-f2651bf180ca\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " Jul 05 11:59:11.335488 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.335314 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhhj5\" (UniqueName: \"kubernetes.io/projected/33025ff3-fba2-4b6a-b476-f2651bf180ca-kube-api-access-hhhj5\") pod \"33025ff3-fba2-4b6a-b476-f2651bf180ca\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " Jul 05 11:59:11.335488 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.335370 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-bundle\") pod \"33025ff3-fba2-4b6a-b476-f2651bf180ca\" (UID: \"33025ff3-fba2-4b6a-b476-f2651bf180ca\") " Jul 05 11:59:11.335757 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.335729 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-bundle" (OuterVolumeSpecName: "bundle") pod "33025ff3-fba2-4b6a-b476-f2651bf180ca" (UID: "33025ff3-fba2-4b6a-b476-f2651bf180ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:59:11.337533 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.337510 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33025ff3-fba2-4b6a-b476-f2651bf180ca-kube-api-access-hhhj5" (OuterVolumeSpecName: "kube-api-access-hhhj5") pod "33025ff3-fba2-4b6a-b476-f2651bf180ca" (UID: "33025ff3-fba2-4b6a-b476-f2651bf180ca"). InnerVolumeSpecName "kube-api-access-hhhj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:59:11.340342 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.340304 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-util" (OuterVolumeSpecName: "util") pod "33025ff3-fba2-4b6a-b476-f2651bf180ca" (UID: "33025ff3-fba2-4b6a-b476-f2651bf180ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:59:11.436114 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.435996 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:59:11.436114 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.436032 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhhj5\" (UniqueName: \"kubernetes.io/projected/33025ff3-fba2-4b6a-b476-f2651bf180ca-kube-api-access-hhhj5\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:59:11.436114 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:11.436071 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33025ff3-fba2-4b6a-b476-f2651bf180ca-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:59:12.154420 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:12.154390 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" Jul 05 11:59:12.154420 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:12.154413 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzkld" event={"ID":"33025ff3-fba2-4b6a-b476-f2651bf180ca","Type":"ContainerDied","Data":"1fcb9b5ab7942cf523c1d1fe23af5aa1e89abda37c77df5624762614ff1c2d3d"} Jul 05 11:59:12.154671 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:12.154453 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fcb9b5ab7942cf523c1d1fe23af5aa1e89abda37c77df5624762614ff1c2d3d" Jul 05 11:59:15.147071 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:15.147027 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fjjdf" Jul 05 11:59:17.744964 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.744933 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz"] Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745212 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="extract" Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745223 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="extract" Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745238 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="util" Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745243 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="util" Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745251 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="pull" Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745256 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="pull" Jul 05 11:59:17.745351 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.745309 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33025ff3-fba2-4b6a-b476-f2651bf180ca" containerName="extract" Jul 05 11:59:17.748822 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.748802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:17.751398 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.751372 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 05 11:59:17.751533 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.751453 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lsh4n\"" Jul 05 11:59:17.752321 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.752292 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 05 11:59:17.754220 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.754195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz"] Jul 05 11:59:17.789204 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.789170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2057fca0-a1f3-418b-bb20-ce8bada8412e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ct2mz\" (UID: \"2057fca0-a1f3-418b-bb20-ce8bada8412e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:17.789359 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.789228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fldd7\" (UniqueName: \"kubernetes.io/projected/2057fca0-a1f3-418b-bb20-ce8bada8412e-kube-api-access-fldd7\") pod \"openshift-lws-operator-fd8ccff4c-ct2mz\" (UID: \"2057fca0-a1f3-418b-bb20-ce8bada8412e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:17.890403 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.890367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2057fca0-a1f3-418b-bb20-ce8bada8412e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ct2mz\" (UID: \"2057fca0-a1f3-418b-bb20-ce8bada8412e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:17.890568 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.890428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fldd7\" (UniqueName: \"kubernetes.io/projected/2057fca0-a1f3-418b-bb20-ce8bada8412e-kube-api-access-fldd7\") pod \"openshift-lws-operator-fd8ccff4c-ct2mz\" (UID: \"2057fca0-a1f3-418b-bb20-ce8bada8412e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:17.890752 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.890732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2057fca0-a1f3-418b-bb20-ce8bada8412e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ct2mz\" (UID: \"2057fca0-a1f3-418b-bb20-ce8bada8412e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:17.899097 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:17.899068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fldd7\" (UniqueName: \"kubernetes.io/projected/2057fca0-a1f3-418b-bb20-ce8bada8412e-kube-api-access-fldd7\") pod \"openshift-lws-operator-fd8ccff4c-ct2mz\" (UID: \"2057fca0-a1f3-418b-bb20-ce8bada8412e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:18.059974 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:18.059881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" Jul 05 11:59:18.188665 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:18.188637 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz"] Jul 05 11:59:18.190970 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:18.190943 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2057fca0_a1f3_418b_bb20_ce8bada8412e.slice/crio-d55e5399f397d0513dd2b6b53b7de61ff7d7a924075808c8edbebec223a84025 WatchSource:0}: Error finding container d55e5399f397d0513dd2b6b53b7de61ff7d7a924075808c8edbebec223a84025: Status 404 returned error can't find the container with id d55e5399f397d0513dd2b6b53b7de61ff7d7a924075808c8edbebec223a84025 Jul 05 11:59:19.190393 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:19.190357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" event={"ID":"2057fca0-a1f3-418b-bb20-ce8bada8412e","Type":"ContainerStarted","Data":"d55e5399f397d0513dd2b6b53b7de61ff7d7a924075808c8edbebec223a84025"} Jul 05 11:59:21.200801 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:21.200757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" event={"ID":"2057fca0-a1f3-418b-bb20-ce8bada8412e","Type":"ContainerStarted","Data":"924f0ba1b1bdcf5eecdaa21f38f2be18b046f03538368543a38bc7e058658614"} Jul 05 11:59:21.216416 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:21.216367 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct2mz" podStartSLOduration=2.009726806 podStartE2EDuration="4.216351595s" totalImagesPullingTime="2.206624789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:59:21.215465476 +0000 UTC m=+339.954003013" watchObservedRunningTime="2026-07-05 11:59:21.216351595 +0000 UTC m=+339.954889113" Jul 05 11:59:23.776490 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.776457 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs"] Jul 05 11:59:23.779434 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.779418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.782062 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.782028 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 11:59:23.782918 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.782905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 11:59:23.782969 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.782943 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nqt26\"" Jul 05 11:59:23.787092 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.787070 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs"] Jul 05 11:59:23.843336 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.843290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.843336 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.843345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.843547 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.843410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4dm5\" (UniqueName: \"kubernetes.io/projected/765125b6-7eee-4128-9944-0bad1f2df186-kube-api-access-q4dm5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.944135 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.944103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.944296 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.944166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4dm5\" (UniqueName: \"kubernetes.io/projected/765125b6-7eee-4128-9944-0bad1f2df186-kube-api-access-q4dm5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.944296 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.944229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.944541 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.944520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.944582 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.944558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:23.951822 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:23.951797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4dm5\" (UniqueName: \"kubernetes.io/projected/765125b6-7eee-4128-9944-0bad1f2df186-kube-api-access-q4dm5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:24.089219 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:24.089193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:24.219102 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:24.219043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs"] Jul 05 11:59:24.221585 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:24.221555 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765125b6_7eee_4128_9944_0bad1f2df186.slice/crio-0c9a702dc7c281995a6afd8821ab2f5d1712881474c527aecb30f21a9a870fb6 WatchSource:0}: Error finding container 0c9a702dc7c281995a6afd8821ab2f5d1712881474c527aecb30f21a9a870fb6: Status 404 returned error can't find the container with id 0c9a702dc7c281995a6afd8821ab2f5d1712881474c527aecb30f21a9a870fb6 Jul 05 11:59:25.219091 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:25.218991 2578 generic.go:356] "Generic (PLEG): container finished" podID="765125b6-7eee-4128-9944-0bad1f2df186" containerID="26c75415f4e868adbb97a7a2797f17ef39b938e99fdb5de13a8dd0fa75ff0982" exitCode=0 Jul 05 11:59:25.219421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:25.219089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" event={"ID":"765125b6-7eee-4128-9944-0bad1f2df186","Type":"ContainerDied","Data":"26c75415f4e868adbb97a7a2797f17ef39b938e99fdb5de13a8dd0fa75ff0982"} Jul 05 11:59:25.219421 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:25.219136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" event={"ID":"765125b6-7eee-4128-9944-0bad1f2df186","Type":"ContainerStarted","Data":"0c9a702dc7c281995a6afd8821ab2f5d1712881474c527aecb30f21a9a870fb6"} Jul 05 11:59:26.225264 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:26.225232 2578 generic.go:356] "Generic (PLEG): container finished" podID="765125b6-7eee-4128-9944-0bad1f2df186" containerID="ac40966f95e55b73222255a5e2a97a58f6fe88e715e747d89ce83ce0f1333755" exitCode=0 Jul 05 11:59:26.225652 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:26.225327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" event={"ID":"765125b6-7eee-4128-9944-0bad1f2df186","Type":"ContainerDied","Data":"ac40966f95e55b73222255a5e2a97a58f6fe88e715e747d89ce83ce0f1333755"} Jul 05 11:59:27.232110 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:27.232075 2578 generic.go:356] "Generic (PLEG): container finished" podID="765125b6-7eee-4128-9944-0bad1f2df186" containerID="46539e78f81bfd9a0f3c6e2d3dfe320611426a76468c80f7b35fd35e2464cace" exitCode=0 Jul 05 11:59:27.232481 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:27.232161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" event={"ID":"765125b6-7eee-4128-9944-0bad1f2df186","Type":"ContainerDied","Data":"46539e78f81bfd9a0f3c6e2d3dfe320611426a76468c80f7b35fd35e2464cace"} Jul 05 11:59:28.365136 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.365115 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:28.480955 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.480924 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-bundle\") pod \"765125b6-7eee-4128-9944-0bad1f2df186\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " Jul 05 11:59:28.481121 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.480977 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-util\") pod \"765125b6-7eee-4128-9944-0bad1f2df186\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " Jul 05 11:59:28.481121 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.481005 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4dm5\" (UniqueName: \"kubernetes.io/projected/765125b6-7eee-4128-9944-0bad1f2df186-kube-api-access-q4dm5\") pod \"765125b6-7eee-4128-9944-0bad1f2df186\" (UID: \"765125b6-7eee-4128-9944-0bad1f2df186\") " Jul 05 11:59:28.481624 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.481596 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-bundle" (OuterVolumeSpecName: "bundle") pod "765125b6-7eee-4128-9944-0bad1f2df186" (UID: "765125b6-7eee-4128-9944-0bad1f2df186"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:59:28.483131 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.483101 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/765125b6-7eee-4128-9944-0bad1f2df186-kube-api-access-q4dm5" (OuterVolumeSpecName: "kube-api-access-q4dm5") pod "765125b6-7eee-4128-9944-0bad1f2df186" (UID: "765125b6-7eee-4128-9944-0bad1f2df186"). InnerVolumeSpecName "kube-api-access-q4dm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 11:59:28.489429 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.489360 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-util" (OuterVolumeSpecName: "util") pod "765125b6-7eee-4128-9944-0bad1f2df186" (UID: "765125b6-7eee-4128-9944-0bad1f2df186"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 11:59:28.581777 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.581739 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:59:28.581777 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.581767 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/765125b6-7eee-4128-9944-0bad1f2df186-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:59:28.581777 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:28.581776 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4dm5\" (UniqueName: \"kubernetes.io/projected/765125b6-7eee-4128-9944-0bad1f2df186-kube-api-access-q4dm5\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 11:59:29.242892 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:29.242852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" event={"ID":"765125b6-7eee-4128-9944-0bad1f2df186","Type":"ContainerDied","Data":"0c9a702dc7c281995a6afd8821ab2f5d1712881474c527aecb30f21a9a870fb6"} Jul 05 11:59:29.242892 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:29.242880 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg9kqs" Jul 05 11:59:29.242892 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:29.242902 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c9a702dc7c281995a6afd8821ab2f5d1712881474c527aecb30f21a9a870fb6" Jul 05 11:59:50.531681 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.531641 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58544b45f-crr2w"] Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.531987 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="extract" Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.532001 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="extract" Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.532012 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="util" Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.532018 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="util" Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.532034 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="pull" Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.532039 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="pull" Jul 05 11:59:50.532179 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.532110 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="765125b6-7eee-4128-9944-0bad1f2df186" containerName="extract" Jul 05 11:59:50.538959 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.538938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.542733 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.542700 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rnb7g\"" Jul 05 11:59:50.542879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.542739 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 05 11:59:50.542879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.542752 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 05 11:59:50.542879 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.542700 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 05 11:59:50.551640 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.551613 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58544b45f-crr2w"] Jul 05 11:59:50.569954 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.569926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-metrics-cert\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.570134 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.569978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-manager-config\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.570134 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.570099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-cert\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.570227 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.570147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbsjc\" (UniqueName: \"kubernetes.io/projected/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-kube-api-access-cbsjc\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.671572 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.671531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-cert\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.671770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.671597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbsjc\" (UniqueName: \"kubernetes.io/projected/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-kube-api-access-cbsjc\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.671770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.671633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-metrics-cert\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.671770 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.671676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-manager-config\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.672398 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.672372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-manager-config\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.674346 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.674322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-cert\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.674444 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.674362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-metrics-cert\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.679606 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.679586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbsjc\" (UniqueName: \"kubernetes.io/projected/e1560198-07fb-44fa-9ca3-57d8b8bb9bfd-kube-api-access-cbsjc\") pod \"lws-controller-manager-58544b45f-crr2w\" (UID: \"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd\") " pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.849003 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.848966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:50.993704 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:50.993678 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58544b45f-crr2w"] Jul 05 11:59:50.995780 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:50.995751 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1560198_07fb_44fa_9ca3_57d8b8bb9bfd.slice/crio-86f9e341dbe8be46e21d24e106c1ee91722adcb9d9c6b4e0c0f60a040aa8beea WatchSource:0}: Error finding container 86f9e341dbe8be46e21d24e106c1ee91722adcb9d9c6b4e0c0f60a040aa8beea: Status 404 returned error can't find the container with id 86f9e341dbe8be46e21d24e106c1ee91722adcb9d9c6b4e0c0f60a040aa8beea Jul 05 11:59:51.337586 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.337551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" event={"ID":"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd","Type":"ContainerStarted","Data":"86f9e341dbe8be46e21d24e106c1ee91722adcb9d9c6b4e0c0f60a040aa8beea"} Jul 05 11:59:51.681636 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.681549 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j"] Jul 05 11:59:51.685962 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.685942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.687997 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.687968 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 11:59:51.688244 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.688226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 11:59:51.688616 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.688601 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 11:59:51.688684 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.688606 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 11:59:51.688855 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.688843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ctxds\"" Jul 05 11:59:51.702656 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.702632 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j"] Jul 05 11:59:51.783254 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.783223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrz9\" (UniqueName: \"kubernetes.io/projected/d6c972bd-3dda-405f-b04f-6b5357d57a40-kube-api-access-qcrz9\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.783415 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.783302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6c972bd-3dda-405f-b04f-6b5357d57a40-manifests\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.783415 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.783328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6c972bd-3dda-405f-b04f-6b5357d57a40-tmp\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.783415 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.783369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6c972bd-3dda-405f-b04f-6b5357d57a40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.783415 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.783405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6c972bd-3dda-405f-b04f-6b5357d57a40-webhook-cert\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.884109 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.884077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6c972bd-3dda-405f-b04f-6b5357d57a40-webhook-cert\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.884285 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.884119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrz9\" (UniqueName: \"kubernetes.io/projected/d6c972bd-3dda-405f-b04f-6b5357d57a40-kube-api-access-qcrz9\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.884285 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.884196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6c972bd-3dda-405f-b04f-6b5357d57a40-manifests\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.884285 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.884230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6c972bd-3dda-405f-b04f-6b5357d57a40-tmp\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.884285 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.884276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6c972bd-3dda-405f-b04f-6b5357d57a40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.884725 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.884687 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6c972bd-3dda-405f-b04f-6b5357d57a40-manifests\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.886758 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.886715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6c972bd-3dda-405f-b04f-6b5357d57a40-webhook-cert\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.886884 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.886831 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6c972bd-3dda-405f-b04f-6b5357d57a40-tmp\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.887042 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.887022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6c972bd-3dda-405f-b04f-6b5357d57a40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.899368 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.899345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrz9\" (UniqueName: \"kubernetes.io/projected/d6c972bd-3dda-405f-b04f-6b5357d57a40-kube-api-access-qcrz9\") pod \"opendatahub-operator-controller-manager-59595c8d98-7jd7j\" (UID: \"d6c972bd-3dda-405f-b04f-6b5357d57a40\") " pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:51.997452 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:51.997375 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:52.160184 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:52.160153 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j"] Jul 05 11:59:52.164307 ip-10-0-136-198 kubenswrapper[2578]: W0705 11:59:52.164276 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c972bd_3dda_405f_b04f_6b5357d57a40.slice/crio-91ac3e789e6a21e69f326a7bfe7532e47c54b840748d9808b95334c8b55ca08c WatchSource:0}: Error finding container 91ac3e789e6a21e69f326a7bfe7532e47c54b840748d9808b95334c8b55ca08c: Status 404 returned error can't find the container with id 91ac3e789e6a21e69f326a7bfe7532e47c54b840748d9808b95334c8b55ca08c Jul 05 11:59:52.343536 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:52.343508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" event={"ID":"d6c972bd-3dda-405f-b04f-6b5357d57a40","Type":"ContainerStarted","Data":"91ac3e789e6a21e69f326a7bfe7532e47c54b840748d9808b95334c8b55ca08c"} Jul 05 11:59:53.351044 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:53.351010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" event={"ID":"e1560198-07fb-44fa-9ca3-57d8b8bb9bfd","Type":"ContainerStarted","Data":"eb2f54ea0459558d56d72e7af9944f52cb14f8eaa937739e0ce72cd69949fb45"} Jul 05 11:59:53.351527 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:53.351284 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 11:59:53.368743 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:53.368688 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" podStartSLOduration=1.6419952389999999 podStartE2EDuration="3.368669532s" totalImagesPullingTime="1.726674293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:59:53.367700801 +0000 UTC m=+372.106238344" watchObservedRunningTime="2026-07-05 11:59:53.368669532 +0000 UTC m=+372.107207050" Jul 05 11:59:55.363594 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:55.363561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" event={"ID":"d6c972bd-3dda-405f-b04f-6b5357d57a40","Type":"ContainerStarted","Data":"90618ab27f7855dc51d028fe91224be5be4db83181be8b4c2e3aad4b2c22d431"} Jul 05 11:59:56.369297 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:56.369267 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6c972bd-3dda-405f-b04f-6b5357d57a40" containerID="90618ab27f7855dc51d028fe91224be5be4db83181be8b4c2e3aad4b2c22d431" exitCode=0 Jul 05 11:59:56.369795 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:56.369355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" event={"ID":"d6c972bd-3dda-405f-b04f-6b5357d57a40","Type":"ContainerDied","Data":"90618ab27f7855dc51d028fe91224be5be4db83181be8b4c2e3aad4b2c22d431"} Jul 05 11:59:57.376457 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:57.376423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" event={"ID":"d6c972bd-3dda-405f-b04f-6b5357d57a40","Type":"ContainerStarted","Data":"bc6722075da6c261ea03f0e5dbf2f697e13867b4a6f94006d750b4ccbbafe9d2"} Jul 05 11:59:57.376945 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:57.376546 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 11:59:57.397508 ip-10-0-136-198 kubenswrapper[2578]: I0705 11:59:57.397458 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" podStartSLOduration=1.856343047 podStartE2EDuration="6.39743778s" totalImagesPullingTime="3.445639736s" totalInitContainerRuntime="1.095454997s" isStatefulPod=false podCreationTimestamp="2026-07-05 11:59:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 11:59:57.396064587 +0000 UTC m=+376.134602123" watchObservedRunningTime="2026-07-05 11:59:57.39743778 +0000 UTC m=+376.135975297" Jul 05 12:00:04.360002 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:04.359975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58544b45f-crr2w" Jul 05 12:00:08.382783 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:08.382754 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59595c8d98-7jd7j" Jul 05 12:00:12.163533 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.163495 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lltrc"] Jul 05 12:00:12.166859 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.166843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.169655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.169617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fkncf\"" Jul 05 12:00:12.169655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.169626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 05 12:00:12.178266 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.178242 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lltrc"] Jul 05 12:00:12.269198 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.269159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtfz\" (UniqueName: \"kubernetes.io/projected/cd048157-1c2b-4ae5-accd-4ea2d6cb2621-kube-api-access-hhtfz\") pod \"odh-model-controller-7998c67dc4-lltrc\" (UID: \"cd048157-1c2b-4ae5-accd-4ea2d6cb2621\") " pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.269365 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.269217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd048157-1c2b-4ae5-accd-4ea2d6cb2621-cert\") pod \"odh-model-controller-7998c67dc4-lltrc\" (UID: \"cd048157-1c2b-4ae5-accd-4ea2d6cb2621\") " pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.370153 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.370118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtfz\" (UniqueName: \"kubernetes.io/projected/cd048157-1c2b-4ae5-accd-4ea2d6cb2621-kube-api-access-hhtfz\") pod \"odh-model-controller-7998c67dc4-lltrc\" (UID: \"cd048157-1c2b-4ae5-accd-4ea2d6cb2621\") " pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.370345 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.370176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd048157-1c2b-4ae5-accd-4ea2d6cb2621-cert\") pod \"odh-model-controller-7998c67dc4-lltrc\" (UID: \"cd048157-1c2b-4ae5-accd-4ea2d6cb2621\") " pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.372652 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.372628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd048157-1c2b-4ae5-accd-4ea2d6cb2621-cert\") pod \"odh-model-controller-7998c67dc4-lltrc\" (UID: \"cd048157-1c2b-4ae5-accd-4ea2d6cb2621\") " pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.391406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.391378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtfz\" (UniqueName: \"kubernetes.io/projected/cd048157-1c2b-4ae5-accd-4ea2d6cb2621-kube-api-access-hhtfz\") pod \"odh-model-controller-7998c67dc4-lltrc\" (UID: \"cd048157-1c2b-4ae5-accd-4ea2d6cb2621\") " pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.479411 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.479327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:12.624570 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:12.624544 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lltrc"] Jul 05 12:00:12.626290 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:00:12.626256 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd048157_1c2b_4ae5_accd_4ea2d6cb2621.slice/crio-54a8f415a1d6a48cdc761246e640bfdb034ab5338bf280ce90f32d0eaef55a0b WatchSource:0}: Error finding container 54a8f415a1d6a48cdc761246e640bfdb034ab5338bf280ce90f32d0eaef55a0b: Status 404 returned error can't find the container with id 54a8f415a1d6a48cdc761246e640bfdb034ab5338bf280ce90f32d0eaef55a0b Jul 05 12:00:13.453530 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:13.453451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" event={"ID":"cd048157-1c2b-4ae5-accd-4ea2d6cb2621","Type":"ContainerStarted","Data":"54a8f415a1d6a48cdc761246e640bfdb034ab5338bf280ce90f32d0eaef55a0b"} Jul 05 12:00:16.471811 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:16.471774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" event={"ID":"cd048157-1c2b-4ae5-accd-4ea2d6cb2621","Type":"ContainerStarted","Data":"802d03173da4f534b78687b6ea62718c2f0a40b85fffe37ca7e15d15123cfa89"} Jul 05 12:00:16.472254 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:16.471906 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:16.485965 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:16.485918 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" podStartSLOduration=1.447029296 podStartE2EDuration="4.485901645s" totalImagesPullingTime="3.038872349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:00:16.485356442 +0000 UTC m=+395.223893961" watchObservedRunningTime="2026-07-05 12:00:16.485901645 +0000 UTC m=+395.224439186" Jul 05 12:00:20.083156 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.083119 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7"] Jul 05 12:00:20.086692 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.086674 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.089008 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.088989 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 12:00:20.089268 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.089247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 12:00:20.089268 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.089263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w27d9\"" Jul 05 12:00:20.089450 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.089257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 12:00:20.089450 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.089299 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 12:00:20.089450 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.089319 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 12:00:20.089450 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.089250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 12:00:20.098944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.098920 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7"] Jul 05 12:00:20.246724 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.246678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.246900 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.246793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65bb\" (UniqueName: \"kubernetes.io/projected/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-kube-api-access-q65bb\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.246900 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.246845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.246900 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.246884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.247004 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.246969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.247038 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.247012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.247104 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.247058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.347940 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.347910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65bb\" (UniqueName: \"kubernetes.io/projected/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-kube-api-access-q65bb\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348226 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.347959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348226 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.347983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348226 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.348004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348226 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.348180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348226 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.348220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348516 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.348267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.348862 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.348840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.350419 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.350398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.350492 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.350464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.350750 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.350729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.350849 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.350830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.363427 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.363398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.363694 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.363678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65bb\" (UniqueName: \"kubernetes.io/projected/ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede-kube-api-access-q65bb\") pod \"istiod-openshift-gateway-94bb8fbfd-79nb7\" (UID: \"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.397770 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.397730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:20.561211 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:20.561187 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7"] Jul 05 12:00:20.563308 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:00:20.563278 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9c0ccb_92bd_4d3c_9a9c_6c839f713ede.slice/crio-e37fcf1d12975013078fac4a172b84e6f93b7e23be9f83c9c24dc386fa4721df WatchSource:0}: Error finding container e37fcf1d12975013078fac4a172b84e6f93b7e23be9f83c9c24dc386fa4721df: Status 404 returned error can't find the container with id e37fcf1d12975013078fac4a172b84e6f93b7e23be9f83c9c24dc386fa4721df Jul 05 12:00:21.509427 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:21.509393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" event={"ID":"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede","Type":"ContainerStarted","Data":"e37fcf1d12975013078fac4a172b84e6f93b7e23be9f83c9c24dc386fa4721df"} Jul 05 12:00:24.437827 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:24.437790 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:00:24.438132 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:24.437858 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:00:24.525715 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:24.525686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" event={"ID":"ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede","Type":"ContainerStarted","Data":"a483bc7e1ee0e6eada9db1dc85ee2c260a676f3df4ccfb0491a167252d80493d"} Jul 05 12:00:24.525893 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:24.525819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:24.546545 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:24.546494 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" podStartSLOduration=0.674595294 podStartE2EDuration="4.546477718s" totalImagesPullingTime="3.871882424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:00:24.544464362 +0000 UTC m=+403.283001879" watchObservedRunningTime="2026-07-05 12:00:24.546477718 +0000 UTC m=+403.285015234" Jul 05 12:00:25.533641 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.533594 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-79nb7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 12:00:25.534132 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.533671 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" podUID="ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 12:00:25.730698 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.730662 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx"] Jul 05 12:00:25.733964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.733940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.736357 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.736332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d9xsq\"" Jul 05 12:00:25.748748 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.748724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx"] Jul 05 12:00:25.903454 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903454 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d260d89-884b-4d59-a784-2dcc46f30845-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903665 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqc7s\" (UniqueName: \"kubernetes.io/projected/8d260d89-884b-4d59-a784-2dcc46f30845-kube-api-access-qqc7s\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903665 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903665 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903665 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d260d89-884b-4d59-a784-2dcc46f30845-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903806 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903806 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d260d89-884b-4d59-a784-2dcc46f30845-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:25.903806 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:25.903787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004287 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d260d89-884b-4d59-a784-2dcc46f30845-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004465 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004465 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004465 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d260d89-884b-4d59-a784-2dcc46f30845-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004465 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqc7s\" (UniqueName: \"kubernetes.io/projected/8d260d89-884b-4d59-a784-2dcc46f30845-kube-api-access-qqc7s\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004465 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d260d89-884b-4d59-a784-2dcc46f30845-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004911 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004884 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.004985 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004922 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.005043 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.004986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.005043 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.005002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.005485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.005462 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d260d89-884b-4d59-a784-2dcc46f30845-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.006795 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.006775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d260d89-884b-4d59-a784-2dcc46f30845-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.007080 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.007043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d260d89-884b-4d59-a784-2dcc46f30845-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.012556 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.012527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d260d89-884b-4d59-a784-2dcc46f30845-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.012866 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.012850 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqc7s\" (UniqueName: \"kubernetes.io/projected/8d260d89-884b-4d59-a784-2dcc46f30845-kube-api-access-qqc7s\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785v6sx\" (UID: \"8d260d89-884b-4d59-a784-2dcc46f30845\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.047503 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.047469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:26.206034 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.205952 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx"] Jul 05 12:00:26.208834 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:00:26.208788 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d260d89_884b_4d59_a784_2dcc46f30845.slice/crio-f417e78daaedf5dd77496318a2bcb62fc26ec6cfae8fb3c990d86fc9b9eec9e6 WatchSource:0}: Error finding container f417e78daaedf5dd77496318a2bcb62fc26ec6cfae8fb3c990d86fc9b9eec9e6: Status 404 returned error can't find the container with id f417e78daaedf5dd77496318a2bcb62fc26ec6cfae8fb3c990d86fc9b9eec9e6 Jul 05 12:00:26.536676 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:26.536589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" event={"ID":"8d260d89-884b-4d59-a784-2dcc46f30845","Type":"ContainerStarted","Data":"f417e78daaedf5dd77496318a2bcb62fc26ec6cfae8fb3c990d86fc9b9eec9e6"} Jul 05 12:00:27.479150 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:27.479120 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lltrc" Jul 05 12:00:28.533254 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:28.533211 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-79nb7" Jul 05 12:00:29.065408 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:29.065376 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:00:29.065495 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:29.065453 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:00:29.065495 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:29.065482 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:00:29.556733 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:29.556699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" event={"ID":"8d260d89-884b-4d59-a784-2dcc46f30845","Type":"ContainerStarted","Data":"8fb23c02ce13ca1fc5a1acec56f4ef309306cd600d35537f86a388a0fdc09875"} Jul 05 12:00:29.576805 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:29.576737 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" podStartSLOduration=1.722931702 podStartE2EDuration="4.576722549s" totalImagesPullingTime="2.853790847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:00:29.574396765 +0000 UTC m=+408.312934285" watchObservedRunningTime="2026-07-05 12:00:29.576722549 +0000 UTC m=+408.315260065" Jul 05 12:00:30.047797 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:30.047763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:30.052501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:30.052480 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:30.563432 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:30.563402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:00:30.564414 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:00:30.564389 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785v6sx" Jul 05 12:01:28.290799 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.290769 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69bcf68df8-zs9qp"] Jul 05 12:01:28.678961 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.678927 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6"] Jul 05 12:01:28.682416 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.682398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.684655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.684630 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 12:01:28.684794 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.684675 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r5gq7\"" Jul 05 12:01:28.684794 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.684769 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 12:01:28.688568 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.688544 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6"] Jul 05 12:01:28.750371 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.750330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.750371 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.750373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.750608 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.750524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f5rw\" (UniqueName: \"kubernetes.io/projected/f463373b-8dc3-4eaa-89a3-9406c262d290-kube-api-access-6f5rw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.851664 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.851629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f5rw\" (UniqueName: \"kubernetes.io/projected/f463373b-8dc3-4eaa-89a3-9406c262d290-kube-api-access-6f5rw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.851855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.851691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.851855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.851718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.852124 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.852102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.852208 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.852140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.859038 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.859015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f5rw\" (UniqueName: \"kubernetes.io/projected/f463373b-8dc3-4eaa-89a3-9406c262d290-kube-api-access-6f5rw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:28.993554 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:28.993469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:29.127567 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.127543 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6"] Jul 05 12:01:29.129384 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:01:29.129348 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf463373b_8dc3_4eaa_89a3_9406c262d290.slice/crio-eb2ded0dccca6cd96d9cca2a7c3c2113be85317448f6039aeb093cd9883f4211 WatchSource:0}: Error finding container eb2ded0dccca6cd96d9cca2a7c3c2113be85317448f6039aeb093cd9883f4211: Status 404 returned error can't find the container with id eb2ded0dccca6cd96d9cca2a7c3c2113be85317448f6039aeb093cd9883f4211 Jul 05 12:01:29.275203 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.275126 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89"] Jul 05 12:01:29.278889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.278869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.287621 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.287599 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89"] Jul 05 12:01:29.355408 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.355368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwvq\" (UniqueName: \"kubernetes.io/projected/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-kube-api-access-7vwvq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.355408 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.355410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.355812 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.355437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.456705 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.456670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwvq\" (UniqueName: \"kubernetes.io/projected/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-kube-api-access-7vwvq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.456705 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.456707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.456936 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.456822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.457098 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.457080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.457200 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.457183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.463848 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.463822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwvq\" (UniqueName: \"kubernetes.io/projected/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-kube-api-access-7vwvq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.589374 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.589344 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:29.677270 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.677238 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl"] Jul 05 12:01:29.681611 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.681588 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.686734 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.686672 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl"] Jul 05 12:01:29.726168 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.726143 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89"] Jul 05 12:01:29.728025 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:01:29.727991 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec4ff13_5283_4bfc_8c52_acbbe3a3cfd8.slice/crio-a1c4d2c9da0b5bee6e041e9d7f67e7fc6913c9c2cee256d4addc83133c096eef WatchSource:0}: Error finding container a1c4d2c9da0b5bee6e041e9d7f67e7fc6913c9c2cee256d4addc83133c096eef: Status 404 returned error can't find the container with id a1c4d2c9da0b5bee6e041e9d7f67e7fc6913c9c2cee256d4addc83133c096eef Jul 05 12:01:29.760071 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.760019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.760192 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.760082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.760253 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.760240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nqq9\" (UniqueName: \"kubernetes.io/projected/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-kube-api-access-7nqq9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.846815 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.846745 2578 generic.go:356] "Generic (PLEG): container finished" podID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerID="59ea759b80fc982ba8ee4917eace619494bb0c5af4383f073fd654cf3d746654" exitCode=0 Jul 05 12:01:29.846944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.846834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" event={"ID":"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8","Type":"ContainerDied","Data":"59ea759b80fc982ba8ee4917eace619494bb0c5af4383f073fd654cf3d746654"} Jul 05 12:01:29.846944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.846884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" event={"ID":"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8","Type":"ContainerStarted","Data":"a1c4d2c9da0b5bee6e041e9d7f67e7fc6913c9c2cee256d4addc83133c096eef"} Jul 05 12:01:29.848384 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.848361 2578 generic.go:356] "Generic (PLEG): container finished" podID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerID="1e3f9381385ba3c9ae5ecf1f028883c2f3e433edbe4e22f78aa9836c2bca8ed3" exitCode=0 Jul 05 12:01:29.848384 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.848393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" event={"ID":"f463373b-8dc3-4eaa-89a3-9406c262d290","Type":"ContainerDied","Data":"1e3f9381385ba3c9ae5ecf1f028883c2f3e433edbe4e22f78aa9836c2bca8ed3"} Jul 05 12:01:29.848531 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.848422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" event={"ID":"f463373b-8dc3-4eaa-89a3-9406c262d290","Type":"ContainerStarted","Data":"eb2ded0dccca6cd96d9cca2a7c3c2113be85317448f6039aeb093cd9883f4211"} Jul 05 12:01:29.861756 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.861730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.861949 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.861773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.861949 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.861881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nqq9\" (UniqueName: \"kubernetes.io/projected/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-kube-api-access-7nqq9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.862259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.862240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.862259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.862249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.868664 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.868641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nqq9\" (UniqueName: \"kubernetes.io/projected/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-kube-api-access-7nqq9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:29.993994 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:29.993958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:30.078023 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.077991 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz"] Jul 05 12:01:30.082198 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.082168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.090360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.090292 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz"] Jul 05 12:01:30.126613 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.126528 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl"] Jul 05 12:01:30.129306 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:01:30.129276 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdea1d1_0808_42a4_b498_b9f9ca49c2de.slice/crio-cc5bf4e69e97c1a37f3be95981d0e3a060f8dfe3dc4ef9b0a6e1c1342eba9ee2 WatchSource:0}: Error finding container cc5bf4e69e97c1a37f3be95981d0e3a060f8dfe3dc4ef9b0a6e1c1342eba9ee2: Status 404 returned error can't find the container with id cc5bf4e69e97c1a37f3be95981d0e3a060f8dfe3dc4ef9b0a6e1c1342eba9ee2 Jul 05 12:01:30.164355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.164326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.164498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.164388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.164498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.164474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd67q\" (UniqueName: \"kubernetes.io/projected/aad828e8-a770-4e3d-a3f1-d5c4f690a772-kube-api-access-qd67q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.265234 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.265195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.265374 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.265265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.265374 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.265306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd67q\" (UniqueName: \"kubernetes.io/projected/aad828e8-a770-4e3d-a3f1-d5c4f690a772-kube-api-access-qd67q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.265603 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.265581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.265687 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.265612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.273398 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.273371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd67q\" (UniqueName: \"kubernetes.io/projected/aad828e8-a770-4e3d-a3f1-d5c4f690a772-kube-api-access-qd67q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.393707 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.393629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:30.556194 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.556171 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz"] Jul 05 12:01:30.651276 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:01:30.651212 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad828e8_a770_4e3d_a3f1_d5c4f690a772.slice/crio-4d2f3d14ff83968c8c885759a67e9836ad8c592acc0d2de9845c8f4c0d456dde WatchSource:0}: Error finding container 4d2f3d14ff83968c8c885759a67e9836ad8c592acc0d2de9845c8f4c0d456dde: Status 404 returned error can't find the container with id 4d2f3d14ff83968c8c885759a67e9836ad8c592acc0d2de9845c8f4c0d456dde Jul 05 12:01:30.855148 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.855117 2578 generic.go:356] "Generic (PLEG): container finished" podID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerID="23b1bab7a562f2dd7e611c777c28c3e0cc6eec5eaa524f91114f705cb3c99884" exitCode=0 Jul 05 12:01:30.855353 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.855197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" event={"ID":"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8","Type":"ContainerDied","Data":"23b1bab7a562f2dd7e611c777c28c3e0cc6eec5eaa524f91114f705cb3c99884"} Jul 05 12:01:30.856732 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.856658 2578 generic.go:356] "Generic (PLEG): container finished" podID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerID="253157991b4652bfd75910fd928d63f8340e477ad38f6166ede7dea36cc1fba0" exitCode=0 Jul 05 12:01:30.856834 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.856742 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" event={"ID":"aad828e8-a770-4e3d-a3f1-d5c4f690a772","Type":"ContainerDied","Data":"253157991b4652bfd75910fd928d63f8340e477ad38f6166ede7dea36cc1fba0"} Jul 05 12:01:30.856834 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.856797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" event={"ID":"aad828e8-a770-4e3d-a3f1-d5c4f690a772","Type":"ContainerStarted","Data":"4d2f3d14ff83968c8c885759a67e9836ad8c592acc0d2de9845c8f4c0d456dde"} Jul 05 12:01:30.858323 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.858290 2578 generic.go:356] "Generic (PLEG): container finished" podID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerID="c47b7ac0e1d8aad255aaaa18731213a953dd82481a15067cfcc56b02720791f5" exitCode=0 Jul 05 12:01:30.858430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.858371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" event={"ID":"1cdea1d1-0808-42a4-b498-b9f9ca49c2de","Type":"ContainerDied","Data":"c47b7ac0e1d8aad255aaaa18731213a953dd82481a15067cfcc56b02720791f5"} Jul 05 12:01:30.858430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.858415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" event={"ID":"1cdea1d1-0808-42a4-b498-b9f9ca49c2de","Type":"ContainerStarted","Data":"cc5bf4e69e97c1a37f3be95981d0e3a060f8dfe3dc4ef9b0a6e1c1342eba9ee2"} Jul 05 12:01:30.860385 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.860345 2578 generic.go:356] "Generic (PLEG): container finished" podID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerID="53c12c37c7c9fde9e2617e96090619eb2e87c01c4af7146212d4d944eea41961" exitCode=0 Jul 05 12:01:30.860385 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:30.860378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" event={"ID":"f463373b-8dc3-4eaa-89a3-9406c262d290","Type":"ContainerDied","Data":"53c12c37c7c9fde9e2617e96090619eb2e87c01c4af7146212d4d944eea41961"} Jul 05 12:01:31.867960 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:31.867930 2578 generic.go:356] "Generic (PLEG): container finished" podID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerID="6bb651b6b81cb754578a58f2d0c30d41afdd09092d85493d1e6cc72ed6a5db48" exitCode=0 Jul 05 12:01:31.868403 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:31.868011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" event={"ID":"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8","Type":"ContainerDied","Data":"6bb651b6b81cb754578a58f2d0c30d41afdd09092d85493d1e6cc72ed6a5db48"} Jul 05 12:01:31.870178 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:31.870154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" event={"ID":"1cdea1d1-0808-42a4-b498-b9f9ca49c2de","Type":"ContainerStarted","Data":"4aab592abead02d81cd8e45e346318908ab350925d06774318e75e71b343cc1f"} Jul 05 12:01:31.872190 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:31.872168 2578 generic.go:356] "Generic (PLEG): container finished" podID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerID="efae11faceb13569c0b3a65039f4ea2fae2f5e13b6be06660bbddb214137a8a6" exitCode=0 Jul 05 12:01:31.872283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:31.872199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" event={"ID":"f463373b-8dc3-4eaa-89a3-9406c262d290","Type":"ContainerDied","Data":"efae11faceb13569c0b3a65039f4ea2fae2f5e13b6be06660bbddb214137a8a6"} Jul 05 12:01:32.880290 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:32.880256 2578 generic.go:356] "Generic (PLEG): container finished" podID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerID="228afd07dc8ee8a610e0c285ae94b1d1f09e990833f9b1453838d98807d0d5b5" exitCode=0 Jul 05 12:01:32.880735 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:32.880332 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" event={"ID":"aad828e8-a770-4e3d-a3f1-d5c4f690a772","Type":"ContainerDied","Data":"228afd07dc8ee8a610e0c285ae94b1d1f09e990833f9b1453838d98807d0d5b5"} Jul 05 12:01:32.882275 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:32.882256 2578 generic.go:356] "Generic (PLEG): container finished" podID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerID="4aab592abead02d81cd8e45e346318908ab350925d06774318e75e71b343cc1f" exitCode=0 Jul 05 12:01:32.882419 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:32.882391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" event={"ID":"1cdea1d1-0808-42a4-b498-b9f9ca49c2de","Type":"ContainerDied","Data":"4aab592abead02d81cd8e45e346318908ab350925d06774318e75e71b343cc1f"} Jul 05 12:01:33.030362 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.030335 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:33.090104 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.090069 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f5rw\" (UniqueName: \"kubernetes.io/projected/f463373b-8dc3-4eaa-89a3-9406c262d290-kube-api-access-6f5rw\") pod \"f463373b-8dc3-4eaa-89a3-9406c262d290\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " Jul 05 12:01:33.090278 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.090143 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-util\") pod \"f463373b-8dc3-4eaa-89a3-9406c262d290\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " Jul 05 12:01:33.090278 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.090184 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-bundle\") pod \"f463373b-8dc3-4eaa-89a3-9406c262d290\" (UID: \"f463373b-8dc3-4eaa-89a3-9406c262d290\") " Jul 05 12:01:33.090677 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.090654 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-bundle" (OuterVolumeSpecName: "bundle") pod "f463373b-8dc3-4eaa-89a3-9406c262d290" (UID: "f463373b-8dc3-4eaa-89a3-9406c262d290"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:33.092109 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.092087 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f463373b-8dc3-4eaa-89a3-9406c262d290-kube-api-access-6f5rw" (OuterVolumeSpecName: "kube-api-access-6f5rw") pod "f463373b-8dc3-4eaa-89a3-9406c262d290" (UID: "f463373b-8dc3-4eaa-89a3-9406c262d290"). InnerVolumeSpecName "kube-api-access-6f5rw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:01:33.095018 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.094984 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-util" (OuterVolumeSpecName: "util") pod "f463373b-8dc3-4eaa-89a3-9406c262d290" (UID: "f463373b-8dc3-4eaa-89a3-9406c262d290"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:33.163847 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.163786 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:33.191056 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191028 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vwvq\" (UniqueName: \"kubernetes.io/projected/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-kube-api-access-7vwvq\") pod \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " Jul 05 12:01:33.191198 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191120 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-bundle\") pod \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " Jul 05 12:01:33.191198 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191155 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-util\") pod \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\" (UID: \"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8\") " Jul 05 12:01:33.191430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191405 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f5rw\" (UniqueName: \"kubernetes.io/projected/f463373b-8dc3-4eaa-89a3-9406c262d290-kube-api-access-6f5rw\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:33.191430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191432 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:33.191566 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191446 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f463373b-8dc3-4eaa-89a3-9406c262d290-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:33.191640 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.191619 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-bundle" (OuterVolumeSpecName: "bundle") pod "4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" (UID: "4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:33.193239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.193216 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-kube-api-access-7vwvq" (OuterVolumeSpecName: "kube-api-access-7vwvq") pod "4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" (UID: "4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8"). InnerVolumeSpecName "kube-api-access-7vwvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:01:33.196205 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.196179 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-util" (OuterVolumeSpecName: "util") pod "4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" (UID: "4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:33.292435 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.292401 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:33.292435 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.292430 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:33.292435 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.292438 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vwvq\" (UniqueName: \"kubernetes.io/projected/4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8-kube-api-access-7vwvq\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:33.889146 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.889116 2578 generic.go:356] "Generic (PLEG): container finished" podID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerID="72fefa868a6020abd53f66cedaf53925c78eba04ea4fb0db875791f18fa5bb91" exitCode=0 Jul 05 12:01:33.889614 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.889180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" event={"ID":"aad828e8-a770-4e3d-a3f1-d5c4f690a772","Type":"ContainerDied","Data":"72fefa868a6020abd53f66cedaf53925c78eba04ea4fb0db875791f18fa5bb91"} Jul 05 12:01:33.891244 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.891223 2578 generic.go:356] "Generic (PLEG): container finished" podID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerID="102085b2cfd3bf7e434cc324fc4faa5c229a60b29e23ec7c639d7524b0f76d44" exitCode=0 Jul 05 12:01:33.891371 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.891291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" event={"ID":"1cdea1d1-0808-42a4-b498-b9f9ca49c2de","Type":"ContainerDied","Data":"102085b2cfd3bf7e434cc324fc4faa5c229a60b29e23ec7c639d7524b0f76d44"} Jul 05 12:01:33.893099 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.893075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" event={"ID":"f463373b-8dc3-4eaa-89a3-9406c262d290","Type":"ContainerDied","Data":"eb2ded0dccca6cd96d9cca2a7c3c2113be85317448f6039aeb093cd9883f4211"} Jul 05 12:01:33.893186 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.893088 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6" Jul 05 12:01:33.893186 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.893112 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb2ded0dccca6cd96d9cca2a7c3c2113be85317448f6039aeb093cd9883f4211" Jul 05 12:01:33.894994 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.894972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" event={"ID":"4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8","Type":"ContainerDied","Data":"a1c4d2c9da0b5bee6e041e9d7f67e7fc6913c9c2cee256d4addc83133c096eef"} Jul 05 12:01:33.894994 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.894986 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89" Jul 05 12:01:33.895170 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:33.895012 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1c4d2c9da0b5bee6e041e9d7f67e7fc6913c9c2cee256d4addc83133c096eef" Jul 05 12:01:35.032877 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.032851 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:35.067497 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.067476 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:35.110137 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110102 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-bundle\") pod \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " Jul 05 12:01:35.110301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110206 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd67q\" (UniqueName: \"kubernetes.io/projected/aad828e8-a770-4e3d-a3f1-d5c4f690a772-kube-api-access-qd67q\") pod \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " Jul 05 12:01:35.110301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110250 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-util\") pod \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\" (UID: \"aad828e8-a770-4e3d-a3f1-d5c4f690a772\") " Jul 05 12:01:35.110301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110276 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-bundle\") pod \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " Jul 05 12:01:35.110436 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110411 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nqq9\" (UniqueName: \"kubernetes.io/projected/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-kube-api-access-7nqq9\") pod \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " Jul 05 12:01:35.110506 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110491 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-util\") pod \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\" (UID: \"1cdea1d1-0808-42a4-b498-b9f9ca49c2de\") " Jul 05 12:01:35.110644 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.110620 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-bundle" (OuterVolumeSpecName: "bundle") pod "aad828e8-a770-4e3d-a3f1-d5c4f690a772" (UID: "aad828e8-a770-4e3d-a3f1-d5c4f690a772"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:35.111138 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.111113 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-bundle" (OuterVolumeSpecName: "bundle") pod "1cdea1d1-0808-42a4-b498-b9f9ca49c2de" (UID: "1cdea1d1-0808-42a4-b498-b9f9ca49c2de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:35.112426 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.112396 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad828e8-a770-4e3d-a3f1-d5c4f690a772-kube-api-access-qd67q" (OuterVolumeSpecName: "kube-api-access-qd67q") pod "aad828e8-a770-4e3d-a3f1-d5c4f690a772" (UID: "aad828e8-a770-4e3d-a3f1-d5c4f690a772"). InnerVolumeSpecName "kube-api-access-qd67q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:01:35.112862 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.112834 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-kube-api-access-7nqq9" (OuterVolumeSpecName: "kube-api-access-7nqq9") pod "1cdea1d1-0808-42a4-b498-b9f9ca49c2de" (UID: "1cdea1d1-0808-42a4-b498-b9f9ca49c2de"). InnerVolumeSpecName "kube-api-access-7nqq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:01:35.115803 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.115781 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-util" (OuterVolumeSpecName: "util") pod "aad828e8-a770-4e3d-a3f1-d5c4f690a772" (UID: "aad828e8-a770-4e3d-a3f1-d5c4f690a772"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:35.116340 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.116317 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-util" (OuterVolumeSpecName: "util") pod "1cdea1d1-0808-42a4-b498-b9f9ca49c2de" (UID: "1cdea1d1-0808-42a4-b498-b9f9ca49c2de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:01:35.212273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.212165 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd67q\" (UniqueName: \"kubernetes.io/projected/aad828e8-a770-4e3d-a3f1-d5c4f690a772-kube-api-access-qd67q\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:35.212273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.212209 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:35.212273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.212220 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:35.212273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.212228 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nqq9\" (UniqueName: \"kubernetes.io/projected/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-kube-api-access-7nqq9\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:35.212273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.212238 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cdea1d1-0808-42a4-b498-b9f9ca49c2de-util\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:35.212273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.212247 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aad828e8-a770-4e3d-a3f1-d5c4f690a772-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:35.907365 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.907337 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" Jul 05 12:01:35.907365 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.907338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz" event={"ID":"aad828e8-a770-4e3d-a3f1-d5c4f690a772","Type":"ContainerDied","Data":"4d2f3d14ff83968c8c885759a67e9836ad8c592acc0d2de9845c8f4c0d456dde"} Jul 05 12:01:35.907623 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.907384 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d2f3d14ff83968c8c885759a67e9836ad8c592acc0d2de9845c8f4c0d456dde" Jul 05 12:01:35.909372 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.909348 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" Jul 05 12:01:35.909372 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.909342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl" event={"ID":"1cdea1d1-0808-42a4-b498-b9f9ca49c2de","Type":"ContainerDied","Data":"cc5bf4e69e97c1a37f3be95981d0e3a060f8dfe3dc4ef9b0a6e1c1342eba9ee2"} Jul 05 12:01:35.909563 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:35.909398 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc5bf4e69e97c1a37f3be95981d0e3a060f8dfe3dc4ef9b0a6e1c1342eba9ee2" Jul 05 12:01:53.312941 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.312866 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69bcf68df8-zs9qp" podUID="e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" containerName="console" containerID="cri-o://3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4" gracePeriod=15 Jul 05 12:01:53.549463 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.549434 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 12:01:53.680737 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680700 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-config\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.680942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680765 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgzr2\" (UniqueName: \"kubernetes.io/projected/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-kube-api-access-bgzr2\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.680942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-trusted-ca-bundle\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.680942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680838 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-service-ca\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.680942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680878 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-serving-cert\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.680942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680905 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-oauth-serving-cert\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.681244 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.680955 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-oauth-config\") pod \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\" (UID: \"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523\") " Jul 05 12:01:53.681479 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.681429 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:01:53.681575 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.681470 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:01:53.681575 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.681493 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:01:53.681575 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.681526 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-config" (OuterVolumeSpecName: "console-config") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:01:53.683263 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.683243 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-kube-api-access-bgzr2" (OuterVolumeSpecName: "kube-api-access-bgzr2") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "kube-api-access-bgzr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:01:53.683559 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.683531 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 12:01:53.683559 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.683547 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" (UID: "e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 12:01:53.782121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782085 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-service-ca\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.782121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782111 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.782121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782121 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-oauth-serving-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.782336 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782131 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-oauth-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.782336 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782139 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-console-config\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.782336 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782147 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgzr2\" (UniqueName: \"kubernetes.io/projected/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-kube-api-access-bgzr2\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.782336 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.782155 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523-trusted-ca-bundle\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:01:53.996150 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.996035 2578 generic.go:356] "Generic (PLEG): container finished" podID="e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" containerID="3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4" exitCode=0 Jul 05 12:01:53.996150 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.996094 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bcf68df8-zs9qp" Jul 05 12:01:53.996150 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.996125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bcf68df8-zs9qp" event={"ID":"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523","Type":"ContainerDied","Data":"3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4"} Jul 05 12:01:53.996396 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.996176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bcf68df8-zs9qp" event={"ID":"e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523","Type":"ContainerDied","Data":"1e2fbf182998c82fbceeeea739966849fab7130df27a2f51216ebbccdbbce64f"} Jul 05 12:01:53.996396 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:53.996198 2578 scope.go:117] "RemoveContainer" containerID="3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4" Jul 05 12:01:54.004897 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:54.004877 2578 scope.go:117] "RemoveContainer" containerID="3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4" Jul 05 12:01:54.005216 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:01:54.005194 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4\": container with ID starting with 3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4 not found: ID does not exist" containerID="3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4" Jul 05 12:01:54.005289 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:54.005226 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4"} err="failed to get container status \"3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4\": rpc error: code = NotFound desc = could not find container \"3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4\": container with ID starting with 3cf74cb27877c2b82fc8a21d8297e815145b2c10a1f724991621e6e4fe01bef4 not found: ID does not exist" Jul 05 12:01:54.015323 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:54.015301 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69bcf68df8-zs9qp"] Jul 05 12:01:54.022895 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:54.022872 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69bcf68df8-zs9qp"] Jul 05 12:01:55.745575 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:01:55.745537 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" path="/var/lib/kubelet/pods/e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523/volumes" Jul 05 12:02:16.325924 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.325889 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs"] Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326264 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326277 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326289 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326294 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326301 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326307 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326316 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326324 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326334 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" containerName="console" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326339 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" containerName="console" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326348 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326353 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326360 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326365 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326371 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326375 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326383 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326389 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="extract" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326403 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326410 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326416 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326421 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326427 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326432 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="pull" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326438 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="util" Jul 05 12:02:16.326490 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326443 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="util" Jul 05 12:02:16.327328 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326514 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad828e8-a770-4e3d-a3f1-d5c4f690a772" containerName="extract" Jul 05 12:02:16.327328 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326523 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f463373b-8dc3-4eaa-89a3-9406c262d290" containerName="extract" Jul 05 12:02:16.327328 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326530 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cdea1d1-0808-42a4-b498-b9f9ca49c2de" containerName="extract" Jul 05 12:02:16.327328 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326536 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8" containerName="extract" Jul 05 12:02:16.327328 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.326541 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e995af-dbc4-4dcb-a7d9-c5ecd8ae6523" containerName="console" Jul 05 12:02:16.331283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.331260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.333909 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.333714 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 12:02:16.334071 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.333959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r799m\"" Jul 05 12:02:16.334282 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.334247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 12:02:16.341504 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.341477 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs"] Jul 05 12:02:16.362985 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.362950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkwdm\" (UniqueName: \"kubernetes.io/projected/469c5014-1973-48f4-a503-b6daaa43ef42-kube-api-access-xkwdm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96zhs\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.363144 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.363008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/469c5014-1973-48f4-a503-b6daaa43ef42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96zhs\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.464296 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.464256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkwdm\" (UniqueName: \"kubernetes.io/projected/469c5014-1973-48f4-a503-b6daaa43ef42-kube-api-access-xkwdm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96zhs\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.464473 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.464310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/469c5014-1973-48f4-a503-b6daaa43ef42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96zhs\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.464655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.464640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/469c5014-1973-48f4-a503-b6daaa43ef42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96zhs\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.473180 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.473149 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkwdm\" (UniqueName: \"kubernetes.io/projected/469c5014-1973-48f4-a503-b6daaa43ef42-kube-api-access-xkwdm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96zhs\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.644214 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.644178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:16.784310 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:16.784284 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs"] Jul 05 12:02:16.786621 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:02:16.786595 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469c5014_1973_48f4_a503_b6daaa43ef42.slice/crio-dbf5c5fd2239946c9efc54a0d22dbc8157da068a4bf07ad07eb82d5477041f4c WatchSource:0}: Error finding container dbf5c5fd2239946c9efc54a0d22dbc8157da068a4bf07ad07eb82d5477041f4c: Status 404 returned error can't find the container with id dbf5c5fd2239946c9efc54a0d22dbc8157da068a4bf07ad07eb82d5477041f4c Jul 05 12:02:17.119623 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:17.119557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" event={"ID":"469c5014-1973-48f4-a503-b6daaa43ef42","Type":"ContainerStarted","Data":"dbf5c5fd2239946c9efc54a0d22dbc8157da068a4bf07ad07eb82d5477041f4c"} Jul 05 12:02:22.147524 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:22.147490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" event={"ID":"469c5014-1973-48f4-a503-b6daaa43ef42","Type":"ContainerStarted","Data":"54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618"} Jul 05 12:02:22.148103 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:22.147628 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:22.166189 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:22.166134 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" podStartSLOduration=1.7924762570000001 podStartE2EDuration="6.166117591s" totalImagesPullingTime="4.373641334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:02:22.16481842 +0000 UTC m=+520.903355956" watchObservedRunningTime="2026-07-05 12:02:22.166117591 +0000 UTC m=+520.904655109" Jul 05 12:02:33.155506 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:33.155426 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:46.605315 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.605277 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs"] Jul 05 12:02:46.605711 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.605494 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" podUID="469c5014-1973-48f4-a503-b6daaa43ef42" containerName="manager" containerID="cri-o://54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618" gracePeriod=10 Jul 05 12:02:46.863752 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.863687 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:46.941624 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.941591 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkwdm\" (UniqueName: \"kubernetes.io/projected/469c5014-1973-48f4-a503-b6daaa43ef42-kube-api-access-xkwdm\") pod \"469c5014-1973-48f4-a503-b6daaa43ef42\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " Jul 05 12:02:46.941832 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.941668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/469c5014-1973-48f4-a503-b6daaa43ef42-extensions-socket-volume\") pod \"469c5014-1973-48f4-a503-b6daaa43ef42\" (UID: \"469c5014-1973-48f4-a503-b6daaa43ef42\") " Jul 05 12:02:46.942069 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.942026 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469c5014-1973-48f4-a503-b6daaa43ef42-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "469c5014-1973-48f4-a503-b6daaa43ef42" (UID: "469c5014-1973-48f4-a503-b6daaa43ef42"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:02:46.943747 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:46.943725 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469c5014-1973-48f4-a503-b6daaa43ef42-kube-api-access-xkwdm" (OuterVolumeSpecName: "kube-api-access-xkwdm") pod "469c5014-1973-48f4-a503-b6daaa43ef42" (UID: "469c5014-1973-48f4-a503-b6daaa43ef42"). InnerVolumeSpecName "kube-api-access-xkwdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:02:47.042574 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.042539 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkwdm\" (UniqueName: \"kubernetes.io/projected/469c5014-1973-48f4-a503-b6daaa43ef42-kube-api-access-xkwdm\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:02:47.042574 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.042567 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/469c5014-1973-48f4-a503-b6daaa43ef42-extensions-socket-volume\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:02:47.282927 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.282844 2578 generic.go:356] "Generic (PLEG): container finished" podID="469c5014-1973-48f4-a503-b6daaa43ef42" containerID="54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618" exitCode=0 Jul 05 12:02:47.282927 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.282887 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" Jul 05 12:02:47.282927 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.282908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" event={"ID":"469c5014-1973-48f4-a503-b6daaa43ef42","Type":"ContainerDied","Data":"54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618"} Jul 05 12:02:47.283194 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.282955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs" event={"ID":"469c5014-1973-48f4-a503-b6daaa43ef42","Type":"ContainerDied","Data":"dbf5c5fd2239946c9efc54a0d22dbc8157da068a4bf07ad07eb82d5477041f4c"} Jul 05 12:02:47.283194 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.282978 2578 scope.go:117] "RemoveContainer" containerID="54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618" Jul 05 12:02:47.291736 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.291715 2578 scope.go:117] "RemoveContainer" containerID="54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618" Jul 05 12:02:47.291981 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:02:47.291959 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618\": container with ID starting with 54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618 not found: ID does not exist" containerID="54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618" Jul 05 12:02:47.292042 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.291994 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618"} err="failed to get container status \"54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618\": rpc error: code = NotFound desc = could not find container \"54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618\": container with ID starting with 54eef4bd29d6ad87ac41d8430b5c279b8907e2d483d2cb833ddcf22208a60618 not found: ID does not exist" Jul 05 12:02:47.306654 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.306627 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs"] Jul 05 12:02:47.314402 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.314377 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96zhs"] Jul 05 12:02:47.745942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:02:47.745900 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="469c5014-1973-48f4-a503-b6daaa43ef42" path="/var/lib/kubelet/pods/469c5014-1973-48f4-a503-b6daaa43ef42/volumes" Jul 05 12:03:02.936634 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.936598 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f"] Jul 05 12:03:02.937210 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.937158 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469c5014-1973-48f4-a503-b6daaa43ef42" containerName="manager" Jul 05 12:03:02.937210 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.937179 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="469c5014-1973-48f4-a503-b6daaa43ef42" containerName="manager" Jul 05 12:03:02.937333 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.937272 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="469c5014-1973-48f4-a503-b6daaa43ef42" containerName="manager" Jul 05 12:03:02.941654 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.941635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:02.944383 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.944360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-msk6h\"" Jul 05 12:03:02.950829 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:02.950799 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f"] Jul 05 12:03:03.080394 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080573 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080573 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080573 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks46x\" (UniqueName: \"kubernetes.io/projected/a868fbfd-5a9b-4da1-86c0-b29be28f1266-kube-api-access-ks46x\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080573 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080573 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080746 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080746 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.080746 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.080677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.181754 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.181717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.181950 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.181774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.181950 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.181794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.181950 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.181813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks46x\" (UniqueName: \"kubernetes.io/projected/a868fbfd-5a9b-4da1-86c0-b29be28f1266-kube-api-access-ks46x\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.181950 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.181838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.181950 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.181860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182245 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182245 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182367 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182367 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182367 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182526 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.182582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.182540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.183042 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.183021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.185146 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.185119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.185367 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.185347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.190466 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.190398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a868fbfd-5a9b-4da1-86c0-b29be28f1266-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.190875 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.190851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks46x\" (UniqueName: \"kubernetes.io/projected/a868fbfd-5a9b-4da1-86c0-b29be28f1266-kube-api-access-ks46x\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2x88f\" (UID: \"a868fbfd-5a9b-4da1-86c0-b29be28f1266\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.252799 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.252757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:03.396014 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.395980 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f"] Jul 05 12:03:03.396645 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:03:03.396624 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda868fbfd_5a9b_4da1_86c0_b29be28f1266.slice/crio-c168590b3d506362040d247d9b6ab21bff06792d81cc168780d7fe3054baa98b WatchSource:0}: Error finding container c168590b3d506362040d247d9b6ab21bff06792d81cc168780d7fe3054baa98b: Status 404 returned error can't find the container with id c168590b3d506362040d247d9b6ab21bff06792d81cc168780d7fe3054baa98b Jul 05 12:03:03.398632 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.398603 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:03:03.398722 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.398680 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:03:03.398722 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:03.398708 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:03:04.367958 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:04.367928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" event={"ID":"a868fbfd-5a9b-4da1-86c0-b29be28f1266","Type":"ContainerStarted","Data":"c1b03afc2d611384fe90bf1b0bb18a2339df9e5d71f41584c9cda653f7cebd5f"} Jul 05 12:03:04.368365 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:04.367978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" event={"ID":"a868fbfd-5a9b-4da1-86c0-b29be28f1266","Type":"ContainerStarted","Data":"c168590b3d506362040d247d9b6ab21bff06792d81cc168780d7fe3054baa98b"} Jul 05 12:03:04.387248 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:04.387195 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" podStartSLOduration=2.387177244 podStartE2EDuration="2.387177244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:03:04.385382685 +0000 UTC m=+563.123920202" watchObservedRunningTime="2026-07-05 12:03:04.387177244 +0000 UTC m=+563.125714761" Jul 05 12:03:05.253044 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:05.253007 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:05.257948 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:05.257911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:05.374651 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:05.374623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:05.375659 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:05.375644 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:03:46.153399 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.153356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8579659468-wc99q"] Jul 05 12:03:46.157371 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.157346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.159722 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.159698 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 12:03:46.159843 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.159720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mnqf8\"" Jul 05 12:03:46.159843 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.159704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 12:03:46.166861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.166837 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8579659468-wc99q"] Jul 05 12:03:46.271895 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.271857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.272109 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.271973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5fhk\" (UniqueName: \"kubernetes.io/projected/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-kube-api-access-z5fhk\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.372942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.372905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5fhk\" (UniqueName: \"kubernetes.io/projected/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-kube-api-access-z5fhk\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.373138 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.372987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.373138 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:03:46.373118 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 05 12:03:46.373227 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:03:46.373185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert podName:d3cd7a05-78c0-4387-ba1d-ed0b27476df8 nodeName:}" failed. No retries permitted until 2026-07-05 12:03:46.873166109 +0000 UTC m=+605.611703603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert") pod "maas-controller-8579659468-wc99q" (UID: "d3cd7a05-78c0-4387-ba1d-ed0b27476df8") : secret "maas-controller-webhook-cert" not found Jul 05 12:03:46.381476 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.381452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5fhk\" (UniqueName: \"kubernetes.io/projected/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-kube-api-access-z5fhk\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.876968 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.876935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:46.879431 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:46.879406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert\") pod \"maas-controller-8579659468-wc99q\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:47.068786 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:47.068749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:47.200877 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:47.200846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8579659468-wc99q"] Jul 05 12:03:47.202694 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:03:47.202662 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cd7a05_78c0_4387_ba1d_ed0b27476df8.slice/crio-c76534888a1065ea197d2a5d3669e7cc881a37403e04ba1af8a702640d644841 WatchSource:0}: Error finding container c76534888a1065ea197d2a5d3669e7cc881a37403e04ba1af8a702640d644841: Status 404 returned error can't find the container with id c76534888a1065ea197d2a5d3669e7cc881a37403e04ba1af8a702640d644841 Jul 05 12:03:47.204027 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:47.204010 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 12:03:47.599225 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:47.599189 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8579659468-wc99q" event={"ID":"d3cd7a05-78c0-4387-ba1d-ed0b27476df8","Type":"ContainerStarted","Data":"c76534888a1065ea197d2a5d3669e7cc881a37403e04ba1af8a702640d644841"} Jul 05 12:03:49.612800 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:49.612760 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8579659468-wc99q" event={"ID":"d3cd7a05-78c0-4387-ba1d-ed0b27476df8","Type":"ContainerStarted","Data":"787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422"} Jul 05 12:03:49.613199 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:49.612953 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:03:49.634892 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:03:49.630102 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8579659468-wc99q" podStartSLOduration=1.881178302 podStartE2EDuration="3.63008299s" totalImagesPullingTime="1.748904688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:03:49.627812132 +0000 UTC m=+608.366349665" watchObservedRunningTime="2026-07-05 12:03:49.63008299 +0000 UTC m=+608.368620508" Jul 05 12:04:00.622659 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:00.622627 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:04:00.962956 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:00.962870 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8579659468-wc99q"] Jul 05 12:04:00.963138 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:00.963079 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8579659468-wc99q" podUID="d3cd7a05-78c0-4387-ba1d-ed0b27476df8" containerName="manager" containerID="cri-o://787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422" gracePeriod=30 Jul 05 12:04:01.211650 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.211625 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:04:01.313313 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.313223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5fhk\" (UniqueName: \"kubernetes.io/projected/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-kube-api-access-z5fhk\") pod \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " Jul 05 12:04:01.313313 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.313309 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert\") pod \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\" (UID: \"d3cd7a05-78c0-4387-ba1d-ed0b27476df8\") " Jul 05 12:04:01.315426 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.315395 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-kube-api-access-z5fhk" (OuterVolumeSpecName: "kube-api-access-z5fhk") pod "d3cd7a05-78c0-4387-ba1d-ed0b27476df8" (UID: "d3cd7a05-78c0-4387-ba1d-ed0b27476df8"). InnerVolumeSpecName "kube-api-access-z5fhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:04:01.315426 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.315400 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d3cd7a05-78c0-4387-ba1d-ed0b27476df8" (UID: "d3cd7a05-78c0-4387-ba1d-ed0b27476df8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 12:04:01.414288 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.414252 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5fhk\" (UniqueName: \"kubernetes.io/projected/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-kube-api-access-z5fhk\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:04:01.414288 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.414282 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cd7a05-78c0-4387-ba1d-ed0b27476df8-webhook-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:04:01.675133 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.675103 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3cd7a05-78c0-4387-ba1d-ed0b27476df8" containerID="787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422" exitCode=0 Jul 05 12:04:01.675498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.675166 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8579659468-wc99q" Jul 05 12:04:01.675498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.675187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8579659468-wc99q" event={"ID":"d3cd7a05-78c0-4387-ba1d-ed0b27476df8","Type":"ContainerDied","Data":"787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422"} Jul 05 12:04:01.675498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.675266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8579659468-wc99q" event={"ID":"d3cd7a05-78c0-4387-ba1d-ed0b27476df8","Type":"ContainerDied","Data":"c76534888a1065ea197d2a5d3669e7cc881a37403e04ba1af8a702640d644841"} Jul 05 12:04:01.675498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.675288 2578 scope.go:117] "RemoveContainer" containerID="787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422" Jul 05 12:04:01.684865 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.684848 2578 scope.go:117] "RemoveContainer" containerID="787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422" Jul 05 12:04:01.685163 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:04:01.685142 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422\": container with ID starting with 787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422 not found: ID does not exist" containerID="787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422" Jul 05 12:04:01.685217 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.685173 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422"} err="failed to get container status \"787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422\": rpc error: code = NotFound desc = could not find container \"787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422\": container with ID starting with 787fd339bbc7e24e3d7eb58c658ef1156e9db9c652558521b47bbd012959f422 not found: ID does not exist" Jul 05 12:04:01.696889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.696862 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8579659468-wc99q"] Jul 05 12:04:01.700450 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.700428 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8579659468-wc99q"] Jul 05 12:04:01.745987 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:01.745961 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3cd7a05-78c0-4387-ba1d-ed0b27476df8" path="/var/lib/kubelet/pods/d3cd7a05-78c0-4387-ba1d-ed0b27476df8/volumes" Jul 05 12:04:22.466201 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.466164 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hclj5"] Jul 05 12:04:22.466713 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.466486 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cd7a05-78c0-4387-ba1d-ed0b27476df8" containerName="manager" Jul 05 12:04:22.466713 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.466498 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cd7a05-78c0-4387-ba1d-ed0b27476df8" containerName="manager" Jul 05 12:04:22.466713 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.466567 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cd7a05-78c0-4387-ba1d-ed0b27476df8" containerName="manager" Jul 05 12:04:22.471817 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.471796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.474757 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.474730 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 05 12:04:22.474876 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.474822 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2gzjc\"" Jul 05 12:04:22.479284 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.479263 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hclj5"] Jul 05 12:04:22.497871 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.497840 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6cll8"] Jul 05 12:04:22.502135 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.502116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.510677 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.510649 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6cll8"] Jul 05 12:04:22.615044 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.614985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794973f7-1b25-4633-9f60-78ce38b62828-plugins-config-volume\") pod \"payload-processing-58f86c7798-6cll8\" (UID: \"794973f7-1b25-4633-9f60-78ce38b62828\") " pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.615239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.615086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5gvt\" (UniqueName: \"kubernetes.io/projected/794973f7-1b25-4633-9f60-78ce38b62828-kube-api-access-s5gvt\") pod \"payload-processing-58f86c7798-6cll8\" (UID: \"794973f7-1b25-4633-9f60-78ce38b62828\") " pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.615239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.615123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hclj5\" (UID: \"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9\") " pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.615239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.615145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t86k\" (UniqueName: \"kubernetes.io/projected/61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9-kube-api-access-6t86k\") pod \"payload-pre-processing-7964457696-hclj5\" (UID: \"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9\") " pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.716430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.716340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5gvt\" (UniqueName: \"kubernetes.io/projected/794973f7-1b25-4633-9f60-78ce38b62828-kube-api-access-s5gvt\") pod \"payload-processing-58f86c7798-6cll8\" (UID: \"794973f7-1b25-4633-9f60-78ce38b62828\") " pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.716430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.716389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hclj5\" (UID: \"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9\") " pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.716430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.716415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t86k\" (UniqueName: \"kubernetes.io/projected/61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9-kube-api-access-6t86k\") pod \"payload-pre-processing-7964457696-hclj5\" (UID: \"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9\") " pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.716718 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.716487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794973f7-1b25-4633-9f60-78ce38b62828-plugins-config-volume\") pod \"payload-processing-58f86c7798-6cll8\" (UID: \"794973f7-1b25-4633-9f60-78ce38b62828\") " pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.717210 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.717188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hclj5\" (UID: \"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9\") " pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.717304 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.717242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794973f7-1b25-4633-9f60-78ce38b62828-plugins-config-volume\") pod \"payload-processing-58f86c7798-6cll8\" (UID: \"794973f7-1b25-4633-9f60-78ce38b62828\") " pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.725636 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.725610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5gvt\" (UniqueName: \"kubernetes.io/projected/794973f7-1b25-4633-9f60-78ce38b62828-kube-api-access-s5gvt\") pod \"payload-processing-58f86c7798-6cll8\" (UID: \"794973f7-1b25-4633-9f60-78ce38b62828\") " pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.725636 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.725627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t86k\" (UniqueName: \"kubernetes.io/projected/61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9-kube-api-access-6t86k\") pod \"payload-pre-processing-7964457696-hclj5\" (UID: \"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9\") " pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.783794 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.783765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:22.813993 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.813964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:22.929264 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.929235 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hclj5"] Jul 05 12:04:22.930815 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:04:22.930786 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61dbe7b4_9c5c_45a5_a0b1_ae0e33bcf8a9.slice/crio-a6ed0789c6adb810e713ed3a5aad31afacfa23b09872f839f9843dc1d35ad099 WatchSource:0}: Error finding container a6ed0789c6adb810e713ed3a5aad31afacfa23b09872f839f9843dc1d35ad099: Status 404 returned error can't find the container with id a6ed0789c6adb810e713ed3a5aad31afacfa23b09872f839f9843dc1d35ad099 Jul 05 12:04:22.961621 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:22.961598 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6cll8"] Jul 05 12:04:22.962773 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:04:22.962746 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794973f7_1b25_4633_9f60_78ce38b62828.slice/crio-07b93eb76d426a711e903a5dd5c35bc74b69be22fe3b5f1bc7570665d1ddc095 WatchSource:0}: Error finding container 07b93eb76d426a711e903a5dd5c35bc74b69be22fe3b5f1bc7570665d1ddc095: Status 404 returned error can't find the container with id 07b93eb76d426a711e903a5dd5c35bc74b69be22fe3b5f1bc7570665d1ddc095 Jul 05 12:04:23.795023 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:23.794920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" event={"ID":"794973f7-1b25-4633-9f60-78ce38b62828","Type":"ContainerStarted","Data":"07b93eb76d426a711e903a5dd5c35bc74b69be22fe3b5f1bc7570665d1ddc095"} Jul 05 12:04:23.798065 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:23.798015 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" event={"ID":"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9","Type":"ContainerStarted","Data":"a6ed0789c6adb810e713ed3a5aad31afacfa23b09872f839f9843dc1d35ad099"} Jul 05 12:04:24.805033 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:24.804941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" event={"ID":"794973f7-1b25-4633-9f60-78ce38b62828","Type":"ContainerStarted","Data":"3b763c100c793f921e678da1b1237bdd72e03a96ac32c370e9818720c7aa8be5"} Jul 05 12:04:24.805478 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:24.805079 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:24.806592 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:24.806562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" event={"ID":"61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9","Type":"ContainerStarted","Data":"ce6863dac45219211aad3f7bed127c69c781b018d0036a54b68de15414ab0da2"} Jul 05 12:04:24.806707 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:24.806684 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:24.820203 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:24.820148 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" podStartSLOduration=1.275785972 podStartE2EDuration="2.820128891s" totalImagesPullingTime="1.544342919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:04:24.81925591 +0000 UTC m=+643.557793429" watchObservedRunningTime="2026-07-05 12:04:24.820128891 +0000 UTC m=+643.558666408" Jul 05 12:04:24.833010 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:24.832946 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" podStartSLOduration=1.255097698 podStartE2EDuration="2.832924618s" totalImagesPullingTime="1.57782692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:04:24.832446186 +0000 UTC m=+643.570983703" watchObservedRunningTime="2026-07-05 12:04:24.832924618 +0000 UTC m=+643.571462163" Jul 05 12:04:30.842736 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:30.842701 2578 generic.go:356] "Generic (PLEG): container finished" podID="a868fbfd-5a9b-4da1-86c0-b29be28f1266" containerID="c1b03afc2d611384fe90bf1b0bb18a2339df9e5d71f41584c9cda653f7cebd5f" exitCode=0 Jul 05 12:04:30.843172 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:30.842775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" event={"ID":"a868fbfd-5a9b-4da1-86c0-b29be28f1266","Type":"ContainerDied","Data":"c1b03afc2d611384fe90bf1b0bb18a2339df9e5d71f41584c9cda653f7cebd5f"} Jul 05 12:04:30.843172 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:30.843171 2578 scope.go:117] "RemoveContainer" containerID="c1b03afc2d611384fe90bf1b0bb18a2339df9e5d71f41584c9cda653f7cebd5f" Jul 05 12:04:30.844073 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:30.844030 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:04:30.844143 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:30.844116 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:04:30.844180 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:30.844148 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:04:31.852446 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:31.852409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" event={"ID":"a868fbfd-5a9b-4da1-86c0-b29be28f1266","Type":"ContainerStarted","Data":"6472371705fc939042e2294891dd258dfa6bb428af0fe03d5d1a5edf0da2ceae"} Jul 05 12:04:32.253378 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:32.253280 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:04:32.254558 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:32.254532 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2x88f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 05 12:04:32.254678 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:32.254583 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" podUID="a868fbfd-5a9b-4da1-86c0-b29be28f1266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 05 12:04:33.253160 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:33.253123 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2x88f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 05 12:04:33.253561 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:33.253184 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" podUID="a868fbfd-5a9b-4da1-86c0-b29be28f1266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 05 12:04:34.254165 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:34.254128 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2x88f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 05 12:04:34.254565 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:34.254182 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" podUID="a868fbfd-5a9b-4da1-86c0-b29be28f1266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 05 12:04:35.253725 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:35.253685 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2x88f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 05 12:04:35.253914 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:35.253743 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" podUID="a868fbfd-5a9b-4da1-86c0-b29be28f1266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 05 12:04:35.374830 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:35.374790 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:04:35.813907 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:35.813872 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-6cll8" Jul 05 12:04:35.814210 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:35.814188 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-hclj5" Jul 05 12:04:36.257099 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:36.257036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:04:36.258078 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:36.258033 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2x88f" Jul 05 12:04:43.100875 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.100836 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7"] Jul 05 12:04:43.104442 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.104419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.108023 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.107998 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 05 12:04:43.108023 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.108023 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 05 12:04:43.108236 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.108087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7msdg\"" Jul 05 12:04:43.108236 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.108116 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 05 12:04:43.112543 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.112516 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7"] Jul 05 12:04:43.200124 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.200088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.200298 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.200182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.200298 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.200213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce711a0-e35f-4b39-8534-4ebdac127736-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.200298 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.200264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwwxc\" (UniqueName: \"kubernetes.io/projected/8ce711a0-e35f-4b39-8534-4ebdac127736-kube-api-access-mwwxc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.200298 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.200286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.200441 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.200345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301496 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce711a0-e35f-4b39-8534-4ebdac127736-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwwxc\" (UniqueName: \"kubernetes.io/projected/8ce711a0-e35f-4b39-8534-4ebdac127736-kube-api-access-mwwxc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.301965 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.302010 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.301949 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.302080 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.302028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.303874 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.303854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce711a0-e35f-4b39-8534-4ebdac127736-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.304038 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.304022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce711a0-e35f-4b39-8534-4ebdac127736-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.308536 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.308513 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwwxc\" (UniqueName: \"kubernetes.io/projected/8ce711a0-e35f-4b39-8534-4ebdac127736-kube-api-access-mwwxc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7\" (UID: \"8ce711a0-e35f-4b39-8534-4ebdac127736\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.416968 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.416874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:43.557576 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.557544 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7"] Jul 05 12:04:43.559953 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:04:43.559929 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce711a0_e35f_4b39_8534_4ebdac127736.slice/crio-ba37f5e164240370c4e1dca60b975b5a84445ce015a9a03eb71e2678cf4cb8e3 WatchSource:0}: Error finding container ba37f5e164240370c4e1dca60b975b5a84445ce015a9a03eb71e2678cf4cb8e3: Status 404 returned error can't find the container with id ba37f5e164240370c4e1dca60b975b5a84445ce015a9a03eb71e2678cf4cb8e3 Jul 05 12:04:43.925306 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:43.925259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" event={"ID":"8ce711a0-e35f-4b39-8534-4ebdac127736","Type":"ContainerStarted","Data":"ba37f5e164240370c4e1dca60b975b5a84445ce015a9a03eb71e2678cf4cb8e3"} Jul 05 12:04:44.931420 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:44.931387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" event={"ID":"8ce711a0-e35f-4b39-8534-4ebdac127736","Type":"ContainerStarted","Data":"c2105ff54949e08161d2e25287b7b96ae4afdf8ea7b36e38c12beb4bfd66c4b6"} Jul 05 12:04:44.949159 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:44.949108 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" podStartSLOduration=0.805673235 podStartE2EDuration="1.949092535s" totalImagesPullingTime="1.1434193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:04:44.946792874 +0000 UTC m=+663.685330412" watchObservedRunningTime="2026-07-05 12:04:44.949092535 +0000 UTC m=+663.687630052" Jul 05 12:04:53.418017 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:53.417969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:53.418524 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:53.418042 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:53.431002 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:53.430978 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:04:53.987624 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:04:53.987592 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7" Jul 05 12:05:16.366161 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.366129 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-75krj"] Jul 05 12:05:16.369871 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.369849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.372839 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.372795 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 05 12:05:16.379749 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.379724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-75krj"] Jul 05 12:05:16.492304 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.492267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.492492 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.492344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceef140e-d45e-4234-aa0e-0ab5ab339c48-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.492492 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.492396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.492492 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.492452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.492492 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.492470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.492668 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.492538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fn5\" (UniqueName: \"kubernetes.io/projected/ceef140e-d45e-4234-aa0e-0ab5ab339c48-kube-api-access-97fn5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.593879 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.593835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceef140e-d45e-4234-aa0e-0ab5ab339c48-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.593879 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.593883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594192 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.593931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594192 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.593951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594192 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.594001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97fn5\" (UniqueName: \"kubernetes.io/projected/ceef140e-d45e-4234-aa0e-0ab5ab339c48-kube-api-access-97fn5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594192 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.594073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594433 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.594408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.594436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.594554 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.594504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.596192 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.596161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ceef140e-d45e-4234-aa0e-0ab5ab339c48-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.596469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.596448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceef140e-d45e-4234-aa0e-0ab5ab339c48-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.606347 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.606324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fn5\" (UniqueName: \"kubernetes.io/projected/ceef140e-d45e-4234-aa0e-0ab5ab339c48-kube-api-access-97fn5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-75krj\" (UID: \"ceef140e-d45e-4234-aa0e-0ab5ab339c48\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.681558 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.681461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:16.814315 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:16.814288 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-75krj"] Jul 05 12:05:16.815729 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:05:16.815704 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceef140e_d45e_4234_aa0e_0ab5ab339c48.slice/crio-e937b0172a59c7226cbc919e7998466ee567aca9c3c9b43466c80728606b01d9 WatchSource:0}: Error finding container e937b0172a59c7226cbc919e7998466ee567aca9c3c9b43466c80728606b01d9: Status 404 returned error can't find the container with id e937b0172a59c7226cbc919e7998466ee567aca9c3c9b43466c80728606b01d9 Jul 05 12:05:17.099633 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:17.099598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" event={"ID":"ceef140e-d45e-4234-aa0e-0ab5ab339c48","Type":"ContainerStarted","Data":"8658fe16be8a58a9372b06ac66887487859b383dcf1e1affe51233f46ea9ff13"} Jul 05 12:05:17.099832 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:17.099668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" event={"ID":"ceef140e-d45e-4234-aa0e-0ab5ab339c48","Type":"ContainerStarted","Data":"e937b0172a59c7226cbc919e7998466ee567aca9c3c9b43466c80728606b01d9"} Jul 05 12:05:17.116086 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:17.116022 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" podStartSLOduration=0.92959423 podStartE2EDuration="1.116006429s" totalImagesPullingTime="186.412199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:05:17.115328844 +0000 UTC m=+695.853866361" watchObservedRunningTime="2026-07-05 12:05:17.116006429 +0000 UTC m=+695.854543944" Jul 05 12:05:26.682529 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:26.682491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:26.683030 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:26.682555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:26.694996 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:26.694970 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:05:27.170827 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:05:27.170800 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-75krj" Jul 05 12:08:17.965982 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:17.965941 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4f9f4b57-7qrw6"] Jul 05 12:08:17.969353 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:17.969335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:17.972697 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:17.972665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 12:08:17.972697 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:17.972677 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mnqf8\"" Jul 05 12:08:17.972904 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:17.972715 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 12:08:17.978410 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:17.978389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f9f4b57-7qrw6"] Jul 05 12:08:18.071123 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.071093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f-webhook-cert\") pod \"maas-controller-d4f9f4b57-7qrw6\" (UID: \"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f\") " pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.071319 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.071130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrmf\" (UniqueName: \"kubernetes.io/projected/2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f-kube-api-access-zkrmf\") pod \"maas-controller-d4f9f4b57-7qrw6\" (UID: \"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f\") " pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.171835 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.171796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f-webhook-cert\") pod \"maas-controller-d4f9f4b57-7qrw6\" (UID: \"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f\") " pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.172083 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.171844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrmf\" (UniqueName: \"kubernetes.io/projected/2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f-kube-api-access-zkrmf\") pod \"maas-controller-d4f9f4b57-7qrw6\" (UID: \"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f\") " pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.174379 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.174357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f-webhook-cert\") pod \"maas-controller-d4f9f4b57-7qrw6\" (UID: \"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f\") " pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.179495 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.179472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrmf\" (UniqueName: \"kubernetes.io/projected/2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f-kube-api-access-zkrmf\") pod \"maas-controller-d4f9f4b57-7qrw6\" (UID: \"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f\") " pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.280804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.280715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:18.411103 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:18.411066 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f9f4b57-7qrw6"] Jul 05 12:08:18.414446 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:08:18.414417 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff09dab_5ec4_4e4f_b8c5_2fc26c29463f.slice/crio-cba774695157bb462d04506734814b975be6900568c00dd23440b489233684aa WatchSource:0}: Error finding container cba774695157bb462d04506734814b975be6900568c00dd23440b489233684aa: Status 404 returned error can't find the container with id cba774695157bb462d04506734814b975be6900568c00dd23440b489233684aa Jul 05 12:08:19.075804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:19.075768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" event={"ID":"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f","Type":"ContainerStarted","Data":"d56e9a9c1b572b1cb05cd096ea34e771bc218b3cac7c33ba97f3d6cb302329ba"} Jul 05 12:08:19.076208 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:19.075820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" event={"ID":"2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f","Type":"ContainerStarted","Data":"cba774695157bb462d04506734814b975be6900568c00dd23440b489233684aa"} Jul 05 12:08:19.076208 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:19.075851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:08:19.095112 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:19.095041 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" podStartSLOduration=1.664372075 podStartE2EDuration="2.095025834s" totalImagesPullingTime="430.653759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:08:19.093683275 +0000 UTC m=+877.832220820" watchObservedRunningTime="2026-07-05 12:08:19.095025834 +0000 UTC m=+877.833563351" Jul 05 12:08:30.087855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:08:30.087824 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4f9f4b57-7qrw6" Jul 05 12:15:00.131707 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.131672 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29720895-4nx2l"] Jul 05 12:15:00.134993 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.134977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:00.137132 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.137111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4cvrp\"" Jul 05 12:15:00.141041 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.141016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720895-4nx2l"] Jul 05 12:15:00.249917 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.249883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfm4\" (UniqueName: \"kubernetes.io/projected/6ade654c-2290-42cd-b899-0152882ef271-kube-api-access-8xfm4\") pod \"maas-api-key-cleanup-29720895-4nx2l\" (UID: \"6ade654c-2290-42cd-b899-0152882ef271\") " pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:00.351112 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.351076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfm4\" (UniqueName: \"kubernetes.io/projected/6ade654c-2290-42cd-b899-0152882ef271-kube-api-access-8xfm4\") pod \"maas-api-key-cleanup-29720895-4nx2l\" (UID: \"6ade654c-2290-42cd-b899-0152882ef271\") " pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:00.358386 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.358356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfm4\" (UniqueName: \"kubernetes.io/projected/6ade654c-2290-42cd-b899-0152882ef271-kube-api-access-8xfm4\") pod \"maas-api-key-cleanup-29720895-4nx2l\" (UID: \"6ade654c-2290-42cd-b899-0152882ef271\") " pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:00.446800 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.446709 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:00.571648 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.571625 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720895-4nx2l"] Jul 05 12:15:00.573490 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:15:00.573459 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ade654c_2290_42cd_b899_0152882ef271.slice/crio-8fb33cbcd0ab427083ddae3f3e8fb5818c79884c818fc0126d7fe31327dc069c WatchSource:0}: Error finding container 8fb33cbcd0ab427083ddae3f3e8fb5818c79884c818fc0126d7fe31327dc069c: Status 404 returned error can't find the container with id 8fb33cbcd0ab427083ddae3f3e8fb5818c79884c818fc0126d7fe31327dc069c Jul 05 12:15:00.575214 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:00.575198 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 12:15:01.199576 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:01.199545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" event={"ID":"6ade654c-2290-42cd-b899-0152882ef271","Type":"ContainerStarted","Data":"8fb33cbcd0ab427083ddae3f3e8fb5818c79884c818fc0126d7fe31327dc069c"} Jul 05 12:15:03.212679 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:03.212583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" event={"ID":"6ade654c-2290-42cd-b899-0152882ef271","Type":"ContainerStarted","Data":"d6cbb08604ff734e4267783c6b117b290003bf652c79793720019960909c17e7"} Jul 05 12:15:03.226779 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:03.226727 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" podStartSLOduration=1.210320056 podStartE2EDuration="3.22671203s" totalImagesPullingTime="2.016391974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:15:03.225747434 +0000 UTC m=+1281.964284951" watchObservedRunningTime="2026-07-05 12:15:03.22671203 +0000 UTC m=+1281.965249544" Jul 05 12:15:04.219308 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:04.219265 2578 generic.go:356] "Generic (PLEG): container finished" podID="6ade654c-2290-42cd-b899-0152882ef271" containerID="d6cbb08604ff734e4267783c6b117b290003bf652c79793720019960909c17e7" exitCode=0 Jul 05 12:15:04.219695 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:04.219317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" event={"ID":"6ade654c-2290-42cd-b899-0152882ef271","Type":"ContainerDied","Data":"d6cbb08604ff734e4267783c6b117b290003bf652c79793720019960909c17e7"} Jul 05 12:15:05.355402 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:05.355364 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:05.498426 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:05.498342 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xfm4\" (UniqueName: \"kubernetes.io/projected/6ade654c-2290-42cd-b899-0152882ef271-kube-api-access-8xfm4\") pod \"6ade654c-2290-42cd-b899-0152882ef271\" (UID: \"6ade654c-2290-42cd-b899-0152882ef271\") " Jul 05 12:15:05.500323 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:05.500297 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ade654c-2290-42cd-b899-0152882ef271-kube-api-access-8xfm4" (OuterVolumeSpecName: "kube-api-access-8xfm4") pod "6ade654c-2290-42cd-b899-0152882ef271" (UID: "6ade654c-2290-42cd-b899-0152882ef271"). InnerVolumeSpecName "kube-api-access-8xfm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:15:05.600085 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:05.600030 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xfm4\" (UniqueName: \"kubernetes.io/projected/6ade654c-2290-42cd-b899-0152882ef271-kube-api-access-8xfm4\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:15:06.230581 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:06.230554 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" Jul 05 12:15:06.230769 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:06.230582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720895-4nx2l" event={"ID":"6ade654c-2290-42cd-b899-0152882ef271","Type":"ContainerDied","Data":"8fb33cbcd0ab427083ddae3f3e8fb5818c79884c818fc0126d7fe31327dc069c"} Jul 05 12:15:06.230769 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:15:06.230667 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fb33cbcd0ab427083ddae3f3e8fb5818c79884c818fc0126d7fe31327dc069c" Jul 05 12:20:09.508013 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.507981 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4"] Jul 05 12:20:09.509509 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.508528 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ade654c-2290-42cd-b899-0152882ef271" containerName="cleanup" Jul 05 12:20:09.509509 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.508543 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ade654c-2290-42cd-b899-0152882ef271" containerName="cleanup" Jul 05 12:20:09.509509 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.508607 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ade654c-2290-42cd-b899-0152882ef271" containerName="cleanup" Jul 05 12:20:09.510554 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.510533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.512976 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.512956 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9b1d55bc-openshift-default-dockercfg-jgcpk\"" Jul 05 12:20:09.530298 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.530269 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4"] Jul 05 12:20:09.602447 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27da425a-0d54-4cf9-99ff-751de36e9366-istiod-ca-cert\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602634 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-envoy\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602634 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf6gd\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-kube-api-access-pf6gd\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602634 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-istio-token\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602634 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-socket\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602815 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-data\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602815 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-certs\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602815 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27da425a-0d54-4cf9-99ff-751de36e9366-istio-podinfo\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.602815 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.602768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-credential-socket\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703596 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-envoy\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703787 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf6gd\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-kube-api-access-pf6gd\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703787 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-istio-token\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703787 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-socket\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703963 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-data\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703963 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-certs\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703963 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27da425a-0d54-4cf9-99ff-751de36e9366-istio-podinfo\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.703963 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.703949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-credential-socket\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.704196 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.704006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27da425a-0d54-4cf9-99ff-751de36e9366-istiod-ca-cert\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.704196 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.704164 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-socket\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.704299 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.704263 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-data\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.704356 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.704296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-certs\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.704414 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.704386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-credential-socket\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.704709 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.704687 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27da425a-0d54-4cf9-99ff-751de36e9366-istiod-ca-cert\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.705914 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.705898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-envoy\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.706351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.706327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27da425a-0d54-4cf9-99ff-751de36e9366-istio-podinfo\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.710810 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.710782 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-istio-token\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.711199 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.711179 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf6gd\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-kube-api-access-pf6gd\") pod \"e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.823737 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.823644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:09.959766 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.959737 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4"] Jul 05 12:20:09.961904 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:20:09.961875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27da425a_0d54_4cf9_99ff_751de36e9366.slice/crio-d8c99a37a00d456dbcc32ba3d3528ab8e54c9a77ad2c5a202a771032bd478692 WatchSource:0}: Error finding container d8c99a37a00d456dbcc32ba3d3528ab8e54c9a77ad2c5a202a771032bd478692: Status 404 returned error can't find the container with id d8c99a37a00d456dbcc32ba3d3528ab8e54c9a77ad2c5a202a771032bd478692 Jul 05 12:20:09.964224 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.964175 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:09.964301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.964272 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:09.964339 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:09.964316 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:10.849338 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:10.849306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" event={"ID":"27da425a-0d54-4cf9-99ff-751de36e9366","Type":"ContainerStarted","Data":"b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747"} Jul 05 12:20:10.849866 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:10.849357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" event={"ID":"27da425a-0d54-4cf9-99ff-751de36e9366","Type":"ContainerStarted","Data":"d8c99a37a00d456dbcc32ba3d3528ab8e54c9a77ad2c5a202a771032bd478692"} Jul 05 12:20:10.870741 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:10.870698 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" podStartSLOduration=1.870683119 podStartE2EDuration="1.870683119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:20:10.868931152 +0000 UTC m=+1589.607468687" watchObservedRunningTime="2026-07-05 12:20:10.870683119 +0000 UTC m=+1589.609220634" Jul 05 12:20:11.824110 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:11.824075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:11.829529 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:11.829501 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:11.854585 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:11.854555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:11.855482 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:11.855462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:16.072777 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:16.072742 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4"] Jul 05 12:20:16.073264 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:16.072922 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" podUID="27da425a-0d54-4cf9-99ff-751de36e9366" containerName="istio-proxy" containerID="cri-o://b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747" gracePeriod=30 Jul 05 12:20:20.747213 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.747187 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:20.809424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809333 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-data\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809369 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-certs\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809399 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-istio-token\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809708 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-socket\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809708 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809491 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27da425a-0d54-4cf9-99ff-751de36e9366-istiod-ca-cert\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809708 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809514 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27da425a-0d54-4cf9-99ff-751de36e9366-istio-podinfo\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809708 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809543 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-credential-socket\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809708 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809584 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-envoy\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.809708 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809626 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf6gd\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-kube-api-access-pf6gd\") pod \"27da425a-0d54-4cf9-99ff-751de36e9366\" (UID: \"27da425a-0d54-4cf9-99ff-751de36e9366\") " Jul 05 12:20:20.810006 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809754 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:20.810006 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809853 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:20.810006 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809851 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27da425a-0d54-4cf9-99ff-751de36e9366-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:20:20.810006 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.809912 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:20.810252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.810111 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.810252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.810130 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.810252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.810136 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-data" (OuterVolumeSpecName: "istio-data") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:20.810252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.810142 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27da425a-0d54-4cf9-99ff-751de36e9366-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.810252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.810183 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.811811 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.811784 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-istio-token" (OuterVolumeSpecName: "istio-token") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:20:20.811947 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.811852 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-kube-api-access-pf6gd" (OuterVolumeSpecName: "kube-api-access-pf6gd") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "kube-api-access-pf6gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:20:20.811947 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.811860 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:20.811947 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.811906 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27da425a-0d54-4cf9-99ff-751de36e9366-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27da425a-0d54-4cf9-99ff-751de36e9366" (UID: "27da425a-0d54-4cf9-99ff-751de36e9366"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:20:20.908427 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.908390 2578 generic.go:356] "Generic (PLEG): container finished" podID="27da425a-0d54-4cf9-99ff-751de36e9366" containerID="b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747" exitCode=0 Jul 05 12:20:20.908593 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.908460 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" Jul 05 12:20:20.908593 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.908478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" event={"ID":"27da425a-0d54-4cf9-99ff-751de36e9366","Type":"ContainerDied","Data":"b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747"} Jul 05 12:20:20.908593 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.908539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4" event={"ID":"27da425a-0d54-4cf9-99ff-751de36e9366","Type":"ContainerDied","Data":"d8c99a37a00d456dbcc32ba3d3528ab8e54c9a77ad2c5a202a771032bd478692"} Jul 05 12:20:20.908593 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.908568 2578 scope.go:117] "RemoveContainer" containerID="b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747" Jul 05 12:20:20.911514 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.911491 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf6gd\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-kube-api-access-pf6gd\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.911590 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.911523 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.911590 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.911538 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27da425a-0d54-4cf9-99ff-751de36e9366-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.911590 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.911550 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27da425a-0d54-4cf9-99ff-751de36e9366-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.911590 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.911562 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27da425a-0d54-4cf9-99ff-751de36e9366-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:20.918755 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.918740 2578 scope.go:117] "RemoveContainer" containerID="b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747" Jul 05 12:20:20.918989 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:20:20.918972 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747\": container with ID starting with b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747 not found: ID does not exist" containerID="b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747" Jul 05 12:20:20.919099 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.918997 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747"} err="failed to get container status \"b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747\": rpc error: code = NotFound desc = could not find container \"b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747\": container with ID starting with b69f608ed7efa3ae285383c8a31c69263fd8b23542c52c13df7436989bafe747 not found: ID does not exist" Jul 05 12:20:20.930171 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.930147 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4"] Jul 05 12:20:20.934011 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:20.933988 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9b1d55bc-openshift-default-677f954cdf-fz2x4"] Jul 05 12:20:21.747382 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.747346 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27da425a-0d54-4cf9-99ff-751de36e9366" path="/var/lib/kubelet/pods/27da425a-0d54-4cf9-99ff-751de36e9366/volumes" Jul 05 12:20:21.913820 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.913776 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx"] Jul 05 12:20:21.914758 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.914729 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27da425a-0d54-4cf9-99ff-751de36e9366" containerName="istio-proxy" Jul 05 12:20:21.914758 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.914758 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27da425a-0d54-4cf9-99ff-751de36e9366" containerName="istio-proxy" Jul 05 12:20:21.914971 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.914841 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27da425a-0d54-4cf9-99ff-751de36e9366" containerName="istio-proxy" Jul 05 12:20:21.919472 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.919453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:21.921799 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.921781 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c2af4718-openshift-default-dockercfg-chrj4\"" Jul 05 12:20:21.928386 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:21.928157 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx"] Jul 05 12:20:22.023564 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-certs\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.023564 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-data\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.023564 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901ee074-75e2-40e5-bcad-efb75e449671-istiod-ca-cert\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.023880 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901ee074-75e2-40e5-bcad-efb75e449671-istio-podinfo\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.023880 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-socket\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.023880 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-istio-token\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.024032 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-credential-socket\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.024032 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-envoy\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.024032 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.023953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqttf\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-kube-api-access-sqttf\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124452 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-certs\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124452 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-data\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124712 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901ee074-75e2-40e5-bcad-efb75e449671-istiod-ca-cert\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124712 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901ee074-75e2-40e5-bcad-efb75e449671-istio-podinfo\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124712 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-socket\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124712 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-istio-token\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-credential-socket\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-envoy\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqttf\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-kube-api-access-sqttf\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.124944 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-data\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.125173 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-certs\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.125173 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.124968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-socket\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.125173 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.125097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-credential-socket\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.125414 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.125385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901ee074-75e2-40e5-bcad-efb75e449671-istiod-ca-cert\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.127271 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.127253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-envoy\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.127475 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.127452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901ee074-75e2-40e5-bcad-efb75e449671-istio-podinfo\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.139992 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.139970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-istio-token\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.140210 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.140190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqttf\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-kube-api-access-sqttf\") pod \"e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.232964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.232930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:22.370234 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.370204 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx"] Jul 05 12:20:22.371899 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:20:22.371875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901ee074_75e2_40e5_bcad_efb75e449671.slice/crio-e3c61cbe4c7d5fe6dc8d6b85b56d76b779ea1eaab54fc5887f7f46e1da9f0378 WatchSource:0}: Error finding container e3c61cbe4c7d5fe6dc8d6b85b56d76b779ea1eaab54fc5887f7f46e1da9f0378: Status 404 returned error can't find the container with id e3c61cbe4c7d5fe6dc8d6b85b56d76b779ea1eaab54fc5887f7f46e1da9f0378 Jul 05 12:20:22.373983 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.373953 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:22.374086 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.374017 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:22.374086 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.374043 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:22.924476 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.924440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" event={"ID":"901ee074-75e2-40e5-bcad-efb75e449671","Type":"ContainerStarted","Data":"7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271"} Jul 05 12:20:22.924981 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.924493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" event={"ID":"901ee074-75e2-40e5-bcad-efb75e449671","Type":"ContainerStarted","Data":"e3c61cbe4c7d5fe6dc8d6b85b56d76b779ea1eaab54fc5887f7f46e1da9f0378"} Jul 05 12:20:22.944248 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:22.944193 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" podStartSLOduration=1.944178339 podStartE2EDuration="1.944178339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:20:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:20:22.943265007 +0000 UTC m=+1601.681802520" watchObservedRunningTime="2026-07-05 12:20:22.944178339 +0000 UTC m=+1601.682715855" Jul 05 12:20:23.233173 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:23.233039 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:23.238603 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:23.238574 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:23.930374 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:23.930344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:23.932094 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:23.932065 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:32.982382 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:32.982351 2578 generic.go:356] "Generic (PLEG): container finished" podID="901ee074-75e2-40e5-bcad-efb75e449671" containerID="7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271" exitCode=0 Jul 05 12:20:32.982773 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:32.982420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" event={"ID":"901ee074-75e2-40e5-bcad-efb75e449671","Type":"ContainerDied","Data":"7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271"} Jul 05 12:20:32.982819 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:32.982801 2578 scope.go:117] "RemoveContainer" containerID="7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271" Jul 05 12:20:32.983841 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:32.983815 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:32.983915 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:32.983898 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:32.983961 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:32.983948 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:33.989738 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:33.989702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" event={"ID":"901ee074-75e2-40e5-bcad-efb75e449671","Type":"ContainerStarted","Data":"2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2"} Jul 05 12:20:34.234115 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:34.234079 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:34.238751 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:34.238728 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:34.699632 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:34.699597 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx"] Jul 05 12:20:34.995480 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:34.995393 2578 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" secret="" err="secret \"e2e-ait-c2af4718-openshift-default-dockercfg-chrj4\" not found" Jul 05 12:20:34.995843 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:34.995401 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:34.996439 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:34.996424 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:36.000688 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:36.000650 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" containerID="cri-o://2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2" gracePeriod=30 Jul 05 12:20:40.611715 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.611687 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5"] Jul 05 12:20:40.619350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.619329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.621571 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.621552 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d0668d61-openshift-default-dockercfg-7286f\"" Jul 05 12:20:40.626871 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.626850 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5"] Jul 05 12:20:40.709858 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.709820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-data\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710039 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.709881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-certs\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710039 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.709963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-envoy\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710039 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.709995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-podinfo\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710039 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.710017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-credential-socket\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.710094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-socket\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.710134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-token\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.710163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc3b073-3869-4469-914c-f3ffe51e91f4-istiod-ca-cert\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.710259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.710189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94mr\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-kube-api-access-s94mr\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811153 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-token\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc3b073-3869-4469-914c-f3ffe51e91f4-istiod-ca-cert\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94mr\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-kube-api-access-s94mr\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-data\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-certs\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-envoy\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-podinfo\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811726 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-credential-socket\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811726 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-socket\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811726 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-certs\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811888 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811719 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-data\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811888 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-socket\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811888 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-credential-socket\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.811992 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.811931 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc3b073-3869-4469-914c-f3ffe51e91f4-istiod-ca-cert\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.813642 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.813620 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-envoy\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.813759 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.813743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-podinfo\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.818680 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.818658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-token\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.818887 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.818870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94mr\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-kube-api-access-s94mr\") pod \"e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:40.934125 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:40.934010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:41.076271 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.076247 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5"] Jul 05 12:20:41.084175 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:20:41.084140 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc3b073_3869_4469_914c_f3ffe51e91f4.slice/crio-e37215d7334e886f71e4e48b5679388925112ff5095f5c3df37aa71a759830b4 WatchSource:0}: Error finding container e37215d7334e886f71e4e48b5679388925112ff5095f5c3df37aa71a759830b4: Status 404 returned error can't find the container with id e37215d7334e886f71e4e48b5679388925112ff5095f5c3df37aa71a759830b4 Jul 05 12:20:41.106318 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.106279 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:41.106413 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.106350 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:41.106413 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.106378 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:20:41.269997 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.269970 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:41.415782 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415739 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-envoy\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.415964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415795 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-data\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.415964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415842 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-istio-token\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.415964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415890 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-socket\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.415964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415916 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-certs\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.415964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415952 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901ee074-75e2-40e5-bcad-efb75e449671-istiod-ca-cert\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.416234 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.415993 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-credential-socket\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.416234 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416039 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901ee074-75e2-40e5-bcad-efb75e449671-istio-podinfo\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.416234 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416106 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqttf\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-kube-api-access-sqttf\") pod \"901ee074-75e2-40e5-bcad-efb75e449671\" (UID: \"901ee074-75e2-40e5-bcad-efb75e449671\") " Jul 05 12:20:41.416381 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416263 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:41.416527 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416451 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/901ee074-75e2-40e5-bcad-efb75e449671-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:20:41.416600 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416543 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.416600 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416565 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901ee074-75e2-40e5-bcad-efb75e449671-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.416707 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416618 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:41.416707 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416694 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-data" (OuterVolumeSpecName: "istio-data") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:41.416816 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.416708 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:41.418597 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.418568 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:41.418714 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.418645 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-kube-api-access-sqttf" (OuterVolumeSpecName: "kube-api-access-sqttf") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "kube-api-access-sqttf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:20:41.418714 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.418643 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-istio-token" (OuterVolumeSpecName: "istio-token") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:20:41.418805 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.418729 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/901ee074-75e2-40e5-bcad-efb75e449671-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "901ee074-75e2-40e5-bcad-efb75e449671" (UID: "901ee074-75e2-40e5-bcad-efb75e449671"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517257 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901ee074-75e2-40e5-bcad-efb75e449671-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517291 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqttf\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-kube-api-access-sqttf\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517303 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517311 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517318 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901ee074-75e2-40e5-bcad-efb75e449671-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517325 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:41.517355 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:41.517332 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901ee074-75e2-40e5-bcad-efb75e449671-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:42.043574 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.043533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" event={"ID":"5cc3b073-3869-4469-914c-f3ffe51e91f4","Type":"ContainerStarted","Data":"e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543"} Jul 05 12:20:42.043959 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.043598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" event={"ID":"5cc3b073-3869-4469-914c-f3ffe51e91f4","Type":"ContainerStarted","Data":"e37215d7334e886f71e4e48b5679388925112ff5095f5c3df37aa71a759830b4"} Jul 05 12:20:42.045225 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.045202 2578 generic.go:356] "Generic (PLEG): container finished" podID="901ee074-75e2-40e5-bcad-efb75e449671" containerID="2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2" exitCode=0 Jul 05 12:20:42.045351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.045243 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" Jul 05 12:20:42.045351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.045243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" event={"ID":"901ee074-75e2-40e5-bcad-efb75e449671","Type":"ContainerDied","Data":"2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2"} Jul 05 12:20:42.045443 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.045355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx" event={"ID":"901ee074-75e2-40e5-bcad-efb75e449671","Type":"ContainerDied","Data":"e3c61cbe4c7d5fe6dc8d6b85b56d76b779ea1eaab54fc5887f7f46e1da9f0378"} Jul 05 12:20:42.045443 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.045382 2578 scope.go:117] "RemoveContainer" containerID="2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2" Jul 05 12:20:42.054583 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.054559 2578 scope.go:117] "RemoveContainer" containerID="7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271" Jul 05 12:20:42.064449 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.064422 2578 scope.go:117] "RemoveContainer" containerID="2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2" Jul 05 12:20:42.064770 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:20:42.064745 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2\": container with ID starting with 2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2 not found: ID does not exist" containerID="2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2" Jul 05 12:20:42.064896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.064783 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2"} err="failed to get container status \"2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2\": rpc error: code = NotFound desc = could not find container \"2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2\": container with ID starting with 2ed913a4cd9562b93b83723dec685bc9a11e43e3d6b2e229e80fc36470d974d2 not found: ID does not exist" Jul 05 12:20:42.064896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.064808 2578 scope.go:117] "RemoveContainer" containerID="7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271" Jul 05 12:20:42.065812 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.065586 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" podStartSLOduration=2.065568951 podStartE2EDuration="2.065568951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:20:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:20:42.065088428 +0000 UTC m=+1620.803625947" watchObservedRunningTime="2026-07-05 12:20:42.065568951 +0000 UTC m=+1620.804106466" Jul 05 12:20:42.065812 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:20:42.065784 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271\": container with ID starting with 7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271 not found: ID does not exist" containerID="7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271" Jul 05 12:20:42.065979 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.065816 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271"} err="failed to get container status \"7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271\": rpc error: code = NotFound desc = could not find container \"7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271\": container with ID starting with 7ab158511e18d480bd4c6ce1024c0d87c6e475e27631b60cbe3531ef523ea271 not found: ID does not exist" Jul 05 12:20:42.089502 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.089472 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx"] Jul 05 12:20:42.095123 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.095097 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c2af4718-openshift-default-58cd89b759-cqxdx"] Jul 05 12:20:42.934794 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.934762 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:42.940187 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:42.940165 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:43.051357 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:43.051328 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:43.052217 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:43.052195 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:43.745756 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:43.745727 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901ee074-75e2-40e5-bcad-efb75e449671" path="/var/lib/kubelet/pods/901ee074-75e2-40e5-bcad-efb75e449671/volumes" Jul 05 12:20:46.615672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:46.615636 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5"] Jul 05 12:20:46.616148 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:46.615799 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" podUID="5cc3b073-3869-4469-914c-f3ffe51e91f4" containerName="istio-proxy" containerID="cri-o://e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543" gracePeriod=30 Jul 05 12:20:52.358434 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.358411 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:52.524360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524265 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-socket\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524315 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s94mr\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-kube-api-access-s94mr\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524347 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-envoy\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524367 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-podinfo\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524790 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524383 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-data\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524790 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-token\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524790 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524577 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-certs\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524790 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524584 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:52.524790 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524611 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc3b073-3869-4469-914c-f3ffe51e91f4-istiod-ca-cert\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.524790 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524648 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-credential-socket\") pod \"5cc3b073-3869-4469-914c-f3ffe51e91f4\" (UID: \"5cc3b073-3869-4469-914c-f3ffe51e91f4\") " Jul 05 12:20:52.525154 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.524795 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:52.525154 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.525030 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.525154 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.525081 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.525154 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.525114 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cc3b073-3869-4469-914c-f3ffe51e91f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:20:52.525330 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.525235 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:52.525426 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.525405 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:52.526612 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.526590 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:20:52.526701 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.526642 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:20:52.526958 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.526933 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:20:52.526958 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.526941 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-kube-api-access-s94mr" (OuterVolumeSpecName: "kube-api-access-s94mr") pod "5cc3b073-3869-4469-914c-f3ffe51e91f4" (UID: "5cc3b073-3869-4469-914c-f3ffe51e91f4"). InnerVolumeSpecName "kube-api-access-s94mr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:20:52.626301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626257 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s94mr\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-kube-api-access-s94mr\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.626301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626297 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.626301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626308 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.626301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626317 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.626551 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626325 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cc3b073-3869-4469-914c-f3ffe51e91f4-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.626551 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626332 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cc3b073-3869-4469-914c-f3ffe51e91f4-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:52.626551 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:52.626340 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cc3b073-3869-4469-914c-f3ffe51e91f4-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:20:53.105165 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.105132 2578 generic.go:356] "Generic (PLEG): container finished" podID="5cc3b073-3869-4469-914c-f3ffe51e91f4" containerID="e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543" exitCode=0 Jul 05 12:20:53.105346 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.105175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" event={"ID":"5cc3b073-3869-4469-914c-f3ffe51e91f4","Type":"ContainerDied","Data":"e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543"} Jul 05 12:20:53.105346 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.105183 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" Jul 05 12:20:53.105346 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.105219 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5" event={"ID":"5cc3b073-3869-4469-914c-f3ffe51e91f4","Type":"ContainerDied","Data":"e37215d7334e886f71e4e48b5679388925112ff5095f5c3df37aa71a759830b4"} Jul 05 12:20:53.105346 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.105239 2578 scope.go:117] "RemoveContainer" containerID="e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543" Jul 05 12:20:53.114314 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.114297 2578 scope.go:117] "RemoveContainer" containerID="e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543" Jul 05 12:20:53.114574 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:20:53.114558 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543\": container with ID starting with e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543 not found: ID does not exist" containerID="e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543" Jul 05 12:20:53.114629 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.114583 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543"} err="failed to get container status \"e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543\": rpc error: code = NotFound desc = could not find container \"e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543\": container with ID starting with e1e8de89caf433ac2dab31759ae1e53f4f165e33e193ddd761c9bd01ce51c543 not found: ID does not exist" Jul 05 12:20:53.126797 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.126773 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5"] Jul 05 12:20:53.130741 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.130719 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d0668d61-openshift-default-77c5654695-w9wp5"] Jul 05 12:20:53.745603 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:20:53.745569 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc3b073-3869-4469-914c-f3ffe51e91f4" path="/var/lib/kubelet/pods/5cc3b073-3869-4469-914c-f3ffe51e91f4/volumes" Jul 05 12:22:26.873004 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.872972 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77"] Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873369 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873381 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873388 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc3b073-3869-4469-914c-f3ffe51e91f4" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873394 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc3b073-3869-4469-914c-f3ffe51e91f4" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873406 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873411 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873471 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873479 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc3b073-3869-4469-914c-f3ffe51e91f4" containerName="istio-proxy" Jul 05 12:22:26.873501 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.873485 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="901ee074-75e2-40e5-bcad-efb75e449671" containerName="istio-proxy" Jul 05 12:22:26.876442 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.876426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.879007 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.878988 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e2215ed8-openshift-default-dockercfg-6l4wt\"" Jul 05 12:22:26.885869 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.885846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11863d94-886c-4317-8f7e-b1ccf3a9691e-istiod-ca-cert\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.885972 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.885902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-envoy\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.885972 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.885959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrls\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-kube-api-access-9vrls\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.886065 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.885989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-credential-socket\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.886065 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.886015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-certs\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.886141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.886073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-socket\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.886141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.886130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-token\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.886207 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.886155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-podinfo\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.886207 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.886191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-data\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.894121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.894091 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77"] Jul 05 12:22:26.987155 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrls\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-kube-api-access-9vrls\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987362 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-credential-socket\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987362 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-certs\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987362 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-socket\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987533 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-token\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987533 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-podinfo\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987533 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-data\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11863d94-886c-4317-8f7e-b1ccf3a9691e-istiod-ca-cert\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-envoy\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987672 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-credential-socket\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987812 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-socket\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987812 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-certs\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.987812 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.987805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-data\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.988363 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.988339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11863d94-886c-4317-8f7e-b1ccf3a9691e-istiod-ca-cert\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.989936 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.989910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-envoy\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.990218 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.990200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-podinfo\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.995577 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.995557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-token\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:26.995735 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:26.995711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrls\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-kube-api-access-9vrls\") pod \"e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:27.186324 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.186230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:27.319554 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.319530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77"] Jul 05 12:22:27.321577 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:22:27.321544 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11863d94_886c_4317_8f7e_b1ccf3a9691e.slice/crio-62d73d21b1a80900e7e7a5ddf21f17553180541120bb4a82b3a347a34304de95 WatchSource:0}: Error finding container 62d73d21b1a80900e7e7a5ddf21f17553180541120bb4a82b3a347a34304de95: Status 404 returned error can't find the container with id 62d73d21b1a80900e7e7a5ddf21f17553180541120bb4a82b3a347a34304de95 Jul 05 12:22:27.323509 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.323476 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:22:27.323609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.323542 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:22:27.323609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.323573 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:22:27.606283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.606252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" event={"ID":"11863d94-886c-4317-8f7e-b1ccf3a9691e","Type":"ContainerStarted","Data":"d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449"} Jul 05 12:22:27.606491 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.606316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" event={"ID":"11863d94-886c-4317-8f7e-b1ccf3a9691e","Type":"ContainerStarted","Data":"62d73d21b1a80900e7e7a5ddf21f17553180541120bb4a82b3a347a34304de95"} Jul 05 12:22:27.625647 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:27.625594 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" podStartSLOduration=1.625579504 podStartE2EDuration="1.625579504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:22:27.623624552 +0000 UTC m=+1726.362162069" watchObservedRunningTime="2026-07-05 12:22:27.625579504 +0000 UTC m=+1726.364117019" Jul 05 12:22:28.187259 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:28.187217 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:28.193036 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:28.193005 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:28.611282 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:28.611256 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:28.612035 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:28.612019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:42.685581 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:42.685554 2578 generic.go:356] "Generic (PLEG): container finished" podID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerID="d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449" exitCode=0 Jul 05 12:22:42.685947 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:42.685626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" event={"ID":"11863d94-886c-4317-8f7e-b1ccf3a9691e","Type":"ContainerDied","Data":"d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449"} Jul 05 12:22:42.686041 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:42.686026 2578 scope.go:117] "RemoveContainer" containerID="d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449" Jul 05 12:22:42.687163 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:42.687138 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:22:42.687236 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:42.687206 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:22:42.687277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:42.687238 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:22:43.611916 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:43.611881 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:43.693003 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:43.692966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" event={"ID":"11863d94-886c-4317-8f7e-b1ccf3a9691e","Type":"ContainerStarted","Data":"fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea"} Jul 05 12:22:44.187372 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:44.187336 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:44.188341 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:44.188321 2578 patch_prober.go:28] interesting pod/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 05 12:22:44.188409 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:44.188375 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 05 12:22:45.187430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:45.187393 2578 patch_prober.go:28] interesting pod/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 05 12:22:45.187798 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:45.187456 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 05 12:22:46.187439 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:46.187402 2578 patch_prober.go:28] interesting pod/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 05 12:22:46.187841 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:46.187459 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 05 12:22:47.186845 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:47.186812 2578 patch_prober.go:28] interesting pod/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 05 12:22:47.187042 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:47.186867 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 05 12:22:47.759586 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:47.759553 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77"] Jul 05 12:22:47.760078 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:47.759779 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" containerID="cri-o://fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea" gracePeriod=30 Jul 05 12:22:53.014002 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.013975 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:53.143945 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.143910 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-socket\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144158 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.143961 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11863d94-886c-4317-8f7e-b1ccf3a9691e-istiod-ca-cert\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144158 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.143996 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-credential-socket\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144158 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144035 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vrls\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-kube-api-access-9vrls\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144271 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144231 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-certs\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144320 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144294 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-token\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144377 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144330 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:22:53.144377 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-data\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144377 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144362 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:22:53.144536 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144388 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-podinfo\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144536 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144431 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-envoy\") pod \"11863d94-886c-4317-8f7e-b1ccf3a9691e\" (UID: \"11863d94-886c-4317-8f7e-b1ccf3a9691e\") " Jul 05 12:22:53.144637 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144542 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:22:53.144637 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144541 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11863d94-886c-4317-8f7e-b1ccf3a9691e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:22:53.144858 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144806 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.144858 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144839 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11863d94-886c-4317-8f7e-b1ccf3a9691e-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.144858 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144854 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.144996 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.144869 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.145360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.145337 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-data" (OuterVolumeSpecName: "istio-data") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:22:53.146416 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.146396 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:22:53.146574 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.146552 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-token" (OuterVolumeSpecName: "istio-token") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:22:53.146735 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.146715 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:22:53.146782 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.146743 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-kube-api-access-9vrls" (OuterVolumeSpecName: "kube-api-access-9vrls") pod "11863d94-886c-4317-8f7e-b1ccf3a9691e" (UID: "11863d94-886c-4317-8f7e-b1ccf3a9691e"). InnerVolumeSpecName "kube-api-access-9vrls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:22:53.245497 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.245459 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vrls\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-kube-api-access-9vrls\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.245497 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.245491 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.245497 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.245500 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.245497 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.245507 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.245754 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.245516 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11863d94-886c-4317-8f7e-b1ccf3a9691e-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:22:53.752288 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.752254 2578 generic.go:356] "Generic (PLEG): container finished" podID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerID="fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea" exitCode=0 Jul 05 12:22:53.752456 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.752309 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" Jul 05 12:22:53.752456 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.752334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" event={"ID":"11863d94-886c-4317-8f7e-b1ccf3a9691e","Type":"ContainerDied","Data":"fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea"} Jul 05 12:22:53.752456 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.752395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77" event={"ID":"11863d94-886c-4317-8f7e-b1ccf3a9691e","Type":"ContainerDied","Data":"62d73d21b1a80900e7e7a5ddf21f17553180541120bb4a82b3a347a34304de95"} Jul 05 12:22:53.752723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.752552 2578 scope.go:117] "RemoveContainer" containerID="fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea" Jul 05 12:22:53.769580 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.769557 2578 scope.go:117] "RemoveContainer" containerID="d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449" Jul 05 12:22:53.773335 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.773311 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77"] Jul 05 12:22:53.776989 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.776966 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e2215ed8-openshift-default-6cb7f76c47-tph77"] Jul 05 12:22:53.782109 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.782093 2578 scope.go:117] "RemoveContainer" containerID="fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea" Jul 05 12:22:53.782377 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:22:53.782359 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea\": container with ID starting with fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea not found: ID does not exist" containerID="fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea" Jul 05 12:22:53.782422 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.782387 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea"} err="failed to get container status \"fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea\": rpc error: code = NotFound desc = could not find container \"fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea\": container with ID starting with fa16161aee5bb8e30b331076b0dab33434d9ce9aeb67405790be799b272086ea not found: ID does not exist" Jul 05 12:22:53.782422 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.782405 2578 scope.go:117] "RemoveContainer" containerID="d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449" Jul 05 12:22:53.782636 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:22:53.782618 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449\": container with ID starting with d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449 not found: ID does not exist" containerID="d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449" Jul 05 12:22:53.782679 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:53.782643 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449"} err="failed to get container status \"d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449\": rpc error: code = NotFound desc = could not find container \"d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449\": container with ID starting with d7b5548eee5efb34b86ccd72487eca413d6a725d5eb522e9bbd5a1e266c0d449 not found: ID does not exist" Jul 05 12:22:55.745666 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:22:55.745629 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" path="/var/lib/kubelet/pods/11863d94-886c-4317-8f7e-b1ccf3a9691e/volumes" Jul 05 12:23:06.833724 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.833687 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx"] Jul 05 12:23:06.834267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.834139 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" Jul 05 12:23:06.834267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.834151 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" Jul 05 12:23:06.834267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.834172 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" Jul 05 12:23:06.834267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.834177 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" Jul 05 12:23:06.834267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.834233 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" Jul 05 12:23:06.834267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.834248 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11863d94-886c-4317-8f7e-b1ccf3a9691e" containerName="istio-proxy" Jul 05 12:23:06.837917 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.837895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.840379 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.840357 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c31da5f5-openshift-default-dockercfg-t7zkz\"" Jul 05 12:23:06.847301 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.847277 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx"] Jul 05 12:23:06.877635 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istiod-ca-cert\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.877635 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-data\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.877877 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-socket\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.877877 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dx8h\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-kube-api-access-6dx8h\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.877877 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-envoy\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.878000 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-credential-socket\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.878000 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-podinfo\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.878000 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-token\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.878000 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.877973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-certs\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978607 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-token\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978607 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-certs\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istiod-ca-cert\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-data\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-socket\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dx8h\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-kube-api-access-6dx8h\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-envoy\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-credential-socket\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.978861 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.978840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-podinfo\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.979252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.979077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-certs\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.979309 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.979245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-data\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.979309 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.979261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-socket\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.979417 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.979326 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-credential-socket\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.979469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.979434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istiod-ca-cert\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.981022 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.980997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-envoy\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.981315 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.981298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-podinfo\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.993548 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.993513 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-token\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:06.993714 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:06.993690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dx8h\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-kube-api-access-6dx8h\") pod \"e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:07.150011 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.149956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:07.289847 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.289821 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx"] Jul 05 12:23:07.291390 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:23:07.291365 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30aed90_92a9_4b0f_b114_fd3c9f900a23.slice/crio-6b8eaac354bc511304abd8ed4710e77fe709b74f264638ddb755454b86d0b199 WatchSource:0}: Error finding container 6b8eaac354bc511304abd8ed4710e77fe709b74f264638ddb755454b86d0b199: Status 404 returned error can't find the container with id 6b8eaac354bc511304abd8ed4710e77fe709b74f264638ddb755454b86d0b199 Jul 05 12:23:07.293451 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.293422 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:23:07.293532 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.293490 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:23:07.293532 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.293519 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:23:07.829412 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.829374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" event={"ID":"e30aed90-92a9-4b0f-b114-fd3c9f900a23","Type":"ContainerStarted","Data":"b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5"} Jul 05 12:23:07.829735 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.829440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" event={"ID":"e30aed90-92a9-4b0f-b114-fd3c9f900a23","Type":"ContainerStarted","Data":"6b8eaac354bc511304abd8ed4710e77fe709b74f264638ddb755454b86d0b199"} Jul 05 12:23:07.849942 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:07.849882 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" podStartSLOduration=1.849863241 podStartE2EDuration="1.849863241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:23:07.849038558 +0000 UTC m=+1766.587576092" watchObservedRunningTime="2026-07-05 12:23:07.849863241 +0000 UTC m=+1766.588400770" Jul 05 12:23:08.151235 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:08.151195 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:08.156281 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:08.156251 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:08.835065 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:08.835021 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:08.835976 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:08.835956 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:22.918411 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:22.918366 2578 generic.go:356] "Generic (PLEG): container finished" podID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerID="b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5" exitCode=0 Jul 05 12:23:22.918868 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:22.918440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" event={"ID":"e30aed90-92a9-4b0f-b114-fd3c9f900a23","Type":"ContainerDied","Data":"b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5"} Jul 05 12:23:22.918868 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:22.918855 2578 scope.go:117] "RemoveContainer" containerID="b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5" Jul 05 12:23:22.919922 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:22.919890 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:23:22.919981 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:22.919958 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:23:22.920020 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:22.919988 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:23:23.835070 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:23.835015 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:23.928513 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:23.928466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" event={"ID":"e30aed90-92a9-4b0f-b114-fd3c9f900a23","Type":"ContainerStarted","Data":"d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f"} Jul 05 12:23:24.150140 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:24.150099 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:24.151248 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:24.151221 2578 patch_prober.go:28] interesting pod/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 05 12:23:24.151368 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:24.151271 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 05 12:23:25.150761 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:25.150723 2578 patch_prober.go:28] interesting pod/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 05 12:23:25.151194 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:25.150786 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 05 12:23:26.151089 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:26.151035 2578 patch_prober.go:28] interesting pod/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 05 12:23:26.151492 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:26.151112 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 05 12:23:27.150583 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:27.150549 2578 patch_prober.go:28] interesting pod/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 05 12:23:27.150767 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:27.150603 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 05 12:23:28.154850 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:28.154818 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:28.155276 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:28.155087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:23:28.155755 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:23:28.155734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:24:35.412086 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:35.411990 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx"] Jul 05 12:24:35.412741 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:35.412338 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" containerID="cri-o://d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f" gracePeriod=30 Jul 05 12:24:40.681380 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.681317 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:24:40.778376 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778346 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-data\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778578 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778419 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dx8h\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-kube-api-access-6dx8h\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778578 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-token\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778578 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778485 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-podinfo\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778578 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778505 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-certs\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778578 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778578 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istiod-ca-cert\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778602 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-envoy\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778628 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-socket\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.778855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778662 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-credential-socket\") pod \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\" (UID: \"e30aed90-92a9-4b0f-b114-fd3c9f900a23\") " Jul 05 12:24:40.779001 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778973 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:24:40.779001 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.778987 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:24:40.779273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.779251 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-data" (OuterVolumeSpecName: "istio-data") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:24:40.779353 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.779273 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:24:40.779513 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.779485 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:24:40.780702 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.780672 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-token" (OuterVolumeSpecName: "istio-token") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:24:40.780810 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.780728 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-kube-api-access-6dx8h" (OuterVolumeSpecName: "kube-api-access-6dx8h") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "kube-api-access-6dx8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:24:40.780810 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.780740 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:24:40.781117 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.781100 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e30aed90-92a9-4b0f-b114-fd3c9f900a23" (UID: "e30aed90-92a9-4b0f-b114-fd3c9f900a23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:24:40.879521 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879491 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879521 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879518 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879521 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879526 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879764 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879535 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879764 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879542 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879764 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879550 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879764 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879558 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879764 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879568 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e30aed90-92a9-4b0f-b114-fd3c9f900a23-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:40.879764 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:40.879577 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dx8h\" (UniqueName: \"kubernetes.io/projected/e30aed90-92a9-4b0f-b114-fd3c9f900a23-kube-api-access-6dx8h\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:24:41.375423 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.375389 2578 generic.go:356] "Generic (PLEG): container finished" podID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerID="d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f" exitCode=0 Jul 05 12:24:41.375606 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.375452 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" Jul 05 12:24:41.375606 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.375466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" event={"ID":"e30aed90-92a9-4b0f-b114-fd3c9f900a23","Type":"ContainerDied","Data":"d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f"} Jul 05 12:24:41.375606 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.375519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx" event={"ID":"e30aed90-92a9-4b0f-b114-fd3c9f900a23","Type":"ContainerDied","Data":"6b8eaac354bc511304abd8ed4710e77fe709b74f264638ddb755454b86d0b199"} Jul 05 12:24:41.375606 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.375541 2578 scope.go:117] "RemoveContainer" containerID="d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f" Jul 05 12:24:41.384858 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.384841 2578 scope.go:117] "RemoveContainer" containerID="b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5" Jul 05 12:24:41.392888 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.392867 2578 scope.go:117] "RemoveContainer" containerID="d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f" Jul 05 12:24:41.393147 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:24:41.393129 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f\": container with ID starting with d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f not found: ID does not exist" containerID="d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f" Jul 05 12:24:41.393223 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.393155 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f"} err="failed to get container status \"d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f\": rpc error: code = NotFound desc = could not find container \"d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f\": container with ID starting with d0201eb4db09967616067d11780d30fb7870f8ecec7313f6eda2ea9c34ec879f not found: ID does not exist" Jul 05 12:24:41.393223 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.393172 2578 scope.go:117] "RemoveContainer" containerID="b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5" Jul 05 12:24:41.393408 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:24:41.393391 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5\": container with ID starting with b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5 not found: ID does not exist" containerID="b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5" Jul 05 12:24:41.393456 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.393414 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5"} err="failed to get container status \"b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5\": rpc error: code = NotFound desc = could not find container \"b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5\": container with ID starting with b99ea60117139f9a01f4a45379b302936c286607dcff7bb3f756521f8f5881e5 not found: ID does not exist" Jul 05 12:24:41.397534 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.397516 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx"] Jul 05 12:24:41.401305 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.401285 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c31da5f5-openshift-default-6b665b9c99-ptbfx"] Jul 05 12:24:41.746622 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:24:41.746543 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" path="/var/lib/kubelet/pods/e30aed90-92a9-4b0f-b114-fd3c9f900a23/volumes" Jul 05 12:25:30.013734 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.013698 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7"] Jul 05 12:25:30.014277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.014136 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" Jul 05 12:25:30.014277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.014148 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" Jul 05 12:25:30.014277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.014160 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" Jul 05 12:25:30.014277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.014166 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" Jul 05 12:25:30.014277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.014217 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" Jul 05 12:25:30.014277 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.014224 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30aed90-92a9-4b0f-b114-fd3c9f900a23" containerName="istio-proxy" Jul 05 12:25:30.017283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.017261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.019634 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.019615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1d2467-openshift-default-dockercfg-jspx8\"" Jul 05 12:25:30.028774 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.028753 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7"] Jul 05 12:25:30.138373 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-credential-socket\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-istio-token\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-envoy\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c10aac22-925a-46ee-b301-fb3157afec6f-istiod-ca-cert\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-data\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-socket\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138582 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c10aac22-925a-46ee-b301-fb3157afec6f-istio-podinfo\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138862 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf56d\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-kube-api-access-sf56d\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.138862 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.138616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-certs\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239200 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-credential-socket\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-istio-token\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-envoy\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c10aac22-925a-46ee-b301-fb3157afec6f-istiod-ca-cert\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-data\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-socket\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c10aac22-925a-46ee-b301-fb3157afec6f-istio-podinfo\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf56d\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-kube-api-access-sf56d\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239405 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-certs\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-credential-socket\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-data\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-socket\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.239964 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.239948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-certs\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.240159 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.240139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c10aac22-925a-46ee-b301-fb3157afec6f-istiod-ca-cert\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.242159 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.242131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-envoy\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.242317 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.242299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c10aac22-925a-46ee-b301-fb3157afec6f-istio-podinfo\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.246869 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.246842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-istio-token\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.246973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.246936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf56d\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-kube-api-access-sf56d\") pod \"e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.329092 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.328983 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:30.464726 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.464695 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7"] Jul 05 12:25:30.466521 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:25:30.466495 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10aac22_925a_46ee_b301_fb3157afec6f.slice/crio-aedb2c052175d33a70b15d3d7150526f8f2af1b70f6ecd0f091de2777e3f589f WatchSource:0}: Error finding container aedb2c052175d33a70b15d3d7150526f8f2af1b70f6ecd0f091de2777e3f589f: Status 404 returned error can't find the container with id aedb2c052175d33a70b15d3d7150526f8f2af1b70f6ecd0f091de2777e3f589f Jul 05 12:25:30.468775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.468748 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:30.468866 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.468817 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:30.468904 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.468864 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:30.632583 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.632544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" event={"ID":"c10aac22-925a-46ee-b301-fb3157afec6f","Type":"ContainerStarted","Data":"eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e"} Jul 05 12:25:30.632791 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.632602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" event={"ID":"c10aac22-925a-46ee-b301-fb3157afec6f","Type":"ContainerStarted","Data":"aedb2c052175d33a70b15d3d7150526f8f2af1b70f6ecd0f091de2777e3f589f"} Jul 05 12:25:30.652318 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:30.652264 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podStartSLOduration=1.652248685 podStartE2EDuration="1.652248685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:25:30.6496163 +0000 UTC m=+1909.388153851" watchObservedRunningTime="2026-07-05 12:25:30.652248685 +0000 UTC m=+1909.390786200" Jul 05 12:25:31.329209 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:31.329170 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:31.334091 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:31.334068 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:31.637829 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:31.637798 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:31.638786 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:31.638766 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:37.914742 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:37.914708 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5"] Jul 05 12:25:37.918666 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:37.918644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:37.929446 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:37.929415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-40cd04-openshift-default-dockercfg-zjpsl\"" Jul 05 12:25:37.946139 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:37.946105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5"] Jul 05 12:25:38.019079 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-credential-socket\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019079 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-podinfo\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-socket\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-certs\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-data\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46cf662-9a58-48a5-80c9-39b2cac0a511-istiod-ca-cert\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019416 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfbhp\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-kube-api-access-qfbhp\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019416 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-token\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.019482 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.019442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-envoy\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.120383 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.120338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-socket\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.121143 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-certs\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.121332 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-data\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.121455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46cf662-9a58-48a5-80c9-39b2cac0a511-istiod-ca-cert\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.121587 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfbhp\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-kube-api-access-qfbhp\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.121743 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-token\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.121869 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-envoy\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.122094 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.122039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-credential-socket\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.123693 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.123675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-podinfo\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.123881 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.121029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-socket\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.123981 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.122746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-data\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.124095 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.123001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-credential-socket\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.124178 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.123621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46cf662-9a58-48a5-80c9-39b2cac0a511-istiod-ca-cert\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.124265 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.122494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-certs\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.125486 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.125467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-envoy\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.138112 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.138074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-podinfo\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.157177 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.157141 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfbhp\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-kube-api-access-qfbhp\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.158581 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.157849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-token\") pod \"e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.255434 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.255338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:38.418086 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.418061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5"] Jul 05 12:25:38.419097 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:25:38.419070 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46cf662_9a58_48a5_80c9_39b2cac0a511.slice/crio-de4e25146578d487597e3ff403cba926eb6019c1ca0ddbf926c5aa9ee447b04a WatchSource:0}: Error finding container de4e25146578d487597e3ff403cba926eb6019c1ca0ddbf926c5aa9ee447b04a: Status 404 returned error can't find the container with id de4e25146578d487597e3ff403cba926eb6019c1ca0ddbf926c5aa9ee447b04a Jul 05 12:25:38.445657 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.445597 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:38.445804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.445704 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:38.445804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.445748 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:38.678284 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.678244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" event={"ID":"a46cf662-9a58-48a5-80c9-39b2cac0a511","Type":"ContainerStarted","Data":"55ccf1326da8e55ef2cdfff13ea4ba2c4572c17a24a4e7cbd3e6cd2009a2ae1c"} Jul 05 12:25:38.678543 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.678311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" event={"ID":"a46cf662-9a58-48a5-80c9-39b2cac0a511","Type":"ContainerStarted","Data":"de4e25146578d487597e3ff403cba926eb6019c1ca0ddbf926c5aa9ee447b04a"} Jul 05 12:25:38.697627 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:38.697564 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podStartSLOduration=1.6975430120000001 podStartE2EDuration="1.697543012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:25:38.696551424 +0000 UTC m=+1917.435088951" watchObservedRunningTime="2026-07-05 12:25:38.697543012 +0000 UTC m=+1917.436080530" Jul 05 12:25:39.255559 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:39.255518 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:39.260444 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:39.260414 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:39.683219 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:39.683183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:39.684121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:39.684105 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:44.716007 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:44.715923 2578 generic.go:356] "Generic (PLEG): container finished" podID="c10aac22-925a-46ee-b301-fb3157afec6f" containerID="eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e" exitCode=0 Jul 05 12:25:44.716007 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:44.715994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" event={"ID":"c10aac22-925a-46ee-b301-fb3157afec6f","Type":"ContainerDied","Data":"eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e"} Jul 05 12:25:44.716451 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:44.716411 2578 scope.go:117] "RemoveContainer" containerID="eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e" Jul 05 12:25:44.717544 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:44.717516 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:44.717612 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:44.717585 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:44.717650 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:44.717622 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:45.722899 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:45.722870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" event={"ID":"c10aac22-925a-46ee-b301-fb3157afec6f","Type":"ContainerStarted","Data":"dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85"} Jul 05 12:25:46.330245 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:46.330184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:46.331635 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:46.331599 2578 patch_prober.go:28] interesting pod/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 05 12:25:46.331781 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:46.331669 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 05 12:25:46.639491 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:46.639448 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:47.329637 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:47.329599 2578 patch_prober.go:28] interesting pod/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 05 12:25:47.330297 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:47.330265 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 05 12:25:48.329938 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:48.329892 2578 patch_prober.go:28] interesting pod/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 05 12:25:48.330484 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:48.329997 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 05 12:25:49.329455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:49.329416 2578 patch_prober.go:28] interesting pod/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 05 12:25:49.329988 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:49.329956 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 05 12:25:50.339589 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:50.339549 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:50.345536 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:50.345472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:25:55.725237 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:55.725197 2578 patch_prober.go:28] interesting pod/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 05 12:25:55.725624 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:55.725282 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 05 12:25:56.802523 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:56.802435 2578 generic.go:356] "Generic (PLEG): container finished" podID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerID="55ccf1326da8e55ef2cdfff13ea4ba2c4572c17a24a4e7cbd3e6cd2009a2ae1c" exitCode=0 Jul 05 12:25:56.802523 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:56.802506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" event={"ID":"a46cf662-9a58-48a5-80c9-39b2cac0a511","Type":"ContainerDied","Data":"55ccf1326da8e55ef2cdfff13ea4ba2c4572c17a24a4e7cbd3e6cd2009a2ae1c"} Jul 05 12:25:56.802953 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:56.802900 2578 scope.go:117] "RemoveContainer" containerID="55ccf1326da8e55ef2cdfff13ea4ba2c4572c17a24a4e7cbd3e6cd2009a2ae1c" Jul 05 12:25:56.803860 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:56.803837 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:56.803916 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:56.803900 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:56.803956 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:56.803945 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:25:57.809810 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:57.809771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" event={"ID":"a46cf662-9a58-48a5-80c9-39b2cac0a511","Type":"ContainerStarted","Data":"6ff65e10cf4d9a170322760735f4a8ba2d525ef39d50710ed525ff8febf8b231"} Jul 05 12:25:58.256073 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:58.256002 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:25:58.256302 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:58.256276 2578 patch_prober.go:28] interesting pod/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 05 12:25:58.256377 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:58.256338 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 05 12:25:59.256771 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:59.256735 2578 patch_prober.go:28] interesting pod/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 05 12:25:59.257260 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:25:59.256800 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 05 12:26:00.256021 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:00.255981 2578 patch_prober.go:28] interesting pod/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 05 12:26:00.256275 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:00.256043 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 05 12:26:01.256609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:01.256576 2578 patch_prober.go:28] interesting pod/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Jul 05 12:26:01.257135 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:01.256629 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Jul 05 12:26:02.259522 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:02.259491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:26:02.259895 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:02.259857 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:26:02.260606 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:26:02.260585 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:27:32.807005 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:32.806971 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7"] Jul 05 12:27:32.807555 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:32.807244 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" containerID="cri-o://dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85" gracePeriod=30 Jul 05 12:27:35.342829 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:35.342790 2578 patch_prober.go:28] interesting pod/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 12:27:35.343241 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:35.342859 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 12:27:38.077016 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.076947 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:27:38.193516 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193473 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-socket\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193682 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193541 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c10aac22-925a-46ee-b301-fb3157afec6f-istio-podinfo\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193682 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193563 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-data\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193682 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193585 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-credential-socket\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193682 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193614 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-istio-token\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193682 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193645 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c10aac22-925a-46ee-b301-fb3157afec6f-istiod-ca-cert\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193966 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193696 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-certs\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193966 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193722 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf56d\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-kube-api-access-sf56d\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193966 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193746 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-envoy\") pod \"c10aac22-925a-46ee-b301-fb3157afec6f\" (UID: \"c10aac22-925a-46ee-b301-fb3157afec6f\") " Jul 05 12:27:38.193966 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193822 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:38.194228 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.193994 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:38.194228 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.194134 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.194228 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.194152 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.194228 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.194174 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10aac22-925a-46ee-b301-fb3157afec6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:27:38.194428 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.194355 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:38.194759 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.194727 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:38.195934 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.195900 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c10aac22-925a-46ee-b301-fb3157afec6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:27:38.195934 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.195915 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:27:38.196177 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.195965 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-kube-api-access-sf56d" (OuterVolumeSpecName: "kube-api-access-sf56d") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "kube-api-access-sf56d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:27:38.196177 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.196001 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c10aac22-925a-46ee-b301-fb3157afec6f" (UID: "c10aac22-925a-46ee-b301-fb3157afec6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:38.294804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294767 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.294804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294795 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c10aac22-925a-46ee-b301-fb3157afec6f-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.294804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294803 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.294804 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294811 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf56d\" (UniqueName: \"kubernetes.io/projected/c10aac22-925a-46ee-b301-fb3157afec6f-kube-api-access-sf56d\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.295103 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294820 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.295103 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294829 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c10aac22-925a-46ee-b301-fb3157afec6f-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.295103 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.294841 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c10aac22-925a-46ee-b301-fb3157afec6f-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:38.369141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.369107 2578 generic.go:356] "Generic (PLEG): container finished" podID="c10aac22-925a-46ee-b301-fb3157afec6f" containerID="dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85" exitCode=0 Jul 05 12:27:38.369320 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.369170 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" Jul 05 12:27:38.369320 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.369196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" event={"ID":"c10aac22-925a-46ee-b301-fb3157afec6f","Type":"ContainerDied","Data":"dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85"} Jul 05 12:27:38.369320 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.369274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7" event={"ID":"c10aac22-925a-46ee-b301-fb3157afec6f","Type":"ContainerDied","Data":"aedb2c052175d33a70b15d3d7150526f8f2af1b70f6ecd0f091de2777e3f589f"} Jul 05 12:27:38.369320 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.369298 2578 scope.go:117] "RemoveContainer" containerID="dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85" Jul 05 12:27:38.379247 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.379231 2578 scope.go:117] "RemoveContainer" containerID="eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e" Jul 05 12:27:38.387782 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.387764 2578 scope.go:117] "RemoveContainer" containerID="dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85" Jul 05 12:27:38.388086 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:27:38.388065 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85\": container with ID starting with dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85 not found: ID does not exist" containerID="dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85" Jul 05 12:27:38.388141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.388099 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85"} err="failed to get container status \"dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85\": rpc error: code = NotFound desc = could not find container \"dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85\": container with ID starting with dcc29191088c386978c34ab9a31a38a6cbf995e2f0e82207013d29efaa245f85 not found: ID does not exist" Jul 05 12:27:38.388141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.388116 2578 scope.go:117] "RemoveContainer" containerID="eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e" Jul 05 12:27:38.388355 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:27:38.388332 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e\": container with ID starting with eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e not found: ID does not exist" containerID="eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e" Jul 05 12:27:38.388419 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.388362 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e"} err="failed to get container status \"eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e\": rpc error: code = NotFound desc = could not find container \"eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e\": container with ID starting with eda2f58ab6ebae3fb18343da374f9d1ed6d9c2f07003bf122c24a8ff5dbadf7e not found: ID does not exist" Jul 05 12:27:38.392128 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.392105 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7"] Jul 05 12:27:38.396350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:38.396330 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1d2467-openshift-default-7d6b644749-c6lh7"] Jul 05 12:27:39.747242 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:39.747199 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" path="/var/lib/kubelet/pods/c10aac22-925a-46ee-b301-fb3157afec6f/volumes" Jul 05 12:27:40.199437 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:40.199405 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5"] Jul 05 12:27:40.199667 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:40.199630 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" containerID="cri-o://6ff65e10cf4d9a170322760735f4a8ba2d525ef39d50710ed525ff8febf8b231" gracePeriod=30 Jul 05 12:27:41.111185 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111149 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7"] Jul 05 12:27:41.111731 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111707 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" Jul 05 12:27:41.111731 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111731 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" Jul 05 12:27:41.111896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111746 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" Jul 05 12:27:41.111896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111757 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" Jul 05 12:27:41.111896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111870 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" Jul 05 12:27:41.111896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.111882 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10aac22-925a-46ee-b301-fb3157afec6f" containerName="istio-proxy" Jul 05 12:27:41.116577 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.116558 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.118951 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.118929 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c25ded-openshift-default-dockercfg-gqkx7\"" Jul 05 12:27:41.126381 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.126351 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7"] Jul 05 12:27:41.224281 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-podinfo\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224281 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-credential-socket\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224562 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istiod-ca-cert\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224562 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-certs\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224562 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-envoy\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224562 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-data\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224562 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-socket\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224796 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6zq\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-kube-api-access-6k6zq\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.224796 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.224629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-token\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.325951 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.325915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-certs\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.325951 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.325950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-envoy\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.325969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-data\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-socket\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6zq\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-kube-api-access-6k6zq\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326239 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-token\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-podinfo\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-credential-socket\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-certs\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istiod-ca-cert\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326455 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-data\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326721 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-socket\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326721 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-credential-socket\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.326998 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.326975 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istiod-ca-cert\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.328272 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.328255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-envoy\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.328774 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.328755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-podinfo\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.334180 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.334158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-token\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.334615 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.334593 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6zq\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-kube-api-access-6k6zq\") pod \"e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.429027 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.428940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:41.590510 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.590482 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7"] Jul 05 12:27:41.592221 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:27:41.592193 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f5b28d_0d6e_4805_bdb9_36acb6bb3c46.slice/crio-2fd6c760e414ba6ef4ab975ba7dd3eff32d286393e0d139bfc197b9f8aff4d84 WatchSource:0}: Error finding container 2fd6c760e414ba6ef4ab975ba7dd3eff32d286393e0d139bfc197b9f8aff4d84: Status 404 returned error can't find the container with id 2fd6c760e414ba6ef4ab975ba7dd3eff32d286393e0d139bfc197b9f8aff4d84 Jul 05 12:27:41.594326 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.594298 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:41.594432 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.594359 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:41.594432 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:41.594389 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:42.393860 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:42.393818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" event={"ID":"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46","Type":"ContainerStarted","Data":"537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6"} Jul 05 12:27:42.394299 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:42.393910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" event={"ID":"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46","Type":"ContainerStarted","Data":"2fd6c760e414ba6ef4ab975ba7dd3eff32d286393e0d139bfc197b9f8aff4d84"} Jul 05 12:27:42.414812 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:42.414763 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" podStartSLOduration=1.414748356 podStartE2EDuration="1.414748356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:27:42.413405406 +0000 UTC m=+2041.151942924" watchObservedRunningTime="2026-07-05 12:27:42.414748356 +0000 UTC m=+2041.153285873" Jul 05 12:27:42.429283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:42.429246 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:42.434343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:42.434316 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:43.399688 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:43.399658 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:43.400593 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:43.400576 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:27:45.414274 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.414244 2578 generic.go:356] "Generic (PLEG): container finished" podID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerID="6ff65e10cf4d9a170322760735f4a8ba2d525ef39d50710ed525ff8febf8b231" exitCode=0 Jul 05 12:27:45.414655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.414316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" event={"ID":"a46cf662-9a58-48a5-80c9-39b2cac0a511","Type":"ContainerDied","Data":"6ff65e10cf4d9a170322760735f4a8ba2d525ef39d50710ed525ff8febf8b231"} Jul 05 12:27:45.414655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.414376 2578 scope.go:117] "RemoveContainer" containerID="55ccf1326da8e55ef2cdfff13ea4ba2c4572c17a24a4e7cbd3e6cd2009a2ae1c" Jul 05 12:27:45.462904 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.462843 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:27:45.569967 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.569935 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfbhp\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-kube-api-access-qfbhp\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570148 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.569986 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-data\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570148 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570021 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-token\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570148 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570077 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-podinfo\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570148 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570114 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-credential-socket\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570400 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-certs\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570400 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570197 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-socket\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570400 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570238 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46cf662-9a58-48a5-80c9-39b2cac0a511-istiod-ca-cert\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570400 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570308 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-envoy\") pod \"a46cf662-9a58-48a5-80c9-39b2cac0a511\" (UID: \"a46cf662-9a58-48a5-80c9-39b2cac0a511\") " Jul 05 12:27:45.570611 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570414 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:45.570611 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570511 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:45.570829 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570808 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.570898 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570833 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.570966 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570944 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:45.571038 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.570999 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46cf662-9a58-48a5-80c9-39b2cac0a511-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:27:45.571167 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.571079 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-data" (OuterVolumeSpecName: "istio-data") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:45.572360 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.572330 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-token" (OuterVolumeSpecName: "istio-token") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:27:45.572469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.572416 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-kube-api-access-qfbhp" (OuterVolumeSpecName: "kube-api-access-qfbhp") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "kube-api-access-qfbhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:27:45.572606 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.572588 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:27:45.573024 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.573005 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a46cf662-9a58-48a5-80c9-39b2cac0a511" (UID: "a46cf662-9a58-48a5-80c9-39b2cac0a511"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:27:45.672163 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672130 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a46cf662-9a58-48a5-80c9-39b2cac0a511-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.672163 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672158 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.672163 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672169 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfbhp\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-kube-api-access-qfbhp\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.672406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672180 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.672406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672189 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.672406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672199 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a46cf662-9a58-48a5-80c9-39b2cac0a511-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:45.672406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:45.672207 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a46cf662-9a58-48a5-80c9-39b2cac0a511-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:27:46.420727 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:46.420694 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" Jul 05 12:27:46.421170 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:46.420724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5" event={"ID":"a46cf662-9a58-48a5-80c9-39b2cac0a511","Type":"ContainerDied","Data":"de4e25146578d487597e3ff403cba926eb6019c1ca0ddbf926c5aa9ee447b04a"} Jul 05 12:27:46.421170 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:46.420778 2578 scope.go:117] "RemoveContainer" containerID="6ff65e10cf4d9a170322760735f4a8ba2d525ef39d50710ed525ff8febf8b231" Jul 05 12:27:46.439188 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:46.439162 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5"] Jul 05 12:27:46.442777 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:46.442755 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-40cd04-openshift-default-647459fcf7-6pwm5"] Jul 05 12:27:47.746112 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:47.746043 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" path="/var/lib/kubelet/pods/a46cf662-9a58-48a5-80c9-39b2cac0a511/volumes" Jul 05 12:27:49.786824 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.786788 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9"] Jul 05 12:27:49.787457 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.787437 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" Jul 05 12:27:49.787548 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.787460 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" Jul 05 12:27:49.787548 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.787489 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" Jul 05 12:27:49.787548 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.787500 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" Jul 05 12:27:49.787705 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.787589 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" Jul 05 12:27:49.787705 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.787604 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46cf662-9a58-48a5-80c9-39b2cac0a511" containerName="istio-proxy" Jul 05 12:27:49.790967 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.790947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.794579 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.794553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-96ff9c-openshift-default-dockercfg-gw8j4\"" Jul 05 12:27:49.803377 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.803349 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9"] Jul 05 12:27:49.808481 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-token\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808616 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istiod-ca-cert\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808616 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-data\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808616 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-envoy\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808616 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgjdg\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-kube-api-access-sgjdg\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808616 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-podinfo\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-socket\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-credential-socket\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.808889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.808695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-certs\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910156 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-token\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istiod-ca-cert\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-data\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-envoy\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgjdg\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-kube-api-access-sgjdg\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910351 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-podinfo\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910628 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-socket\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910628 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-credential-socket\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910628 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-certs\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.910987 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.910961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-certs\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.911283 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.911166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istiod-ca-cert\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.911720 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.911665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-credential-socket\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.911832 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.911740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-data\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.911999 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.911970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-socket\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.913655 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.913635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-envoy\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.914980 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.914956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-podinfo\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.919253 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.919229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgjdg\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-kube-api-access-sgjdg\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:49.919368 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:49.919352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-token\") pod \"e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:50.102910 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.102879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:50.242834 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.242807 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9"] Jul 05 12:27:50.244237 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:27:50.244208 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14dac09_cef3_4cd4_9ac8_cb6f14c149ae.slice/crio-c2beee4e484cb1d61cd96259590219426e591bfabae10d989257c3d94b849a34 WatchSource:0}: Error finding container c2beee4e484cb1d61cd96259590219426e591bfabae10d989257c3d94b849a34: Status 404 returned error can't find the container with id c2beee4e484cb1d61cd96259590219426e591bfabae10d989257c3d94b849a34 Jul 05 12:27:50.246310 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.246280 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:50.246415 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.246358 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:50.246415 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.246406 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:50.446653 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.446551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" event={"ID":"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae","Type":"ContainerStarted","Data":"a45afd3e9e363774141b97c8298697c6252514bb9e24559df4f6048c846ea74c"} Jul 05 12:27:50.446653 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.446624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" event={"ID":"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae","Type":"ContainerStarted","Data":"c2beee4e484cb1d61cd96259590219426e591bfabae10d989257c3d94b849a34"} Jul 05 12:27:50.464697 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:50.464636 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" podStartSLOduration=1.464615787 podStartE2EDuration="1.464615787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:27:50.46427153 +0000 UTC m=+2049.202809065" watchObservedRunningTime="2026-07-05 12:27:50.464615787 +0000 UTC m=+2049.203153305" Jul 05 12:27:51.103825 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:51.103787 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:51.108899 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:51.108874 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:51.452563 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:51.452481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:51.453682 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:51.453648 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:27:58.401101 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.401066 2578 patch_prober.go:28] interesting pod/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 05 12:27:58.401554 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.401131 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 05 12:27:58.494338 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.494307 2578 generic.go:356] "Generic (PLEG): container finished" podID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerID="537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6" exitCode=0 Jul 05 12:27:58.494526 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.494371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" event={"ID":"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46","Type":"ContainerDied","Data":"537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6"} Jul 05 12:27:58.494770 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.494752 2578 scope.go:117] "RemoveContainer" containerID="537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6" Jul 05 12:27:58.495851 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.495824 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:58.495913 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.495894 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:58.495952 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:58.495927 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:27:59.501784 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:27:59.501742 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" event={"ID":"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46","Type":"ContainerStarted","Data":"2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767"} Jul 05 12:28:00.434074 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:00.432448 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:28:00.434074 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:00.432578 2578 patch_prober.go:28] interesting pod/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 05 12:28:00.434074 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:00.432655 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 05 12:28:01.430015 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:01.429979 2578 patch_prober.go:28] interesting pod/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 05 12:28:01.430643 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:01.430608 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 05 12:28:02.430465 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:02.430425 2578 patch_prober.go:28] interesting pod/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jul 05 12:28:02.431092 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:02.431037 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jul 05 12:28:03.433384 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:03.433305 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:28:03.433822 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:03.433763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:28:03.434671 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:03.434653 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:28:04.538472 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:04.538368 2578 generic.go:356] "Generic (PLEG): container finished" podID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerID="a45afd3e9e363774141b97c8298697c6252514bb9e24559df4f6048c846ea74c" exitCode=0 Jul 05 12:28:04.538472 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:04.538446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" event={"ID":"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae","Type":"ContainerDied","Data":"a45afd3e9e363774141b97c8298697c6252514bb9e24559df4f6048c846ea74c"} Jul 05 12:28:04.539263 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:04.538967 2578 scope.go:117] "RemoveContainer" containerID="a45afd3e9e363774141b97c8298697c6252514bb9e24559df4f6048c846ea74c" Jul 05 12:28:04.540107 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:04.540078 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:04.540213 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:04.540164 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:04.540213 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:04.540200 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:05.550631 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:05.550585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" event={"ID":"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae","Type":"ContainerStarted","Data":"eff8210e9f16cdf20c8087995a354fcbc7849b3f6d9ba12c7eda6851d895d4fe"} Jul 05 12:28:06.103759 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:06.103729 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:28:06.104692 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:06.104665 2578 patch_prober.go:28] interesting pod/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 05 12:28:06.104825 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:06.104715 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 05 12:28:06.453477 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:06.453368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:28:07.104209 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:07.104175 2578 patch_prober.go:28] interesting pod/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 05 12:28:07.104589 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:07.104229 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 05 12:28:08.103827 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:08.103790 2578 patch_prober.go:28] interesting pod/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 05 12:28:08.104008 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:08.103848 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 05 12:28:09.104115 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:09.104079 2578 patch_prober.go:28] interesting pod/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 05 12:28:09.104499 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:09.104132 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 05 12:28:10.107853 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:10.107812 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:28:10.108845 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:10.108823 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:28:11.585074 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:11.585024 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7"] Jul 05 12:28:11.585517 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:11.585253 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" containerID="cri-o://2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767" gracePeriod=30 Jul 05 12:28:16.868948 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.868920 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:28:16.987016 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.986975 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-token\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987255 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-envoy\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987255 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987105 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k6zq\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-kube-api-access-6k6zq\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987255 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987167 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-podinfo\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987255 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987222 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istiod-ca-cert\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987496 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987270 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-credential-socket\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987496 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987322 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-certs\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987496 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-data\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987496 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987386 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-socket\") pod \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\" (UID: \"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46\") " Jul 05 12:28:16.987693 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987573 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:16.987693 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987615 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:28:16.987831 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987804 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:16.987831 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987818 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:16.987952 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987865 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:16.987952 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.987885 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:16.988425 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.988406 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-data" (OuterVolumeSpecName: "istio-data") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:16.989365 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.989344 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-kube-api-access-6k6zq" (OuterVolumeSpecName: "kube-api-access-6k6zq") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "kube-api-access-6k6zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:28:16.989458 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.989368 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:16.989520 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.989494 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-token" (OuterVolumeSpecName: "istio-token") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:28:16.989589 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:16.989567 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" (UID: "99f5b28d-0d6e-4805-bdb9-36acb6bb3c46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:28:17.088557 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088521 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.088557 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088550 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.088557 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088560 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.088803 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088567 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.088803 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088577 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.088803 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088585 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.088803 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.088592 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k6zq\" (UniqueName: \"kubernetes.io/projected/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46-kube-api-access-6k6zq\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:17.620242 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.620206 2578 generic.go:356] "Generic (PLEG): container finished" podID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerID="2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767" exitCode=0 Jul 05 12:28:17.620424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.620249 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" Jul 05 12:28:17.620424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.620286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" event={"ID":"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46","Type":"ContainerDied","Data":"2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767"} Jul 05 12:28:17.620424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.620341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7" event={"ID":"99f5b28d-0d6e-4805-bdb9-36acb6bb3c46","Type":"ContainerDied","Data":"2fd6c760e414ba6ef4ab975ba7dd3eff32d286393e0d139bfc197b9f8aff4d84"} Jul 05 12:28:17.620424 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.620364 2578 scope.go:117] "RemoveContainer" containerID="2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767" Jul 05 12:28:17.630427 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.630411 2578 scope.go:117] "RemoveContainer" containerID="537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6" Jul 05 12:28:17.639299 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.639274 2578 scope.go:117] "RemoveContainer" containerID="2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767" Jul 05 12:28:17.639654 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:28:17.639633 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767\": container with ID starting with 2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767 not found: ID does not exist" containerID="2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767" Jul 05 12:28:17.639755 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.639665 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767"} err="failed to get container status \"2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767\": rpc error: code = NotFound desc = could not find container \"2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767\": container with ID starting with 2cc02ca7b721d802703c9b5f1337d1496b4abef3a6866b1b3ed536fbe5bb5767 not found: ID does not exist" Jul 05 12:28:17.639755 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.639689 2578 scope.go:117] "RemoveContainer" containerID="537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6" Jul 05 12:28:17.639957 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:28:17.639939 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6\": container with ID starting with 537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6 not found: ID does not exist" containerID="537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6" Jul 05 12:28:17.640001 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.639965 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6"} err="failed to get container status \"537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6\": rpc error: code = NotFound desc = could not find container \"537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6\": container with ID starting with 537b9e4b8a9b40726727618314e845b054bca977fa5e26a0f839c1cb5dcfdcd6 not found: ID does not exist" Jul 05 12:28:17.641550 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.641529 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7"] Jul 05 12:28:17.645347 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.645324 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c25ded-openshift-default-799459fccc-fqnc7"] Jul 05 12:28:17.746618 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:17.746580 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" path="/var/lib/kubelet/pods/99f5b28d-0d6e-4805-bdb9-36acb6bb3c46/volumes" Jul 05 12:28:18.414761 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:18.414722 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9"] Jul 05 12:28:18.415230 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:18.414980 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" containerID="cri-o://eff8210e9f16cdf20c8087995a354fcbc7849b3f6d9ba12c7eda6851d895d4fe" gracePeriod=30 Jul 05 12:28:19.310935 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.310899 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld"] Jul 05 12:28:19.311430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.311408 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" Jul 05 12:28:19.311544 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.311434 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" Jul 05 12:28:19.311544 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.311478 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" Jul 05 12:28:19.311544 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.311488 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" Jul 05 12:28:19.311695 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.311580 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" Jul 05 12:28:19.316205 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.316183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.318711 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.318686 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6f19c8-openshift-default-dockercfg-d2l6j\"" Jul 05 12:28:19.335404 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.335265 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld"] Jul 05 12:28:19.411506 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl57l\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-kube-api-access-jl57l\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411506 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-data\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istiod-ca-cert\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-credential-socket\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-certs\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-envoy\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-token\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.411775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-podinfo\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.412095 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.411795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-socket\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.512869 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.512836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-credential-socket\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.512888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-certs\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-envoy\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-token\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-podinfo\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-socket\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl57l\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-kube-api-access-jl57l\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-certs\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-credential-socket\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513343 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-data\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513749 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istiod-ca-cert\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513749 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-socket\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.513749 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513546 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-data\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.514008 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.513991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istiod-ca-cert\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.515364 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.515342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-envoy\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.515746 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.515730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-podinfo\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.532959 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.532934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-token\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.533089 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.532994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl57l\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-kube-api-access-jl57l\") pod \"e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.629743 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.629716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:19.768721 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.768694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld"] Jul 05 12:28:19.770014 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:28:19.769986 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49e92fb_fb68_4beb_85d4_4bbc9c177c49.slice/crio-29bdd82d0ffff8ffca6f93cecc8e87d626397e3285b902653f6c38aa99b0b2e9 WatchSource:0}: Error finding container 29bdd82d0ffff8ffca6f93cecc8e87d626397e3285b902653f6c38aa99b0b2e9: Status 404 returned error can't find the container with id 29bdd82d0ffff8ffca6f93cecc8e87d626397e3285b902653f6c38aa99b0b2e9 Jul 05 12:28:19.772030 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.772002 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:19.772126 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.772085 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:19.772126 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:19.772121 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:20.639874 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:20.639837 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" event={"ID":"a49e92fb-fb68-4beb-85d4-4bbc9c177c49","Type":"ContainerStarted","Data":"656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609"} Jul 05 12:28:20.640349 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:20.639888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" event={"ID":"a49e92fb-fb68-4beb-85d4-4bbc9c177c49","Type":"ContainerStarted","Data":"29bdd82d0ffff8ffca6f93cecc8e87d626397e3285b902653f6c38aa99b0b2e9"} Jul 05 12:28:20.662430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:20.662369 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" podStartSLOduration=1.662352136 podStartE2EDuration="1.662352136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:28:20.660015719 +0000 UTC m=+2079.398553238" watchObservedRunningTime="2026-07-05 12:28:20.662352136 +0000 UTC m=+2079.400889653" Jul 05 12:28:21.629843 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:21.629806 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:21.634983 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:21.634958 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:21.645894 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:21.645865 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:21.646607 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:21.646588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:23.661071 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.661027 2578 generic.go:356] "Generic (PLEG): container finished" podID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerID="eff8210e9f16cdf20c8087995a354fcbc7849b3f6d9ba12c7eda6851d895d4fe" exitCode=0 Jul 05 12:28:23.661471 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.661087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" event={"ID":"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae","Type":"ContainerDied","Data":"eff8210e9f16cdf20c8087995a354fcbc7849b3f6d9ba12c7eda6851d895d4fe"} Jul 05 12:28:23.661471 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.661149 2578 scope.go:117] "RemoveContainer" containerID="a45afd3e9e363774141b97c8298697c6252514bb9e24559df4f6048c846ea74c" Jul 05 12:28:23.688843 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.688822 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:28:23.758399 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758372 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-envoy\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758569 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758414 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-socket\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758569 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758432 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-credential-socket\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758569 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758458 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-podinfo\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758569 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758479 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgjdg\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-kube-api-access-sgjdg\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758569 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758501 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-certs\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758833 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758602 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istiod-ca-cert\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758833 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758632 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-data\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758833 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758664 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-token\") pod \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\" (UID: \"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae\") " Jul 05 12:28:23.758833 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758701 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:23.758833 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758796 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:23.759146 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.758992 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:23.759146 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.759098 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.759146 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.759115 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.759146 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.759129 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.759601 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.759575 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:28:23.759698 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.759576 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:23.760775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.760752 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:28:23.760890 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.760752 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:28:23.760946 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.760906 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:28:23.761025 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.761003 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-kube-api-access-sgjdg" (OuterVolumeSpecName: "kube-api-access-sgjdg") pod "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" (UID: "c14dac09-cef3-4cd4-9ac8-cb6f14c149ae"). InnerVolumeSpecName "kube-api-access-sgjdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:28:23.860406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.860372 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.860406 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.860406 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.860609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.860418 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgjdg\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-kube-api-access-sgjdg\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.860609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.860429 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.860609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.860437 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:23.860609 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:23.860445 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:28:24.668731 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:24.668704 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" Jul 05 12:28:24.669161 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:24.668698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9" event={"ID":"c14dac09-cef3-4cd4-9ac8-cb6f14c149ae","Type":"ContainerDied","Data":"c2beee4e484cb1d61cd96259590219426e591bfabae10d989257c3d94b849a34"} Jul 05 12:28:24.669161 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:24.668868 2578 scope.go:117] "RemoveContainer" containerID="eff8210e9f16cdf20c8087995a354fcbc7849b3f6d9ba12c7eda6851d895d4fe" Jul 05 12:28:24.702883 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:24.702851 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9"] Jul 05 12:28:24.709359 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:24.709322 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-96ff9c-openshift-default-6f69776d95-mx4p9"] Jul 05 12:28:25.746243 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:25.746213 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" path="/var/lib/kubelet/pods/c14dac09-cef3-4cd4-9ac8-cb6f14c149ae/volumes" Jul 05 12:28:27.857761 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.857725 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng"] Jul 05 12:28:27.858273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.858233 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" Jul 05 12:28:27.858273 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.858267 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" Jul 05 12:28:27.858412 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.858281 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" Jul 05 12:28:27.858412 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.858287 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" Jul 05 12:28:27.858412 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.858369 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" Jul 05 12:28:27.858412 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.858383 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="99f5b28d-0d6e-4805-bdb9-36acb6bb3c46" containerName="istio-proxy" Jul 05 12:28:27.862786 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.862765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:27.865414 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.865396 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-85c29d-openshift-default-dockercfg-hftkc\"" Jul 05 12:28:27.871757 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.871733 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng"] Jul 05 12:28:27.999716 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-envoy\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:27.999889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zctlt\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-kube-api-access-zctlt\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:27.999889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-socket\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:27.999970 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-credential-socket\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:27.999970 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-data\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.000036 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-certs\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.000036 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:27.999993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-podinfo\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.000149 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.000038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcbff7b3-4b20-4261-97c6-26fc6b540597-istiod-ca-cert\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.000149 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.000108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-token\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100592 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-envoy\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zctlt\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-kube-api-access-zctlt\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-socket\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-credential-socket\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-data\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-certs\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-podinfo\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.100802 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcbff7b3-4b20-4261-97c6-26fc6b540597-istiod-ca-cert\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.101158 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.100828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-token\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.101158 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.101131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-socket\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.101416 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.101393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-credential-socket\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.101494 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.101429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-certs\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.101494 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.101463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-data\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.101625 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.101608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcbff7b3-4b20-4261-97c6-26fc6b540597-istiod-ca-cert\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.103388 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.103367 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-envoy\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.103632 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.103604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-podinfo\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.108488 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.108431 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zctlt\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-kube-api-access-zctlt\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.108571 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.108509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-token\") pod \"e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.174604 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.174566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:28.318236 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.318194 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng"] Jul 05 12:28:28.319444 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:28:28.319414 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbff7b3_4b20_4261_97c6_26fc6b540597.slice/crio-dad2ad9e3291c062ead6156b531495c9deb87d177248897fbd77ec94aef4c23e WatchSource:0}: Error finding container dad2ad9e3291c062ead6156b531495c9deb87d177248897fbd77ec94aef4c23e: Status 404 returned error can't find the container with id dad2ad9e3291c062ead6156b531495c9deb87d177248897fbd77ec94aef4c23e Jul 05 12:28:28.321749 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.321710 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:28.321826 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.321802 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:28.321867 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.321852 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:28.694141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.694029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" event={"ID":"bcbff7b3-4b20-4261-97c6-26fc6b540597","Type":"ContainerStarted","Data":"011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d"} Jul 05 12:28:28.694141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.694101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" event={"ID":"bcbff7b3-4b20-4261-97c6-26fc6b540597","Type":"ContainerStarted","Data":"dad2ad9e3291c062ead6156b531495c9deb87d177248897fbd77ec94aef4c23e"} Jul 05 12:28:28.715075 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:28.714991 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podStartSLOduration=1.714971946 podStartE2EDuration="1.714971946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:28:28.712917744 +0000 UTC m=+2087.451455261" watchObservedRunningTime="2026-07-05 12:28:28.714971946 +0000 UTC m=+2087.453509465" Jul 05 12:28:29.174884 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:29.174843 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:29.179966 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:29.179942 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:29.699794 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:29.699764 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:29.700927 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:29.700904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:35.734128 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:35.734091 2578 generic.go:356] "Generic (PLEG): container finished" podID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerID="656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609" exitCode=0 Jul 05 12:28:35.734580 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:35.734151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" event={"ID":"a49e92fb-fb68-4beb-85d4-4bbc9c177c49","Type":"ContainerDied","Data":"656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609"} Jul 05 12:28:35.734580 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:35.734558 2578 scope.go:117] "RemoveContainer" containerID="656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609" Jul 05 12:28:35.735564 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:35.735537 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:35.735618 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:35.735604 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:35.735652 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:35.735632 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:36.646196 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:36.646151 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:36.746414 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:36.746379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" event={"ID":"a49e92fb-fb68-4beb-85d4-4bbc9c177c49","Type":"ContainerStarted","Data":"ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9"} Jul 05 12:28:37.631372 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:37.631329 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:37.631595 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:37.631463 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 05 12:28:37.631595 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:37.631512 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 05 12:28:38.633080 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:38.631404 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 05 12:28:38.633080 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:38.631466 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 05 12:28:39.630499 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:39.630456 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 05 12:28:39.630791 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:39.630761 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 05 12:28:40.630430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:40.630391 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 05 12:28:40.631514 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:40.631041 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 05 12:28:41.634215 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:41.634184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:41.634584 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:41.634568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:41.635335 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:41.635313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:28:44.700950 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.700909 2578 patch_prober.go:28] interesting pod/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 05 12:28:44.701383 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.700978 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 05 12:28:44.816723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.816630 2578 generic.go:356] "Generic (PLEG): container finished" podID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerID="011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d" exitCode=0 Jul 05 12:28:44.816723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.816680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" event={"ID":"bcbff7b3-4b20-4261-97c6-26fc6b540597","Type":"ContainerDied","Data":"011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d"} Jul 05 12:28:44.817103 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.817084 2578 scope.go:117] "RemoveContainer" containerID="011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d" Jul 05 12:28:44.818158 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.818130 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:44.818240 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.818211 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:44.818285 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:44.818251 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 12:28:45.833471 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:45.833434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" event={"ID":"bcbff7b3-4b20-4261-97c6-26fc6b540597","Type":"ContainerStarted","Data":"cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2"} Jul 05 12:28:46.174901 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:46.174865 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:46.175133 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:46.175109 2578 patch_prober.go:28] interesting pod/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 05 12:28:46.175187 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:46.175153 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 05 12:28:47.175260 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:47.175224 2578 patch_prober.go:28] interesting pod/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 05 12:28:47.175740 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:47.175283 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 05 12:28:48.175152 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:48.175116 2578 patch_prober.go:28] interesting pod/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 05 12:28:48.175466 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:48.175171 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 05 12:28:49.175432 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:49.175394 2578 patch_prober.go:28] interesting pod/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 05 12:28:49.175611 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:49.175456 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 05 12:28:50.178763 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:50.178732 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:50.179178 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:50.179093 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:28:50.179894 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:28:50.179876 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:30:00.131316 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.131280 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f"] Jul 05 12:30:00.131794 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.131777 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14dac09-cef3-4cd4-9ac8-cb6f14c149ae" containerName="istio-proxy" Jul 05 12:30:00.135260 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.135244 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:00.137494 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.137476 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4cvrp\"" Jul 05 12:30:00.142317 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.142291 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f"] Jul 05 12:30:00.232982 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.232946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsssg\" (UniqueName: \"kubernetes.io/projected/ddd14fe0-52dd-47cb-b171-3eb0437175f3-kube-api-access-fsssg\") pod \"maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f\" (UID: \"ddd14fe0-52dd-47cb-b171-3eb0437175f3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:00.333695 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.333656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsssg\" (UniqueName: \"kubernetes.io/projected/ddd14fe0-52dd-47cb-b171-3eb0437175f3-kube-api-access-fsssg\") pod \"maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f\" (UID: \"ddd14fe0-52dd-47cb-b171-3eb0437175f3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:00.342545 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.342510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsssg\" (UniqueName: \"kubernetes.io/projected/ddd14fe0-52dd-47cb-b171-3eb0437175f3-kube-api-access-fsssg\") pod \"maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f\" (UID: \"ddd14fe0-52dd-47cb-b171-3eb0437175f3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:00.448200 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.448112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:00.580879 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:00.580850 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f"] Jul 05 12:30:00.583037 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:30:00.583005 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd14fe0_52dd_47cb_b171_3eb0437175f3.slice/crio-4daae14d091577f4e928a44560ceadfb9e9f23c563d62252a1e2096b8c022dd4 WatchSource:0}: Error finding container 4daae14d091577f4e928a44560ceadfb9e9f23c563d62252a1e2096b8c022dd4: Status 404 returned error can't find the container with id 4daae14d091577f4e928a44560ceadfb9e9f23c563d62252a1e2096b8c022dd4 Jul 05 12:30:01.257480 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:01.257447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" event={"ID":"ddd14fe0-52dd-47cb-b171-3eb0437175f3","Type":"ContainerStarted","Data":"eee96ec4eb27f2f9e5e79c216966f292213dd92b35ba7df82ff8000ca491392b"} Jul 05 12:30:01.257878 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:01.257499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" event={"ID":"ddd14fe0-52dd-47cb-b171-3eb0437175f3","Type":"ContainerStarted","Data":"4daae14d091577f4e928a44560ceadfb9e9f23c563d62252a1e2096b8c022dd4"} Jul 05 12:30:01.273856 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:01.273803 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" podStartSLOduration=1.273789469 podStartE2EDuration="1.273789469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:30:01.271223591 +0000 UTC m=+2180.009761133" watchObservedRunningTime="2026-07-05 12:30:01.273789469 +0000 UTC m=+2180.012327042" Jul 05 12:30:02.264064 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:02.264021 2578 generic.go:356] "Generic (PLEG): container finished" podID="ddd14fe0-52dd-47cb-b171-3eb0437175f3" containerID="eee96ec4eb27f2f9e5e79c216966f292213dd92b35ba7df82ff8000ca491392b" exitCode=0 Jul 05 12:30:02.264459 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:02.264066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" event={"ID":"ddd14fe0-52dd-47cb-b171-3eb0437175f3","Type":"ContainerDied","Data":"eee96ec4eb27f2f9e5e79c216966f292213dd92b35ba7df82ff8000ca491392b"} Jul 05 12:30:03.402420 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:03.402396 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:03.462498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:03.462458 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsssg\" (UniqueName: \"kubernetes.io/projected/ddd14fe0-52dd-47cb-b171-3eb0437175f3-kube-api-access-fsssg\") pod \"ddd14fe0-52dd-47cb-b171-3eb0437175f3\" (UID: \"ddd14fe0-52dd-47cb-b171-3eb0437175f3\") " Jul 05 12:30:03.464534 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:03.464511 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd14fe0-52dd-47cb-b171-3eb0437175f3-kube-api-access-fsssg" (OuterVolumeSpecName: "kube-api-access-fsssg") pod "ddd14fe0-52dd-47cb-b171-3eb0437175f3" (UID: "ddd14fe0-52dd-47cb-b171-3eb0437175f3"). InnerVolumeSpecName "kube-api-access-fsssg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:30:03.563548 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:03.563463 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsssg\" (UniqueName: \"kubernetes.io/projected/ddd14fe0-52dd-47cb-b171-3eb0437175f3-kube-api-access-fsssg\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:30:04.276397 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:04.276366 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" Jul 05 12:30:04.276397 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:04.276376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f" event={"ID":"ddd14fe0-52dd-47cb-b171-3eb0437175f3","Type":"ContainerDied","Data":"4daae14d091577f4e928a44560ceadfb9e9f23c563d62252a1e2096b8c022dd4"} Jul 05 12:30:04.276612 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:30:04.276419 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4daae14d091577f4e928a44560ceadfb9e9f23c563d62252a1e2096b8c022dd4" Jul 05 12:33:51.909647 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:33:51.909615 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f"] Jul 05 12:33:51.911855 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:33:51.911833 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-6f19c8-29720910-lmj4f"] Jul 05 12:33:53.745995 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:33:53.745962 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd14fe0-52dd-47cb-b171-3eb0437175f3" path="/var/lib/kubelet/pods/ddd14fe0-52dd-47cb-b171-3eb0437175f3/volumes" Jul 05 12:34:32.121403 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:32.121362 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld"] Jul 05 12:34:32.121984 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:32.121649 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" containerID="cri-o://ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9" gracePeriod=30 Jul 05 12:34:37.377100 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.377078 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:34:37.533540 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533448 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-envoy\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.533540 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533503 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-podinfo\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.533540 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533534 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-credential-socket\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.533807 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533566 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-socket\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.533807 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533629 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-certs\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.533807 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533679 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-data\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.533807 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533709 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-token\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.534024 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533871 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:37.534024 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533886 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:37.534024 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533897 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:37.534024 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.533949 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istiod-ca-cert\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.534024 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534005 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl57l\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-kube-api-access-jl57l\") pod \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\" (UID: \"a49e92fb-fb68-4beb-85d4-4bbc9c177c49\") " Jul 05 12:34:37.534339 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534303 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:34:37.534485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534416 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.534485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534435 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.534485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534449 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.534485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534464 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.534723 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.534654 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-data" (OuterVolumeSpecName: "istio-data") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:37.535900 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.535879 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:37.536246 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.535926 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-token" (OuterVolumeSpecName: "istio-token") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:34:37.536246 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.536141 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:34:37.536246 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.536234 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-kube-api-access-jl57l" (OuterVolumeSpecName: "kube-api-access-jl57l") pod "a49e92fb-fb68-4beb-85d4-4bbc9c177c49" (UID: "a49e92fb-fb68-4beb-85d4-4bbc9c177c49"). InnerVolumeSpecName "kube-api-access-jl57l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:34:37.635751 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.635718 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.635751 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.635745 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.635751 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.635754 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.635751 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.635763 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl57l\" (UniqueName: \"kubernetes.io/projected/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-kube-api-access-jl57l\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.636107 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.635771 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49e92fb-fb68-4beb-85d4-4bbc9c177c49-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:37.830586 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.830499 2578 generic.go:356] "Generic (PLEG): container finished" podID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerID="ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9" exitCode=0 Jul 05 12:34:37.830586 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.830551 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" Jul 05 12:34:37.830774 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.830584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" event={"ID":"a49e92fb-fb68-4beb-85d4-4bbc9c177c49","Type":"ContainerDied","Data":"ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9"} Jul 05 12:34:37.830774 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.830642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld" event={"ID":"a49e92fb-fb68-4beb-85d4-4bbc9c177c49","Type":"ContainerDied","Data":"29bdd82d0ffff8ffca6f93cecc8e87d626397e3285b902653f6c38aa99b0b2e9"} Jul 05 12:34:37.830774 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.830664 2578 scope.go:117] "RemoveContainer" containerID="ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9" Jul 05 12:34:37.839909 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.839891 2578 scope.go:117] "RemoveContainer" containerID="656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609" Jul 05 12:34:37.848416 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.848395 2578 scope.go:117] "RemoveContainer" containerID="ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9" Jul 05 12:34:37.848672 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:34:37.848652 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9\": container with ID starting with ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9 not found: ID does not exist" containerID="ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9" Jul 05 12:34:37.848744 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.848683 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9"} err="failed to get container status \"ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9\": rpc error: code = NotFound desc = could not find container \"ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9\": container with ID starting with ec2e7fbf8b2e62b1d05f60c21f720f461e19cd6ecc24945c43448013603188a9 not found: ID does not exist" Jul 05 12:34:37.848744 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.848709 2578 scope.go:117] "RemoveContainer" containerID="656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609" Jul 05 12:34:37.848958 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:34:37.848927 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609\": container with ID starting with 656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609 not found: ID does not exist" containerID="656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609" Jul 05 12:34:37.849020 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.848964 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609"} err="failed to get container status \"656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609\": rpc error: code = NotFound desc = could not find container \"656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609\": container with ID starting with 656043c06c0af76f4f04be8b357e59eb051943d61bc06c338555fe0437d2f609 not found: ID does not exist" Jul 05 12:34:37.849760 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.849737 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld"] Jul 05 12:34:37.859431 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:37.854427 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6f19c8-openshift-default-846f5fcd6c-r6wld"] Jul 05 12:34:38.993563 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:38.993525 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng"] Jul 05 12:34:38.994002 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:38.993792 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" containerID="cri-o://cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2" gracePeriod=30 Jul 05 12:34:39.747651 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:39.747619 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" path="/var/lib/kubelet/pods/a49e92fb-fb68-4beb-85d4-4bbc9c177c49/volumes" Jul 05 12:34:44.261403 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.261376 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:34:44.399304 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399208 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-data\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399309 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-socket\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399333 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcbff7b3-4b20-4261-97c6-26fc6b540597-istiod-ca-cert\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zctlt\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-kube-api-access-zctlt\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399397 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-token\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399424 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-certs\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399469 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399451 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-podinfo\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399750 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-credential-socket\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399750 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-envoy\") pod \"bcbff7b3-4b20-4261-97c6-26fc6b540597\" (UID: \"bcbff7b3-4b20-4261-97c6-26fc6b540597\") " Jul 05 12:34:44.399750 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399614 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:44.399913 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399835 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:44.399913 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399853 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcbff7b3-4b20-4261-97c6-26fc6b540597-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 12:34:44.399913 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399897 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.400119 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.399974 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:44.400188 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.400134 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-data" (OuterVolumeSpecName: "istio-data") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:44.401896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.401865 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-kube-api-access-zctlt" (OuterVolumeSpecName: "kube-api-access-zctlt") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "kube-api-access-zctlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:34:44.401896 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.401888 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 12:34:44.402160 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.402137 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 12:34:44.402267 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.402208 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcbff7b3-4b20-4261-97c6-26fc6b540597" (UID: "bcbff7b3-4b20-4261-97c6-26fc6b540597"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 12:34:44.501225 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501190 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-data\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501225 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501219 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcbff7b3-4b20-4261-97c6-26fc6b540597-istiod-ca-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501225 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501233 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zctlt\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-kube-api-access-zctlt\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501243 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501252 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-workload-certs\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501260 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-podinfo\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501269 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-credential-socket\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.501485 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.501277 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcbff7b3-4b20-4261-97c6-26fc6b540597-istio-envoy\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" Jul 05 12:34:44.872793 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.872760 2578 generic.go:356] "Generic (PLEG): container finished" podID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerID="cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2" exitCode=0 Jul 05 12:34:44.872980 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.872811 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" Jul 05 12:34:44.872980 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.872848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" event={"ID":"bcbff7b3-4b20-4261-97c6-26fc6b540597","Type":"ContainerDied","Data":"cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2"} Jul 05 12:34:44.872980 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.872898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng" event={"ID":"bcbff7b3-4b20-4261-97c6-26fc6b540597","Type":"ContainerDied","Data":"dad2ad9e3291c062ead6156b531495c9deb87d177248897fbd77ec94aef4c23e"} Jul 05 12:34:44.872980 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.872922 2578 scope.go:117] "RemoveContainer" containerID="cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2" Jul 05 12:34:44.883546 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.883526 2578 scope.go:117] "RemoveContainer" containerID="011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d" Jul 05 12:34:44.892844 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.892820 2578 scope.go:117] "RemoveContainer" containerID="cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2" Jul 05 12:34:44.893181 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:34:44.893162 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2\": container with ID starting with cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2 not found: ID does not exist" containerID="cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2" Jul 05 12:34:44.893262 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.893196 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2"} err="failed to get container status \"cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2\": rpc error: code = NotFound desc = could not find container \"cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2\": container with ID starting with cc1c03fdcab3469510380bc58299311e1e54e2b93ecf9b5c3c42fed752d4cff2 not found: ID does not exist" Jul 05 12:34:44.893262 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.893220 2578 scope.go:117] "RemoveContainer" containerID="011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d" Jul 05 12:34:44.893514 ip-10-0-136-198 kubenswrapper[2578]: E0705 12:34:44.893488 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d\": container with ID starting with 011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d not found: ID does not exist" containerID="011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d" Jul 05 12:34:44.893615 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.893516 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d"} err="failed to get container status \"011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d\": rpc error: code = NotFound desc = could not find container \"011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d\": container with ID starting with 011af866f46c04aa515bac9aed616765e1319f56bd5d345fcf233290014d996d not found: ID does not exist" Jul 05 12:34:44.894899 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.894880 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng"] Jul 05 12:34:44.900622 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.900600 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-85c29d-openshift-default-55b9c4bd59-h9mng"] Jul 05 12:34:44.992142 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:44.992115 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720895-4nx2l_6ade654c-2290-42cd-b899-0152882ef271/cleanup/0.log" Jul 05 12:34:45.231288 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:45.231196 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4f9f4b57-7qrw6_2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f/manager/0.log" Jul 05 12:34:45.481483 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:45.481406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lltrc_cd048157-1c2b-4ae5-accd-4ea2d6cb2621/manager/0.log" Jul 05 12:34:45.723066 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:45.723025 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59595c8d98-7jd7j_d6c972bd-3dda-405f-b04f-6b5357d57a40/copy-manifests/0.log" Jul 05 12:34:45.736149 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:45.736080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59595c8d98-7jd7j_d6c972bd-3dda-405f-b04f-6b5357d57a40/manager/0.log" Jul 05 12:34:45.746528 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:45.746499 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" path="/var/lib/kubelet/pods/bcbff7b3-4b20-4261-97c6-26fc6b540597/volumes" Jul 05 12:34:46.800875 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:46.800844 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz_aad828e8-a770-4e3d-a3f1-d5c4f690a772/util/0.log" Jul 05 12:34:46.807421 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:46.807400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz_aad828e8-a770-4e3d-a3f1-d5c4f690a772/pull/0.log" Jul 05 12:34:46.813809 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:46.813793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz_aad828e8-a770-4e3d-a3f1-d5c4f690a772/extract/0.log" Jul 05 12:34:46.933725 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:46.933694 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89_4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8/util/0.log" Jul 05 12:34:46.940854 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:46.940829 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89_4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8/pull/0.log" Jul 05 12:34:46.948112 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:46.948090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89_4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8/extract/0.log" Jul 05 12:34:47.064309 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:47.064231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl_1cdea1d1-0808-42a4-b498-b9f9ca49c2de/util/0.log" Jul 05 12:34:47.070772 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:47.070749 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl_1cdea1d1-0808-42a4-b498-b9f9ca49c2de/pull/0.log" Jul 05 12:34:47.076840 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:47.076823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl_1cdea1d1-0808-42a4-b498-b9f9ca49c2de/extract/0.log" Jul 05 12:34:47.191120 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:47.191092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6_f463373b-8dc3-4eaa-89a3-9406c262d290/util/0.log" Jul 05 12:34:47.197889 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:47.197862 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6_f463373b-8dc3-4eaa-89a3-9406c262d290/pull/0.log" Jul 05 12:34:47.203945 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:47.203924 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6_f463373b-8dc3-4eaa-89a3-9406c262d290/extract/0.log" Jul 05 12:34:48.560821 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:48.560786 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785v6sx_8d260d89-884b-4d59-a784-2dcc46f30845/istio-proxy/0.log" Jul 05 12:34:48.689793 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:48.689755 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-79nb7_ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede/discovery/0.log" Jul 05 12:34:49.034475 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:49.034428 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/1.log" Jul 05 12:34:49.150936 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:49.150907 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hclj5_61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9/payload-pre-processing/0.log" Jul 05 12:34:49.270115 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:49.270086 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6cll8_794973f7-1b25-4633-9f60-78ce38b62828/payload-processing/0.log" Jul 05 12:34:49.735558 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:49.735526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bsvq7_8ce711a0-e35f-4b39-8534-4ebdac127736/main/0.log" Jul 05 12:34:49.969504 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:49.969473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-75krj_ceef140e-d45e-4234-aa0e-0ab5ab339c48/main/0.log" Jul 05 12:34:57.388457 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:57.388430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nkq5j_0bcd4e58-3a9a-46ac-ac35-ee78766dfe09/global-pull-secret-syncer/0.log" Jul 05 12:34:57.536968 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:57.536933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-stwmn_f46348ea-412d-42fd-b501-302d85d984dc/konnectivity-agent/0.log" Jul 05 12:34:57.559656 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:34:57.559627 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-198.ec2.internal_4bb0963c382b2442e093109581c52883/haproxy/0.log" Jul 05 12:35:02.108945 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.108914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz_aad828e8-a770-4e3d-a3f1-d5c4f690a772/extract/0.log" Jul 05 12:35:02.130110 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.130082 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz_aad828e8-a770-4e3d-a3f1-d5c4f690a772/util/0.log" Jul 05 12:35:02.152894 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.152864 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592chcz_aad828e8-a770-4e3d-a3f1-d5c4f690a772/pull/0.log" Jul 05 12:35:02.184595 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.184566 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89_4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8/extract/0.log" Jul 05 12:35:02.205681 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.205653 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89_4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8/util/0.log" Jul 05 12:35:02.228372 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.228344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgh89_4ec4ff13-5283-4bfc-8c52-acbbe3a3cfd8/pull/0.log" Jul 05 12:35:02.261475 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.261447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl_1cdea1d1-0808-42a4-b498-b9f9ca49c2de/extract/0.log" Jul 05 12:35:02.284350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.284326 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl_1cdea1d1-0808-42a4-b498-b9f9ca49c2de/util/0.log" Jul 05 12:35:02.304976 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.304941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zs5dl_1cdea1d1-0808-42a4-b498-b9f9ca49c2de/pull/0.log" Jul 05 12:35:02.346590 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.346557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6_f463373b-8dc3-4eaa-89a3-9406c262d290/extract/0.log" Jul 05 12:35:02.370076 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.369986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6_f463373b-8dc3-4eaa-89a3-9406c262d290/util/0.log" Jul 05 12:35:02.400995 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:02.400941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zmbg6_f463373b-8dc3-4eaa-89a3-9406c262d290/pull/0.log" Jul 05 12:35:04.691638 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.691605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/alertmanager/0.log" Jul 05 12:35:04.722910 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.722883 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/config-reloader/0.log" Jul 05 12:35:04.753027 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.753004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/kube-rbac-proxy-web/0.log" Jul 05 12:35:04.782619 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.782597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/kube-rbac-proxy/0.log" Jul 05 12:35:04.807299 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.807267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/kube-rbac-proxy-metric/0.log" Jul 05 12:35:04.849644 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.849619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/prom-label-proxy/0.log" Jul 05 12:35:04.907775 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:04.907732 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a58b950e-d556-4579-859a-1a5bc45da1bc/init-config-reloader/0.log" Jul 05 12:35:05.004521 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.004451 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-f9654_c5376af6-771f-4042-a1f4-cce13f52a975/kube-state-metrics/0.log" Jul 05 12:35:05.032269 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.032243 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-f9654_c5376af6-771f-4042-a1f4-cce13f52a975/kube-rbac-proxy-main/0.log" Jul 05 12:35:05.055310 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.055280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-f9654_c5376af6-771f-4042-a1f4-cce13f52a975/kube-rbac-proxy-self/0.log" Jul 05 12:35:05.082020 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.081992 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-686b9ff667-hpcxj_eaa0c15d-260c-4788-96a2-c3d9f121937f/metrics-server/0.log" Jul 05 12:35:05.107313 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.107280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-gwvnz_8b9b43f8-c987-4c66-ad32-2e4bde513104/monitoring-plugin/0.log" Jul 05 12:35:05.309911 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.309830 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qdpmb_415a2ae5-db0d-41ce-bee4-242b0b7f3e9a/node-exporter/0.log" Jul 05 12:35:05.330365 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.330341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qdpmb_415a2ae5-db0d-41ce-bee4-242b0b7f3e9a/kube-rbac-proxy/0.log" Jul 05 12:35:05.353420 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.353396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qdpmb_415a2ae5-db0d-41ce-bee4-242b0b7f3e9a/init-textfile/0.log" Jul 05 12:35:05.624781 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.624748 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-pcfsf_62bf920b-5130-4f31-92ad-949557a15df1/prometheus-operator/0.log" Jul 05 12:35:05.645549 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.645520 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-pcfsf_62bf920b-5130-4f31-92ad-949557a15df1/kube-rbac-proxy/0.log" Jul 05 12:35:05.671984 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.671958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-m5br8_ab9c1bdd-778d-45cf-b4d8-dbf3f8f0acc4/prometheus-operator-admission-webhook/0.log" Jul 05 12:35:05.704185 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.704159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56cc9c6b89-7z49r_ebba0262-216a-404d-a914-539fc588b454/telemeter-client/0.log" Jul 05 12:35:05.729920 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.729896 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56cc9c6b89-7z49r_ebba0262-216a-404d-a914-539fc588b454/reload/0.log" Jul 05 12:35:05.750945 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:05.750921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56cc9c6b89-7z49r_ebba0262-216a-404d-a914-539fc588b454/kube-rbac-proxy/0.log" Jul 05 12:35:07.823027 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.822993 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88"] Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823426 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823439 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823449 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823455 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823495 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd14fe0-52dd-47cb-b171-3eb0437175f3" containerName="cleanup" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823504 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd14fe0-52dd-47cb-b171-3eb0437175f3" containerName="cleanup" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823517 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" Jul 05 12:35:07.823518 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823523 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" Jul 05 12:35:07.823973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823549 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" Jul 05 12:35:07.823973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823556 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" Jul 05 12:35:07.823973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823675 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcbff7b3-4b20-4261-97c6-26fc6b540597" containerName="istio-proxy" Jul 05 12:35:07.823973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823700 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" Jul 05 12:35:07.823973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823710 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49e92fb-fb68-4beb-85d4-4bbc9c177c49" containerName="istio-proxy" Jul 05 12:35:07.823973 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.823720 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddd14fe0-52dd-47cb-b171-3eb0437175f3" containerName="cleanup" Jul 05 12:35:07.827252 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.827232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:07.829683 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.829662 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dkr2v\"/\"openshift-service-ca.crt\"" Jul 05 12:35:07.830546 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.830529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dkr2v\"/\"kube-root-ca.crt\"" Jul 05 12:35:07.830650 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.830554 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dkr2v\"/\"default-dockercfg-9cplw\"" Jul 05 12:35:07.835871 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.835849 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88"] Jul 05 12:35:07.923271 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.923219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwchw\" (UniqueName: \"kubernetes.io/projected/f3e61c0a-f520-4107-9525-68af492343f3-kube-api-access-fwchw\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:07.923463 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.923335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-podres\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:07.923463 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.923377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-sys\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:07.923556 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.923484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-lib-modules\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:07.923556 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:07.923501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-proc\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.024897 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.024858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-sys\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.024948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-lib-modules\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.024974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-proc\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.024995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-sys\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.024996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwchw\" (UniqueName: \"kubernetes.io/projected/f3e61c0a-f520-4107-9525-68af492343f3-kube-api-access-fwchw\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025121 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.025112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-proc\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025344 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.025115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-podres\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025344 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.025141 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-lib-modules\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.025344 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.025190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3e61c0a-f520-4107-9525-68af492343f3-podres\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.032350 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.032318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwchw\" (UniqueName: \"kubernetes.io/projected/f3e61c0a-f520-4107-9525-68af492343f3-kube-api-access-fwchw\") pod \"perf-node-gather-daemonset-tln88\" (UID: \"f3e61c0a-f520-4107-9525-68af492343f3\") " pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.139193 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.139144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:08.274319 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:08.274295 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88"] Jul 05 12:35:08.276195 ip-10-0-136-198 kubenswrapper[2578]: W0705 12:35:08.276157 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3e61c0a_f520_4107_9525_68af492343f3.slice/crio-ef4a06563ce32aeaa2e0e549cb864d19a114766919ea61e99b49d5127e979130 WatchSource:0}: Error finding container ef4a06563ce32aeaa2e0e549cb864d19a114766919ea61e99b49d5127e979130: Status 404 returned error can't find the container with id ef4a06563ce32aeaa2e0e549cb864d19a114766919ea61e99b49d5127e979130 Jul 05 12:35:09.007397 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:09.007357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" event={"ID":"f3e61c0a-f520-4107-9525-68af492343f3","Type":"ContainerStarted","Data":"059c7c5c74daed8444ce4d15fabb9e9e5c138ed959816e9c86f6a6943d47df7e"} Jul 05 12:35:09.007882 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:09.007447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" event={"ID":"f3e61c0a-f520-4107-9525-68af492343f3","Type":"ContainerStarted","Data":"ef4a06563ce32aeaa2e0e549cb864d19a114766919ea61e99b49d5127e979130"} Jul 05 12:35:09.007882 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:09.007473 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:09.023311 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:09.023253 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" podStartSLOduration=2.023236435 podStartE2EDuration="2.023236435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 12:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 12:35:09.021787762 +0000 UTC m=+2487.760325306" watchObservedRunningTime="2026-07-05 12:35:09.023236435 +0000 UTC m=+2487.761773952" Jul 05 12:35:09.955375 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:09.955333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrlcj_bbab0bc4-4d70-4988-913b-be2d0a8e7fd2/dns/0.log" Jul 05 12:35:09.975895 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:09.975856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrlcj_bbab0bc4-4d70-4988-913b-be2d0a8e7fd2/kube-rbac-proxy/0.log" Jul 05 12:35:10.050854 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:10.050821 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2vkk_d6b7aed2-c9e7-4060-a03c-4d99c49dc0e7/dns-node-resolver/0.log" Jul 05 12:35:10.653507 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:10.653483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktxnk_3f5659d9-2af0-4bdf-845b-d7087d5a983f/node-ca/0.log" Jul 05 12:35:11.598387 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:11.598342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785v6sx_8d260d89-884b-4d59-a784-2dcc46f30845/istio-proxy/0.log" Jul 05 12:35:11.711195 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:11.711162 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-79nb7_ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede/discovery/0.log" Jul 05 12:35:11.814785 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:11.814747 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/0.log" Jul 05 12:35:11.841352 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:11.841323 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/1.log" Jul 05 12:35:11.879823 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:11.879730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hclj5_61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9/payload-pre-processing/0.log" Jul 05 12:35:11.936144 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:11.936116 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6cll8_794973f7-1b25-4633-9f60-78ce38b62828/payload-processing/0.log" Jul 05 12:35:12.674266 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:12.674238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z6d9g_6df6e597-063e-4f13-9751-4c5f399c6c53/serve-healthcheck-canary/0.log" Jul 05 12:35:13.182189 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:13.182147 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lk98l_4345a3d8-4dd1-468e-96b1-98afa67aa93c/kube-rbac-proxy/0.log" Jul 05 12:35:13.202323 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:13.202298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lk98l_4345a3d8-4dd1-468e-96b1-98afa67aa93c/exporter/0.log" Jul 05 12:35:13.221915 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:13.221872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lk98l_4345a3d8-4dd1-468e-96b1-98afa67aa93c/extractor/0.log" Jul 05 12:35:15.023331 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:15.023301 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dkr2v/perf-node-gather-daemonset-tln88" Jul 05 12:35:15.578603 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:15.578571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720895-4nx2l_6ade654c-2290-42cd-b899-0152882ef271/cleanup/0.log" Jul 05 12:35:15.694408 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:15.694378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4f9f4b57-7qrw6_2ff09dab-5ec4-4e4f-b8c5-2fc26c29463f/manager/0.log" Jul 05 12:35:15.778108 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:15.778079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lltrc_cd048157-1c2b-4ae5-accd-4ea2d6cb2621/manager/0.log" Jul 05 12:35:15.885059 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:15.885014 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59595c8d98-7jd7j_d6c972bd-3dda-405f-b04f-6b5357d57a40/manager/0.log" Jul 05 12:35:15.903821 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:15.903795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59595c8d98-7jd7j_d6c972bd-3dda-405f-b04f-6b5357d57a40/copy-manifests/0.log" Jul 05 12:35:17.219387 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:17.219355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58544b45f-crr2w_e1560198-07fb-44fa-9ca3-57d8b8bb9bfd/manager/0.log" Jul 05 12:35:17.246637 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:17.246605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ct2mz_2057fca0-a1f3-418b-bb20-ce8bada8412e/openshift-lws-operator/0.log" Jul 05 12:35:17.919157 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:17.919123 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785v6sx_8d260d89-884b-4d59-a784-2dcc46f30845/istio-proxy/0.log" Jul 05 12:35:18.013516 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:18.013409 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-79nb7_ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede/discovery/0.log" Jul 05 12:35:18.068213 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:18.068181 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/0.log" Jul 05 12:35:18.095953 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:18.095928 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/1.log" Jul 05 12:35:18.115446 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:18.115415 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hclj5_61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9/payload-pre-processing/0.log" Jul 05 12:35:18.151624 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:18.151593 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6cll8_794973f7-1b25-4633-9f60-78ce38b62828/payload-processing/0.log" Jul 05 12:35:19.463042 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:19.462962 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785v6sx_8d260d89-884b-4d59-a784-2dcc46f30845/istio-proxy/0.log" Jul 05 12:35:19.562702 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:19.562668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-79nb7_ae9c0ccb-92bd-4d3c-9a9c-6c839f713ede/discovery/0.log" Jul 05 12:35:19.609509 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:19.609475 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/0.log" Jul 05 12:35:19.643258 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:19.643224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2x88f_a868fbfd-5a9b-4da1-86c0-b29be28f1266/istio-proxy/1.log" Jul 05 12:35:19.663213 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:19.663184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hclj5_61dbe7b4-9c5c-45a5-a0b1-ae0e33bcf8a9/payload-pre-processing/0.log" Jul 05 12:35:19.701117 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:19.701088 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6cll8_794973f7-1b25-4633-9f60-78ce38b62828/payload-processing/0.log" Jul 05 12:35:23.960732 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:23.960705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/kube-multus-additional-cni-plugins/0.log" Jul 05 12:35:23.980141 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:23.980112 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/egress-router-binary-copy/0.log" Jul 05 12:35:23.999430 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:23.999403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/cni-plugins/0.log" Jul 05 12:35:24.018831 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.018805 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/bond-cni-plugin/0.log" Jul 05 12:35:24.040186 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.040159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/routeoverride-cni/0.log" Jul 05 12:35:24.060347 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.060324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/whereabouts-cni-bincopy/0.log" Jul 05 12:35:24.081059 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.081015 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c62wx_a2a8c44b-1654-420e-99f7-bd1bae029a24/whereabouts-cni/0.log" Jul 05 12:35:24.316111 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.316017 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zrx7v_0d686916-19f8-464a-8e1c-e252b17a35df/kube-multus/0.log" Jul 05 12:35:24.379243 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.379199 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4kqfb_6a9269d7-98c4-4f56-9c35-d0d44b0d17b4/network-metrics-daemon/0.log" Jul 05 12:35:24.396715 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:24.396688 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4kqfb_6a9269d7-98c4-4f56-9c35-d0d44b0d17b4/kube-rbac-proxy/0.log" Jul 05 12:35:25.650318 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.650282 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/ovn-controller/0.log" Jul 05 12:35:25.665997 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.665971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/ovn-acl-logging/0.log" Jul 05 12:35:25.686545 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.686513 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/kube-rbac-proxy-node/0.log" Jul 05 12:35:25.705623 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.705597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/kube-rbac-proxy-ovn-metrics/0.log" Jul 05 12:35:25.724007 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.723981 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/northd/0.log" Jul 05 12:35:25.742498 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.742468 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/nbdb/0.log" Jul 05 12:35:25.761633 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.761605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/sbdb/0.log" Jul 05 12:35:25.814596 ip-10-0-136-198 kubenswrapper[2578]: I0705 12:35:25.814568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgt4q_65a7db95-68c2-481c-89b5-1df722115e67/ovnkube-controller/0.log"