Jul 09 13:58:18.484464 ip-10-0-132-27 systemd[1]: Starting Kubernetes Kubelet... Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.867956 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874939 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874950 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874953 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874956 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874959 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874962 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874965 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:18.997925 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874968 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:18.942556 ip-10-0-132-27 systemd[1]: Started Kubernetes Kubelet. Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874971 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874974 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874976 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874981 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874984 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.874996 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875000 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875003 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875006 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875009 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875012 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875015 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875018 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875021 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875023 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875026 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875029 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875032 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:18.998881 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875035 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875037 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875040 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875043 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875045 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875048 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875050 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875053 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875055 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875058 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875061 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875063 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875066 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875068 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875071 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875073 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875076 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875078 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875081 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:18.999605 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875084 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875089 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875092 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875095 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875098 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875101 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875104 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875106 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875109 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875111 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875114 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875116 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875119 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875122 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875125 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875127 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875130 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875133 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875135 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875139 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:19.000197 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875142 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875145 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875148 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875150 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875153 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875156 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875159 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875162 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875176 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875180 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875183 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875186 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875188 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875191 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875194 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875196 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875199 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875201 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875204 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875206 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:19.000864 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875209 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875211 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875214 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875216 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875219 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875221 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875224 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875227 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875229 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875232 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875235 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875237 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875240 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875243 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875957 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875963 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875967 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875970 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875972 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:19.002658 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875981 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875984 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875988 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875992 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875995 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.875999 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876001 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876004 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876007 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876010 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876013 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876016 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876018 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876022 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876026 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876029 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876032 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876035 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876038 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:19.004139 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876042 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876045 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876048 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876050 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876054 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876057 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876059 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876062 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876064 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876067 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876069 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876072 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876075 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876077 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876086 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876089 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876092 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876094 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876097 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876099 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:19.006474 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876102 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876104 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876107 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876109 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876112 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876115 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876117 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876120 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876122 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876125 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876127 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876130 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876132 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876134 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876137 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876139 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876142 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876145 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876148 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:19.008403 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876150 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876153 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876155 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876158 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876160 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876182 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876185 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876188 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876191 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876194 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876196 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876199 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876203 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876205 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876208 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876210 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876213 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876216 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876218 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876221 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:19.010277 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876223 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876226 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876228 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876230 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876233 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876239 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876241 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876244 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876246 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876249 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876251 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876254 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876257 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876259 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876262 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876264 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876613 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876619 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876622 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876625 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:19.010966 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876628 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876630 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876633 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876635 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876638 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876640 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876643 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876645 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876647 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876650 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876653 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876655 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876657 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876660 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876662 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876664 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876669 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876674 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876677 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:19.017756 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876680 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876683 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876685 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876689 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876692 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876696 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876698 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876701 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876704 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876706 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876711 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876714 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876716 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876719 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876722 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876725 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876727 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876730 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876732 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876735 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:19.018759 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876737 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876740 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876742 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876745 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876748 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876750 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876753 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876755 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876758 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876760 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876764 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876767 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876769 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876772 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876774 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876777 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876779 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876782 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876784 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876787 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:19.198654 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876789 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876791 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876795 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876798 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876800 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876802 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876805 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876808 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876810 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876813 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876815 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876818 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876820 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876823 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876825 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876828 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876832 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876835 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876839 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876841 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:19.211575 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876844 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876846 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876849 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876852 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876854 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876857 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876859 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876862 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876864 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876867 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876869 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876872 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876874 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876877 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876881 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.876883 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876961 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876967 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876973 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876977 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 13:58:19.212297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876981 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876984 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876988 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876992 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876995 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.876998 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877001 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877004 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877007 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877010 2553 flags.go:64] FLAG: --cgroup-root="" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877013 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877016 2553 flags.go:64] FLAG: --client-ca-file="" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877018 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877021 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877025 2553 flags.go:64] FLAG: --cluster-domain="" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877028 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877031 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877034 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877037 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877041 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877044 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877047 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877050 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877053 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 09 13:58:19.212935 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877056 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877059 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877063 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877066 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877069 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877072 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877075 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877078 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877080 2553 flags.go:64] FLAG: --enable-server="true" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877083 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877087 2553 flags.go:64] FLAG: --event-burst="100" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877090 2553 flags.go:64] FLAG: --event-qps="50" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877093 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877096 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877099 2553 flags.go:64] FLAG: --eviction-hard="" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877105 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877108 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877111 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877114 2553 flags.go:64] FLAG: --eviction-soft="" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877117 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877119 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877122 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877126 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877129 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877132 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 13:58:19.213759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877135 2553 flags.go:64] FLAG: --feature-gates="" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877138 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877144 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877147 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877150 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877153 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877155 2553 flags.go:64] FLAG: --help="false" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877158 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877161 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877177 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877180 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877184 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877187 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877190 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877193 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877196 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877198 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877207 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877211 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877214 2553 flags.go:64] FLAG: --kube-reserved="" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877217 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877219 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877222 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877225 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 13:58:19.214646 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877228 2553 flags.go:64] FLAG: --lock-file="" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877231 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877233 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877236 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877245 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877250 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877252 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877255 2553 flags.go:64] FLAG: --logging-format="text" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877258 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877261 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877264 2553 flags.go:64] FLAG: --manifest-url="" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877267 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877271 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877273 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877277 2553 flags.go:64] FLAG: --max-pods="110" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877280 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877283 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877287 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877290 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877293 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877295 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877298 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877305 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877307 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877310 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 13:58:19.215303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877313 2553 flags.go:64] FLAG: --pod-cidr="" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877317 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877322 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877324 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877327 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877330 2553 flags.go:64] FLAG: --port="10250" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877333 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877336 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fdcf3de4aae708b4" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877339 2553 flags.go:64] FLAG: --qos-reserved="" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877342 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877345 2553 flags.go:64] FLAG: --register-node="true" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877348 2553 flags.go:64] FLAG: --register-with-taints="" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877351 2553 flags.go:64] FLAG: --registry-burst="10" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877356 2553 flags.go:64] FLAG: --registry-qps="5" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877359 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877361 2553 flags.go:64] FLAG: --reserved-memory="" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877365 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877368 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877370 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877373 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877376 2553 flags.go:64] FLAG: --runonce="false" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877379 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877381 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877384 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877388 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 13:58:19.216455 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877391 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877394 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877397 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877400 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877402 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877405 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877408 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877410 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877413 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877417 2553 flags.go:64] FLAG: --system-cgroups="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877419 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877424 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877427 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877430 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877433 2553 flags.go:64] FLAG: --tls-min-version="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877435 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877438 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877441 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877444 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877457 2553 flags.go:64] FLAG: --v="2" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877463 2553 flags.go:64] FLAG: --version="false" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877467 2553 flags.go:64] FLAG: --vmodule="" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877471 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.877474 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877589 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:19.217652 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877593 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877596 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877599 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877602 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877604 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877607 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877611 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877613 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877616 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877619 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877621 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877623 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877626 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877629 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877631 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877634 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877636 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877639 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877642 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:19.218390 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877644 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877647 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877649 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877652 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877656 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877659 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877662 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877665 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877670 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877672 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877675 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877678 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877680 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877683 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877685 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877688 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877691 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877693 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877695 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:19.219003 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877699 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877702 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877704 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877707 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877709 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877712 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877714 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877717 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877719 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877722 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877724 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877727 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877730 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877732 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877735 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877737 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877740 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877743 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877745 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877747 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:19.219637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877750 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877754 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877757 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877760 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877764 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877767 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877770 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877773 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877776 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877778 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877781 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877783 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877787 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877790 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877792 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877795 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877797 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877800 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877802 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877805 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:19.220441 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877808 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877810 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877812 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877815 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877817 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877821 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877823 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877825 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877828 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877830 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877833 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877835 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877838 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877841 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877845 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877849 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877851 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877855 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877857 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:19.221070 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.877860 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.878558 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.886397 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.886413 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.888031 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.888040 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888095 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888101 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888105 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888109 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888112 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888115 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888118 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888120 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:19.221611 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888123 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888126 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888129 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888132 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888135 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888138 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888140 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888143 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888145 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888148 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888151 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888153 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888156 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888159 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888162 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888177 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888183 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888185 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888188 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888191 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:19.222030 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888194 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888196 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888199 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888202 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888204 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888207 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888209 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888212 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888214 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888217 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888220 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888222 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888225 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888228 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888231 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888233 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888236 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888238 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888241 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888244 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:19.222580 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888246 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888249 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888251 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888254 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888257 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888261 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888263 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888266 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888268 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888271 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888274 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888276 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888280 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888287 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888290 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888293 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888295 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888298 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888300 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888303 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:19.223135 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888308 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888310 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888313 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888315 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888318 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888321 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888323 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888326 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888329 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888331 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888334 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888337 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888340 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888343 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888346 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888350 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888353 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888356 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888359 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:19.223688 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888362 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888364 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888367 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888369 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888372 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888374 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888378 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888381 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888384 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888387 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888391 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888394 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.888399 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888509 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:19.224240 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888515 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888518 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888521 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888525 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888528 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888531 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888534 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888536 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888539 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888542 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888544 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888548 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888551 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888553 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888557 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888561 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888564 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888568 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888571 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:19.224930 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888574 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888577 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888580 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888583 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888586 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888589 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888593 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888595 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888598 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888600 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888603 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888605 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888609 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888612 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888614 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888617 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888619 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888622 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888625 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888628 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:19.225510 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888630 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888633 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888635 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888638 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888641 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888644 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888647 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888649 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888651 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888654 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888657 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888659 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888662 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888665 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888667 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888670 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888672 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888675 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888678 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888681 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:19.387880 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888684 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888686 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888689 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888692 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888696 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888698 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888701 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888703 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888706 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888708 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888711 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888713 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888716 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888719 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888721 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888724 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888726 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888729 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888734 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:19.388728 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888737 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888740 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888742 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888745 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888747 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888750 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888752 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888755 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888757 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888760 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888762 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888766 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888769 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888772 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888774 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888777 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888780 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888783 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888786 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:19.389275 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:18.888788 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.888794 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.888913 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.892072 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.893814 2553 server.go:1019] "Starting client certificate rotation" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.893917 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.893947 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.896435 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.897536 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.907599 2553 log.go:25] "Validated CRI v1 runtime API" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.909845 2553 log.go:25] "Validated CRI v1 image API" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.911499 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 13:58:19.389813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.913901 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af00b698-ba5d-41a5-88aa-785cea9da6c1:/dev/nvme0n1p4 f4d565e4-3650-4b09-9888-80dcc52229d0:/dev/nvme0n1p3] Jul 09 13:58:19.390159 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.913917 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.919878 2553 manager.go:216] Machine: {Timestamp:2026-07-09 13:58:18.918651033 +0000 UTC m=+0.320817538 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106452 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2709715da87c0a066ea126db5d304e SystemUUID:ec270971-5da8-7c0a-066e-a126db5d304e BootID:2bb41c9f-9aee-43e9-a996-21f4e3e9d381 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:ec:a0:d1:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:ec:a0:d1:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:87:1d:51:2d:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.919968 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.920030 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.923191 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.923217 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.924051 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.924065 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 13:58:19.390278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.924074 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.924760 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.925937 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.928288 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.929421 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.929587 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.929618 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.931328 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.931351 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.931365 2553 kubelet.go:398] "Adding apiserver pod source" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.931396 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.931837 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.931888 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.934335 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.936833 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.936860 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937527 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937540 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937545 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937551 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937559 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937564 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937572 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937577 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937583 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937588 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937596 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.937604 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.938431 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.938438 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.941776 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.941798 2553 server.go:1268] "Started kubelet" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.941850 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.942027 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.942081 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.942162 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.942518 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.943934 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.944006 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 09 13:58:19.390549 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.945869 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.946812 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n4msp" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.947386 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-27.ec2.internal.18c0a3c057db91c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-27.ec2.internal,UID:ip-10-0-132-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-27.ec2.internal,},FirstTimestamp:2026-07-09 13:58:18.94177223 +0000 UTC m=+0.343938736,LastTimestamp:2026-07-09 13:58:18.94177223 +0000 UTC m=+0.343938736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-27.ec2.internal,}" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.951417 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.951431 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.951567 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952095 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952113 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952204 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952294 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952305 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952493 2553 factory.go:55] Registering systemd factory Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952505 2553 factory.go:223] Registration of the systemd container factory successfully Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952694 2553 factory.go:153] Registering CRI-O factory Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952703 2553 factory.go:223] Registration of the crio container factory successfully Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952747 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952764 2553 factory.go:103] Registering Raw factory Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.952774 2553 manager.go:1196] Started watching for new ooms in manager Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.953234 2553 manager.go:349] Starting recovery of all containers Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.954639 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:18.954848 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.954778 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n4msp" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.965859 2553 manager.go:354] Recovery completed Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.969910 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.971664 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.971692 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.971701 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972235 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972247 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972249 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972265 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972907 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972929 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.391634 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.972938 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.973470 2553 policy_none.go:49] "None policy: Start" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.973482 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.973491 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:18.974525 2553 policy_none.go:47] "Start" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.018923 2553 manager.go:337] "Starting Device Plugin manager" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.019053 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.019064 2553 server.go:87] "Starting device plugin registration server" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.019252 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.019261 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.020014 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.020143 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.020152 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.021246 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.021284 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.104940 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.106124 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.106153 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.106189 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.106227 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.109391 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.120966 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.121666 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.121690 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.121700 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.121721 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.130565 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.130585 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-27.ec2.internal\": node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.146921 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.207098 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal"] Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.207188 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.207875 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.207900 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.207909 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.209333 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.209455 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.209484 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.209922 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.392540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.209950 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.209966 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.210007 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.210029 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.210041 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.211579 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.211605 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.212227 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.212247 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.212261 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.243857 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-27.ec2.internal\" not found" node="ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.247865 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.248141 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-27.ec2.internal\" not found" node="ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.347932 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.354269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fba6338be0b99866e9d3da952db4f50-config\") pod \"kube-apiserver-proxy-ip-10-0-132-27.ec2.internal\" (UID: \"2fba6338be0b99866e9d3da952db4f50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.354315 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c02ee31496adf67fc996998dae99e41-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"2c02ee31496adf67fc996998dae99e41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:19.393545 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.354333 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c02ee31496adf67fc996998dae99e41-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"2c02ee31496adf67fc996998dae99e41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:19.448640 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.455006 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c02ee31496adf67fc996998dae99e41-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"2c02ee31496adf67fc996998dae99e41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.455025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fba6338be0b99866e9d3da952db4f50-config\") pod \"kube-apiserver-proxy-ip-10-0-132-27.ec2.internal\" (UID: \"2fba6338be0b99866e9d3da952db4f50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.455039 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c02ee31496adf67fc996998dae99e41-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"2c02ee31496adf67fc996998dae99e41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.455075 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c02ee31496adf67fc996998dae99e41-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"2c02ee31496adf67fc996998dae99e41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.455099 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c02ee31496adf67fc996998dae99e41-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"2c02ee31496adf67fc996998dae99e41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:19.455122 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fba6338be0b99866e9d3da952db4f50-config\") pod \"kube-apiserver-proxy-ip-10-0-132-27.ec2.internal\" (UID: \"2fba6338be0b99866e9d3da952db4f50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:20.734057 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:20.736794 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:20.764875 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:20.740061 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jul 09 13:58:20.962483 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:20.837423 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:20.962483 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:20.937539 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:21.140977 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:21.039460 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:21.140977 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.069060 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:21.140977 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.080609 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 13:58:21.140977 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.080692 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:58:21.140977 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.080716 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:58:21.140977 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:21.139962 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:21.316101 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.153046 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:53:20 +0000 UTC" deadline="2028-04-12 19:20:26.65374086 +0000 UTC" Jul 09 13:58:21.316101 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.153467 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15437h22m5.500276845s" Jul 09 13:58:21.316101 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:21.240295 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:21.414393 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:21.341380 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jul 09 13:58:21.414393 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.347486 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:21.414393 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.358669 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:21.414393 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:21.385775 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c02ee31496adf67fc996998dae99e41.slice/crio-a7742cd03525494733d9265e8bf787fd55b6cd614223005c530855695b36c0e7 WatchSource:0}: Error finding container a7742cd03525494733d9265e8bf787fd55b6cd614223005c530855695b36c0e7: Status 404 returned error can't find the container with id a7742cd03525494733d9265e8bf787fd55b6cd614223005c530855695b36c0e7 Jul 09 13:58:21.414393 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:21.385944 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fba6338be0b99866e9d3da952db4f50.slice/crio-d9f7976519cefbfeb970d48e183263d5c1679e7607fa5d79e865e7de0c67f182 WatchSource:0}: Error finding container d9f7976519cefbfeb970d48e183263d5c1679e7607fa5d79e865e7de0c67f182: Status 404 returned error can't find the container with id d9f7976519cefbfeb970d48e183263d5c1679e7607fa5d79e865e7de0c67f182 Jul 09 13:58:21.414393 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.389916 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:58:21.568329 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.440034 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jul 09 13:58:21.568329 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.451912 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:58:21.568329 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.452753 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jul 09 13:58:21.568329 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:21.463640 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:58:22.092884 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.049858 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.123314 2553 apiserver.go:52] "Watching apiserver" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.131978 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.132407 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-whglc","openshift-ovn-kubernetes/ovnkube-node-48d8p","kube-system/global-pull-secret-syncer-ftsfn","kube-system/konnectivity-agent-q9nh8","openshift-cluster-node-tuning-operator/tuned-fkbs7","openshift-image-registry/node-ca-9pfvf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal","openshift-multus/multus-additional-cni-plugins-klgkj","openshift-multus/network-metrics-daemon-6pjbl","openshift-network-operator/iptables-alerter-g6k8s","kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw","openshift-dns/node-resolver-p477f","openshift-multus/multus-9j65w"] Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.134711 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.137847 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.138049 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.138257 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.138745 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4jkf6\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.138954 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.139986 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.140046 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.140365 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.141403 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.141420 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zpwdq\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.141596 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.144601 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.153098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.145150 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.154771 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.153908 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 13:58:22.154771 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.154136 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6fc9n\"" Jul 09 13:58:22.154771 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.154358 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 13:58:22.154771 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.154543 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.155430 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.154787 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-flkmt\"" Jul 09 13:58:22.155430 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.155036 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157565 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c632e7c-2b72-4bab-9fd6-751002943a7f-iptables-alerter-script\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157628 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c632e7c-2b72-4bab-9fd6-751002943a7f-host-slash\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157658 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfac2c63-25e1-4469-b164-1546ec46a98b-hosts-file\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157682 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfac2c63-25e1-4469-b164-1546ec46a98b-tmp-dir\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863e7fcd-75f6-437a-8094-d5a450a7d826-dbus\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157730 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28w9p\" (UniqueName: \"kubernetes.io/projected/4c632e7c-2b72-4bab-9fd6-751002943a7f-kube-api-access-28w9p\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157751 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9555\" (UniqueName: \"kubernetes.io/projected/cfac2c63-25e1-4469-b164-1546ec46a98b-kube-api-access-s9555\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157775 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863e7fcd-75f6-437a-8094-d5a450a7d826-kubelet-config\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157803 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157835 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/605f0eef-837a-498b-a85b-98ce8216fb78-agent-certs\") pod \"konnectivity-agent-q9nh8\" (UID: \"605f0eef-837a-498b-a85b-98ce8216fb78\") " pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.157857 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/605f0eef-837a-498b-a85b-98ce8216fb78-konnectivity-ca\") pod \"konnectivity-agent-q9nh8\" (UID: \"605f0eef-837a-498b-a85b-98ce8216fb78\") " pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.158206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.158915 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.158283 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:22.161854 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.160882 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.161854 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.161378 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nw8wd\"" Jul 09 13:58:22.161854 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.161474 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.161854 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.161482 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.161854 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.161582 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 13:58:22.161854 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.161750 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:58:22.163182 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.163076 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 13:58:22.163182 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.163384 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.163182 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.163412 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 13:58:22.163182 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.163850 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.163182 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.164363 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.163182 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.164627 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xxbvb\"" Jul 09 13:58:22.166147 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.165665 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:22.166147 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.165699 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 13:58:22.166147 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.165751 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:22.166147 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.165942 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pcmzz\"" Jul 09 13:58:22.166643 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.166296 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 13:58:22.168224 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.167318 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 13:58:22.168224 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.167355 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.168224 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.167519 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 13:58:22.168224 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.167629 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.168224 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.168042 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.170969 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.170406 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 13:58:22.170969 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.170723 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.170969 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.170866 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7tnw\"" Jul 09 13:58:22.171294 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.171264 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 13:58:22.173691 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.173553 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 13:58:22.174359 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.173910 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 13:58:22.174359 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.174164 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 13:58:22.174359 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.174176 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27n56\"" Jul 09 13:58:22.175667 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.175451 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9g8d8" Jul 09 13:58:22.185000 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.184977 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9g8d8" Jul 09 13:58:22.241955 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.241747 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 13:58:22.258672 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.258650 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28w9p\" (UniqueName: \"kubernetes.io/projected/4c632e7c-2b72-4bab-9fd6-751002943a7f-kube-api-access-28w9p\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.258761 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.258714 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863e7fcd-75f6-437a-8094-d5a450a7d826-kubelet-config\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.258819 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.258769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-cni-bin\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.258819 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.258796 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-daemon-config\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.258926 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.258855 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-slash\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.259877 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.259180 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-env-overrides\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.259877 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.259233 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-registration-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.259877 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.259286 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.259877 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.259334 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.260046 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.259368 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-run-netns\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.260046 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.259975 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:22.260046 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260030 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-kubernetes\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.260164 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260061 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-sys\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.260164 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260094 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-etc-kubernetes\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.260164 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260137 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-lib-modules\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.260297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260169 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-var-lib-kubelet\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.260297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260197 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-host\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.260297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e9c1943-279e-42bf-a186-47c16d6b88aa-serviceca\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.260297 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260261 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.260472 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260298 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfac2c63-25e1-4469-b164-1546ec46a98b-tmp-dir\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.260472 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260327 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.260563 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-cni-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.260638 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260596 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysconfig\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.260689 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260658 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-device-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.260744 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260695 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-multus-certs\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.260968 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260949 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863e7fcd-75f6-437a-8094-d5a450a7d826-kubelet-config\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.261022 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.260949 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-systemd\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.261080 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.261064 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:22.261145 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261083 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-ovnkube-config\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.261369 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.261354 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:22.761326545 +0000 UTC m=+2.975552656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:22.261437 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261385 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfac2c63-25e1-4469-b164-1546ec46a98b-tmp-dir\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.261504 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261487 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysctl-conf\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.261551 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261527 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-cnibin\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.261602 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261557 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn8cv\" (UniqueName: \"kubernetes.io/projected/a5f66f5f-2878-4162-ae66-44837b44b6ce-kube-api-access-kn8cv\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.261759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c632e7c-2b72-4bab-9fd6-751002943a7f-iptables-alerter-script\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.261832 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261814 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c632e7c-2b72-4bab-9fd6-751002943a7f-host-slash\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.261891 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261858 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-netns\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.261943 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-conf-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.261943 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261922 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c632e7c-2b72-4bab-9fd6-751002943a7f-host-slash\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.262086 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.261962 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-cni-bin\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.262166 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-system-cni-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.262342 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262320 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.262400 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262367 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-ovnkube-script-lib\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.262444 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262399 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-run\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.262444 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262429 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.262533 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262492 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfac2c63-25e1-4469-b164-1546ec46a98b-hosts-file\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.262580 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-cnibin\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.262627 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.262627 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262606 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8tpv\" (UniqueName: \"kubernetes.io/projected/d640e396-5035-4aab-9fe7-06964070c2fb-kube-api-access-p8tpv\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.262748 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262625 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c632e7c-2b72-4bab-9fd6-751002943a7f-iptables-alerter-script\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.262748 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262639 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-systemd\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.262748 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262673 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2zxz\" (UniqueName: \"kubernetes.io/projected/bbf3bec5-f3a1-4284-abc6-286e47935c96-kube-api-access-t2zxz\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.262748 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-system-cni-dir\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.262748 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262741 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-sys-fs\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.262961 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262823 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-cni-multus\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.262961 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262860 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-modprobe-d\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.262961 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262889 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-tuned\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.262961 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkg68\" (UniqueName: \"kubernetes.io/projected/5e9c1943-279e-42bf-a186-47c16d6b88aa-kube-api-access-pkg68\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.262961 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262957 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-os-release\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.263201 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.262988 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-systemd-units\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.263201 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263021 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf3bec5-f3a1-4284-abc6-286e47935c96-tmp\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.263201 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9555\" (UniqueName: \"kubernetes.io/projected/cfac2c63-25e1-4469-b164-1546ec46a98b-kube-api-access-s9555\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.263201 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263067 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfac2c63-25e1-4469-b164-1546ec46a98b-hosts-file\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.263201 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263090 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/605f0eef-837a-498b-a85b-98ce8216fb78-agent-certs\") pod \"konnectivity-agent-q9nh8\" (UID: \"605f0eef-837a-498b-a85b-98ce8216fb78\") " pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.263201 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263141 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-k8s-cni-cncf-io\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.263464 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263401 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-kubelet\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.263464 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263437 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-etc-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.263564 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263483 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-node-log\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.263564 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263472 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 13:58:22.263564 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263519 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d640e396-5035-4aab-9fe7-06964070c2fb-ovn-node-metrics-cert\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.263564 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263551 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-cni-binary-copy\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.263737 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263579 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-kubelet\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.263737 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263611 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863e7fcd-75f6-437a-8094-d5a450a7d826-dbus\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.263737 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysctl-d\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.263737 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263717 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-os-release\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263739 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-hostroot\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263808 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263842 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/605f0eef-837a-498b-a85b-98ce8216fb78-konnectivity-ca\") pod \"konnectivity-agent-q9nh8\" (UID: \"605f0eef-837a-498b-a85b-98ce8216fb78\") " pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263873 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263897 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e9c1943-279e-42bf-a186-47c16d6b88aa-host\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.263938 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.263928 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-socket-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.264258 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.264020 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ls6r\" (UniqueName: \"kubernetes.io/projected/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-kube-api-access-2ls6r\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.264258 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.264052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8jh7\" (UniqueName: \"kubernetes.io/projected/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-kube-api-access-j8jh7\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.264258 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.264084 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-var-lib-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.264258 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.264131 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-cni-netd\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.264258 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.264168 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.264258 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.264197 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-socket-dir-parent\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.265030 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.265005 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55lp\" (UniqueName: \"kubernetes.io/projected/b224c32b-7b3b-4d25-84ce-868d610a2ae0-kube-api-access-d55lp\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.265128 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.265041 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863e7fcd-75f6-437a-8094-d5a450a7d826-dbus\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.265128 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.265096 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-ovn\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.265233 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.265144 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-log-socket\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.266056 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.266035 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/605f0eef-837a-498b-a85b-98ce8216fb78-konnectivity-ca\") pod \"konnectivity-agent-q9nh8\" (UID: \"605f0eef-837a-498b-a85b-98ce8216fb78\") " pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.268249 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.268187 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/605f0eef-837a-498b-a85b-98ce8216fb78-agent-certs\") pod \"konnectivity-agent-q9nh8\" (UID: \"605f0eef-837a-498b-a85b-98ce8216fb78\") " pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.271450 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.271356 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28w9p\" (UniqueName: \"kubernetes.io/projected/4c632e7c-2b72-4bab-9fd6-751002943a7f-kube-api-access-28w9p\") pod \"iptables-alerter-g6k8s\" (UID: \"4c632e7c-2b72-4bab-9fd6-751002943a7f\") " pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.272866 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.272844 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9555\" (UniqueName: \"kubernetes.io/projected/cfac2c63-25e1-4469-b164-1546ec46a98b-kube-api-access-s9555\") pod \"node-resolver-p477f\" (UID: \"cfac2c63-25e1-4469-b164-1546ec46a98b\") " pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.298984 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.298893 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" event={"ID":"2fba6338be0b99866e9d3da952db4f50","Type":"ContainerStarted","Data":"d9f7976519cefbfeb970d48e183263d5c1679e7607fa5d79e865e7de0c67f182"} Jul 09 13:58:22.300540 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.300491 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" event={"ID":"2c02ee31496adf67fc996998dae99e41","Type":"ContainerStarted","Data":"a7742cd03525494733d9265e8bf787fd55b6cd614223005c530855695b36c0e7"} Jul 09 13:58:22.366345 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366321 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-socket-dir-parent\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55lp\" (UniqueName: \"kubernetes.io/projected/b224c32b-7b3b-4d25-84ce-868d610a2ae0-kube-api-access-d55lp\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366383 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-ovn\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366404 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-log-socket\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366425 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-cni-bin\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366452 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-daemon-config\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-slash\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366489 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-env-overrides\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-registration-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366554 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-run-netns\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366601 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-kubernetes\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-sys\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.366883 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366653 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-etc-kubernetes\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366686 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-lib-modules\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366707 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-var-lib-kubelet\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366729 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-host\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366752 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e9c1943-279e-42bf-a186-47c16d6b88aa-serviceca\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366777 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366802 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366831 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-cni-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366854 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysconfig\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366878 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-device-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366916 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-multus-certs\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-systemd\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366966 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-ovnkube-config\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.366992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysctl-conf\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367016 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-host\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.367595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367047 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-cnibin\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn8cv\" (UniqueName: \"kubernetes.io/projected/a5f66f5f-2878-4162-ae66-44837b44b6ce-kube-api-access-kn8cv\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-netns\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367155 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-conf-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367179 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-cni-bin\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367202 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-ovn\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-system-cni-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367255 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367282 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-ovnkube-script-lib\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367302 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-system-cni-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367327 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-kubernetes\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367348 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-log-socket\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367398 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-run\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367444 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-cni-bin\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367820 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e9c1943-279e-42bf-a186-47c16d6b88aa-serviceca\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.368308 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367894 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-sys\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367912 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367941 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-etc-kubernetes\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367969 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-daemon-config\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368006 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-cni-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368033 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-slash\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368050 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-lib-modules\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.368072 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368099 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-var-lib-kubelet\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.368180 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:22.86813543 +0000 UTC m=+3.082361527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368234 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysctl-conf\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368287 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysconfig\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368343 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-device-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368350 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-cnibin\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.369008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368393 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-multus-certs\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368430 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-env-overrides\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368441 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-systemd\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368504 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-registration-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368578 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-netns\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368585 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368630 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-run-netns\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368637 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-cni-bin\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.367306 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-run\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368678 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-conf-dir\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368681 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368715 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-cnibin\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368724 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368739 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368761 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8tpv\" (UniqueName: \"kubernetes.io/projected/d640e396-5035-4aab-9fe7-06964070c2fb-kube-api-access-p8tpv\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.369708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-systemd\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368796 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2zxz\" (UniqueName: \"kubernetes.io/projected/bbf3bec5-f3a1-4284-abc6-286e47935c96-kube-api-access-t2zxz\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-system-cni-dir\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368839 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-sys-fs\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368862 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-cni-multus\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368879 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-modprobe-d\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368894 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-tuned\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368908 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkg68\" (UniqueName: \"kubernetes.io/projected/5e9c1943-279e-42bf-a186-47c16d6b88aa-kube-api-access-pkg68\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368905 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-ovnkube-config\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368953 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-system-cni-dir\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.368984 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-sys-fs\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369016 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-cni-multus\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369080 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-modprobe-d\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369257 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d640e396-5035-4aab-9fe7-06964070c2fb-ovnkube-script-lib\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.370476 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369312 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-run-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369325 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-multus-socket-dir-parent\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369367 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369389 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-os-release\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369418 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-systemd-units\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369447 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf3bec5-f3a1-4284-abc6-286e47935c96-tmp\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-k8s-cni-cncf-io\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369509 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-kubelet\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-etc-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369547 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-systemd\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369557 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-node-log\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369580 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d640e396-5035-4aab-9fe7-06964070c2fb-ovn-node-metrics-cert\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369601 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-cni-binary-copy\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369622 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-kubelet\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369650 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysctl-d\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.371186 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369672 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-os-release\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369696 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-hostroot\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369721 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369773 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369794 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e9c1943-279e-42bf-a186-47c16d6b88aa-host\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-socket-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369838 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ls6r\" (UniqueName: \"kubernetes.io/projected/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-kube-api-access-2ls6r\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369869 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8jh7\" (UniqueName: \"kubernetes.io/projected/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-kube-api-access-j8jh7\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-var-lib-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-cni-netd\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.369942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-hostroot\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370209 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-run-k8s-cni-cncf-io\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.371893 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370247 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-kubelet\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370282 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-cnibin\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370290 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-etc-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370326 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-node-log\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370351 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-os-release\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370426 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-systemd-units\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370440 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370507 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-sysctl-d\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370593 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f66f5f-2878-4162-ae66-44837b44b6ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-cni-binary-copy\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.370962 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-host-var-lib-kubelet\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371026 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f66f5f-2878-4162-ae66-44837b44b6ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371208 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371243 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e9c1943-279e-42bf-a186-47c16d6b88aa-host\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371281 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-var-lib-openvswitch\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.372606 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371334 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-socket-dir\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.373502 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371335 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d640e396-5035-4aab-9fe7-06964070c2fb-host-cni-netd\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.373502 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.371392 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-os-release\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.373502 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.372011 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf3bec5-f3a1-4284-abc6-286e47935c96-tmp\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.373502 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.372103 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbf3bec5-f3a1-4284-abc6-286e47935c96-etc-tuned\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.373502 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.373447 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d640e396-5035-4aab-9fe7-06964070c2fb-ovn-node-metrics-cert\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.377047 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.376758 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:22.377047 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.376786 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:22.377047 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.376801 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:22.377047 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.376853 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:22.876838531 +0000 UTC m=+3.091064648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:22.379577 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.379530 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55lp\" (UniqueName: \"kubernetes.io/projected/b224c32b-7b3b-4d25-84ce-868d610a2ae0-kube-api-access-d55lp\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.380724 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.380696 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ls6r\" (UniqueName: \"kubernetes.io/projected/9d90cdcf-725c-4b61-8d21-ee37f2feb39d-kube-api-access-2ls6r\") pod \"aws-ebs-csi-driver-node-8qpfw\" (UID: \"9d90cdcf-725c-4b61-8d21-ee37f2feb39d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.381683 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.381658 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn8cv\" (UniqueName: \"kubernetes.io/projected/a5f66f5f-2878-4162-ae66-44837b44b6ce-kube-api-access-kn8cv\") pod \"multus-additional-cni-plugins-klgkj\" (UID: \"a5f66f5f-2878-4162-ae66-44837b44b6ce\") " pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.382165 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.382095 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8tpv\" (UniqueName: \"kubernetes.io/projected/d640e396-5035-4aab-9fe7-06964070c2fb-kube-api-access-p8tpv\") pod \"ovnkube-node-48d8p\" (UID: \"d640e396-5035-4aab-9fe7-06964070c2fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.383421 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.383373 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8jh7\" (UniqueName: \"kubernetes.io/projected/e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb-kube-api-access-j8jh7\") pod \"multus-9j65w\" (UID: \"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb\") " pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.383949 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.383908 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2zxz\" (UniqueName: \"kubernetes.io/projected/bbf3bec5-f3a1-4284-abc6-286e47935c96-kube-api-access-t2zxz\") pod \"tuned-fkbs7\" (UID: \"bbf3bec5-f3a1-4284-abc6-286e47935c96\") " pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.384045 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.384012 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkg68\" (UniqueName: \"kubernetes.io/projected/5e9c1943-279e-42bf-a186-47c16d6b88aa-kube-api-access-pkg68\") pod \"node-ca-9pfvf\" (UID: \"5e9c1943-279e-42bf-a186-47c16d6b88aa\") " pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.490120 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.490080 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g6k8s" Jul 09 13:58:22.499847 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.499826 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p477f" Jul 09 13:58:22.516381 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.516359 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:22.524213 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.524196 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" Jul 09 13:58:22.530390 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.530369 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9pfvf" Jul 09 13:58:22.538621 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.538603 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9j65w" Jul 09 13:58:22.545758 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.545741 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:22.553779 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.553729 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klgkj" Jul 09 13:58:22.562014 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.561996 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" Jul 09 13:58:22.773272 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.773241 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:22.773447 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.773387 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:22.773447 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.773444 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:23.773428274 +0000 UTC m=+3.987654367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:22.874163 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.874070 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:22.874311 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.874212 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:22.874311 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.874277 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:23.874256735 +0000 UTC m=+4.088482843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:22.974644 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:22.974603 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:22.974814 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.974796 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:22.974876 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.974822 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:22.974876 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.974835 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:22.974978 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:22.974899 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:23.974878302 +0000 UTC m=+4.189104414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:23.133689 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.133613 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:23.188084 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.187995 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:53:22 +0000 UTC" deadline="2028-03-27 20:03:49.18988115 +0000 UTC" Jul 09 13:58:23.188084 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.188082 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15054h5m26.001806148s" Jul 09 13:58:23.283818 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.283790 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d90cdcf_725c_4b61_8d21_ee37f2feb39d.slice/crio-398f3bfcced0fcf90036eca29971b1cccd813980adf006137c48ea95032aff4d WatchSource:0}: Error finding container 398f3bfcced0fcf90036eca29971b1cccd813980adf006137c48ea95032aff4d: Status 404 returned error can't find the container with id 398f3bfcced0fcf90036eca29971b1cccd813980adf006137c48ea95032aff4d Jul 09 13:58:23.284679 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.284658 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfac2c63_25e1_4469_b164_1546ec46a98b.slice/crio-ec8ce516160213b1176a32456bbd96575c77fe5a89968c9e4eae49b8fde880e5 WatchSource:0}: Error finding container ec8ce516160213b1176a32456bbd96575c77fe5a89968c9e4eae49b8fde880e5: Status 404 returned error can't find the container with id ec8ce516160213b1176a32456bbd96575c77fe5a89968c9e4eae49b8fde880e5 Jul 09 13:58:23.302708 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.302681 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p477f" event={"ID":"cfac2c63-25e1-4469-b164-1546ec46a98b","Type":"ContainerStarted","Data":"ec8ce516160213b1176a32456bbd96575c77fe5a89968c9e4eae49b8fde880e5"} Jul 09 13:58:23.303806 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.303720 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" event={"ID":"9d90cdcf-725c-4b61-8d21-ee37f2feb39d","Type":"ContainerStarted","Data":"398f3bfcced0fcf90036eca29971b1cccd813980adf006137c48ea95032aff4d"} Jul 09 13:58:23.310637 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.310613 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7345eb7_e6ab_47db_bfdf_f4b75d39b4fb.slice/crio-cf8d99213054cba7f33dba524349f672041d96f41409f89ceb8334a584b43c74 WatchSource:0}: Error finding container cf8d99213054cba7f33dba524349f672041d96f41409f89ceb8334a584b43c74: Status 404 returned error can't find the container with id cf8d99213054cba7f33dba524349f672041d96f41409f89ceb8334a584b43c74 Jul 09 13:58:23.311559 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.311483 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c632e7c_2b72_4bab_9fd6_751002943a7f.slice/crio-126772c06f5862a570648032e96e655273cb0c5ff2f2677823206e1940dc246c WatchSource:0}: Error finding container 126772c06f5862a570648032e96e655273cb0c5ff2f2677823206e1940dc246c: Status 404 returned error can't find the container with id 126772c06f5862a570648032e96e655273cb0c5ff2f2677823206e1940dc246c Jul 09 13:58:23.312511 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.312402 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f66f5f_2878_4162_ae66_44837b44b6ce.slice/crio-6a60339264efff26bd9aaee5a7824072f41b0b118fe47db78e025d5701989fa3 WatchSource:0}: Error finding container 6a60339264efff26bd9aaee5a7824072f41b0b118fe47db78e025d5701989fa3: Status 404 returned error can't find the container with id 6a60339264efff26bd9aaee5a7824072f41b0b118fe47db78e025d5701989fa3 Jul 09 13:58:23.313329 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.313296 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605f0eef_837a_498b_a85b_98ce8216fb78.slice/crio-7101cf09fdb8c10b6a946a47a45b3a8b39e0de5da07ddf708fe16eb254508afb WatchSource:0}: Error finding container 7101cf09fdb8c10b6a946a47a45b3a8b39e0de5da07ddf708fe16eb254508afb: Status 404 returned error can't find the container with id 7101cf09fdb8c10b6a946a47a45b3a8b39e0de5da07ddf708fe16eb254508afb Jul 09 13:58:23.313989 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.313963 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9c1943_279e_42bf_a186_47c16d6b88aa.slice/crio-1d4b99d66f2347c6c05f5aa21e165e7a275338476cb0c6e597d9171ab1772e76 WatchSource:0}: Error finding container 1d4b99d66f2347c6c05f5aa21e165e7a275338476cb0c6e597d9171ab1772e76: Status 404 returned error can't find the container with id 1d4b99d66f2347c6c05f5aa21e165e7a275338476cb0c6e597d9171ab1772e76 Jul 09 13:58:23.315816 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.315742 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf3bec5_f3a1_4284_abc6_286e47935c96.slice/crio-b8af2374784d5fd6677aa0cbb75f04343ccf55213b05e1447b2e2c32e0a9414a WatchSource:0}: Error finding container b8af2374784d5fd6677aa0cbb75f04343ccf55213b05e1447b2e2c32e0a9414a: Status 404 returned error can't find the container with id b8af2374784d5fd6677aa0cbb75f04343ccf55213b05e1447b2e2c32e0a9414a Jul 09 13:58:23.316985 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:23.316753 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd640e396_5035_4aab_9fe7_06964070c2fb.slice/crio-dec5bd861b1414de98ba7daf661f369d75aafca9f364c4706b4686ed25923a67 WatchSource:0}: Error finding container dec5bd861b1414de98ba7daf661f369d75aafca9f364c4706b4686ed25923a67: Status 404 returned error can't find the container with id dec5bd861b1414de98ba7daf661f369d75aafca9f364c4706b4686ed25923a67 Jul 09 13:58:23.780677 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.779972 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:23.780677 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.780152 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:23.780677 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.780212 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:25.780195034 +0000 UTC m=+5.994421130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:23.881347 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.880785 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:23.881347 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.880918 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:23.881347 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.880981 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:25.880959614 +0000 UTC m=+6.095185711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:23.982078 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:23.982045 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:23.982248 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.982235 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:23.982306 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.982255 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:23.982306 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.982267 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:23.982412 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:23.982321 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:25.982304114 +0000 UTC m=+6.196530231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:24.188732 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.188642 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:53:22 +0000 UTC" deadline="2027-12-15 01:45:10.563521808 +0000 UTC" Jul 09 13:58:24.188732 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.188681 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12563h46m46.374845481s" Jul 09 13:58:24.297717 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.297247 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:24.297717 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.297389 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:24.297717 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:24.297383 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:24.297717 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.297455 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:24.297717 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:24.297545 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:24.297717 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:24.297622 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:24.315125 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.315009 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"dec5bd861b1414de98ba7daf661f369d75aafca9f364c4706b4686ed25923a67"} Jul 09 13:58:24.322623 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.322534 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9j65w" event={"ID":"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb","Type":"ContainerStarted","Data":"cf8d99213054cba7f33dba524349f672041d96f41409f89ceb8334a584b43c74"} Jul 09 13:58:24.326210 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.325683 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" event={"ID":"2fba6338be0b99866e9d3da952db4f50","Type":"ContainerStarted","Data":"f1c56e15d6df33a67a728ee46d27b1a7ed612a534065fc69425263675db8dc7f"} Jul 09 13:58:24.342040 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.341001 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" podStartSLOduration=3.340983018 podStartE2EDuration="3.340983018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:24.340446068 +0000 UTC m=+4.554672187" watchObservedRunningTime="2026-07-09 13:58:24.340983018 +0000 UTC m=+4.555209136" Jul 09 13:58:24.344045 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.344021 2553 generic.go:356] "Generic (PLEG): container finished" podID="2c02ee31496adf67fc996998dae99e41" containerID="adaf1bdfe3f64cd06c1f18781ed06a9f11080fae92cb5dc1486049142ec2fd1b" exitCode=0 Jul 09 13:58:24.344264 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.344244 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" event={"ID":"2c02ee31496adf67fc996998dae99e41","Type":"ContainerDied","Data":"adaf1bdfe3f64cd06c1f18781ed06a9f11080fae92cb5dc1486049142ec2fd1b"} Jul 09 13:58:24.353007 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.352954 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" event={"ID":"bbf3bec5-f3a1-4284-abc6-286e47935c96","Type":"ContainerStarted","Data":"b8af2374784d5fd6677aa0cbb75f04343ccf55213b05e1447b2e2c32e0a9414a"} Jul 09 13:58:24.359773 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.359748 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9pfvf" event={"ID":"5e9c1943-279e-42bf-a186-47c16d6b88aa","Type":"ContainerStarted","Data":"1d4b99d66f2347c6c05f5aa21e165e7a275338476cb0c6e597d9171ab1772e76"} Jul 09 13:58:24.375205 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.375159 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q9nh8" event={"ID":"605f0eef-837a-498b-a85b-98ce8216fb78","Type":"ContainerStarted","Data":"7101cf09fdb8c10b6a946a47a45b3a8b39e0de5da07ddf708fe16eb254508afb"} Jul 09 13:58:24.385225 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.385169 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerStarted","Data":"6a60339264efff26bd9aaee5a7824072f41b0b118fe47db78e025d5701989fa3"} Jul 09 13:58:24.401383 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:24.401359 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g6k8s" event={"ID":"4c632e7c-2b72-4bab-9fd6-751002943a7f","Type":"ContainerStarted","Data":"126772c06f5862a570648032e96e655273cb0c5ff2f2677823206e1940dc246c"} Jul 09 13:58:25.421759 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:25.421721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" event={"ID":"2c02ee31496adf67fc996998dae99e41","Type":"ContainerStarted","Data":"c9b7472155c7028642a92cf3b64debe3b9f979a2f3dc1852c3a63a5f9035150d"} Jul 09 13:58:25.796822 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:25.796743 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:25.796974 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.796920 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:25.797041 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.796983 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:29.796965192 +0000 UTC m=+10.011191300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:25.897415 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:25.897380 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:25.897582 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.897535 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:25.897642 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.897596 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:29.897575397 +0000 UTC m=+10.111801494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:25.998523 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:25.998488 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:25.998688 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.998668 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:25.998742 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.998688 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:25.998742 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.998704 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:25.998855 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:25.998759 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:29.998740977 +0000 UTC m=+10.212967085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:26.296363 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:26.296223 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:26.296363 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:26.296354 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:26.296755 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:26.296586 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:26.296755 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:26.296227 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:26.296755 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:26.296712 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:26.296958 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:26.296779 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:28.296673 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:28.296197 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:28.296673 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:28.296206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:28.296673 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:28.296318 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:28.296673 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:28.296409 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:28.296673 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:28.296453 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:28.296673 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:28.296548 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:29.828834 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:29.828763 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:29.829291 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:29.828929 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:29.829291 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:29.829010 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:37.828987633 +0000 UTC m=+18.043213742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:29.930595 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:29.930045 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:29.930595 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:29.930221 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:29.930595 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:29.930279 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:37.930260463 +0000 UTC m=+18.144486576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:30.031219 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:30.031182 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:30.031383 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.031355 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:30.031383 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.031376 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:30.031504 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.031388 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:30.031504 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.031449 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:38.031430691 +0000 UTC m=+18.245656795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:30.296995 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:30.296063 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:30.296995 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:30.296227 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:30.296995 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:30.296313 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:30.296995 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.296444 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:30.296995 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.296806 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:30.296995 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:30.296912 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:32.294957 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:32.294884 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:32.295519 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:32.295027 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:32.295519 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:32.295199 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:32.295519 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:32.295309 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:32.295519 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:32.295346 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:32.295519 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:32.295435 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:34.295296 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:34.295262 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:34.295683 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:34.295365 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:34.295683 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:34.295261 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:34.295683 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:34.295267 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:34.295683 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:34.295448 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:34.295683 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:34.295567 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:36.294580 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:36.294545 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:36.294580 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:36.294578 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:36.295085 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:36.294545 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:36.295085 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:36.294667 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:36.295085 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:36.294755 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:36.295085 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:36.294828 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:37.891331 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:37.891295 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:37.891749 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:37.891446 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:37.891749 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:37.891537 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:53.891513135 +0000 UTC m=+34.105739252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:37.992508 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:37.992473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:37.992636 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:37.992597 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:37.992676 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:37.992653 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:53.992638071 +0000 UTC m=+34.206864166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:38.093602 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:38.093526 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:38.093739 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.093670 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:38.093739 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.093696 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:38.093739 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.093710 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:38.093899 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.093774 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:54.093755417 +0000 UTC m=+34.307981514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:38.294532 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:38.294498 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:38.294532 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:38.294514 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:38.294718 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.294625 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:38.294718 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.294680 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:38.294803 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:38.294708 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:38.294803 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:38.294794 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:40.295168 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:40.295132 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:40.295604 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:40.295220 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:40.295604 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:40.295235 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:40.295604 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:40.295304 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:40.295604 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:40.295331 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:40.295604 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:40.295444 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:42.295282 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:42.295253 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:42.295579 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:42.295254 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:42.295579 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:42.295349 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:42.295579 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:42.295260 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:42.295579 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:42.295449 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:42.295579 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:42.295547 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:42.472616 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:42.472408 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q9nh8" event={"ID":"605f0eef-837a-498b-a85b-98ce8216fb78","Type":"ContainerStarted","Data":"d8296aacbaecef524a8c6d8614994938051a6c00f0fdde7dac74e77e0982d743"} Jul 09 13:58:42.492223 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:42.491431 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" podStartSLOduration=21.491410819 podStartE2EDuration="21.491410819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:25.460559562 +0000 UTC m=+5.674785679" watchObservedRunningTime="2026-07-09 13:58:42.491410819 +0000 UTC m=+22.705636936" Jul 09 13:58:43.475570 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.475376 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" event={"ID":"9d90cdcf-725c-4b61-8d21-ee37f2feb39d","Type":"ContainerStarted","Data":"140317818f29abefd419f733d0c0ca59a0ce7e9e78c2dbe0bb69a1f2f8c50332"} Jul 09 13:58:43.476714 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.476688 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" event={"ID":"bbf3bec5-f3a1-4284-abc6-286e47935c96","Type":"ContainerStarted","Data":"4f1f1cc886294aba813f58b15aec2da3bd04ba2fbfc24b3fc7398476a06a8142"} Jul 09 13:58:43.478028 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.478007 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9pfvf" event={"ID":"5e9c1943-279e-42bf-a186-47c16d6b88aa","Type":"ContainerStarted","Data":"3aec54e2429e0f8a4e2878e912f6c81aa914ccdb54a7b798ff7a0f1be289a084"} Jul 09 13:58:43.479340 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.479319 2553 generic.go:356] "Generic (PLEG): container finished" podID="a5f66f5f-2878-4162-ae66-44837b44b6ce" containerID="1785deef612376ea91ddc1700eff97d0613ad5805baf1b030bad6c2386f6b840" exitCode=0 Jul 09 13:58:43.479424 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.479383 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerDied","Data":"1785deef612376ea91ddc1700eff97d0613ad5805baf1b030bad6c2386f6b840"} Jul 09 13:58:43.480787 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.480760 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p477f" event={"ID":"cfac2c63-25e1-4469-b164-1546ec46a98b","Type":"ContainerStarted","Data":"06c6d4638477aab67ee25d51f228f9144ddfe45b620649150252bff36272177f"} Jul 09 13:58:43.483467 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483447 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 13:58:43.483800 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483785 2553 generic.go:356] "Generic (PLEG): container finished" podID="d640e396-5035-4aab-9fe7-06964070c2fb" containerID="e59d99fdf70edc6abef2abfd52a1d7b56dbc9d60583ff4cf8dfe1356b98bde73" exitCode=1 Jul 09 13:58:43.483864 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483843 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"ecc5251e50a504ad7d46625ba34fd3950cf8e1fe53a56e0c51efc063f8ce8a12"} Jul 09 13:58:43.483911 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483887 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"0063ad81332ff57b26e45e010e329aa89df471423705fb9d6e778f5b1e88f2d0"} Jul 09 13:58:43.483956 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483918 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"5f1458b8ea552ad76a76ccb4bdc21e5c53ffb127bb0f3e61f20bb902a0111cc0"} Jul 09 13:58:43.483956 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483946 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"be8e7b9a9bc2cecc15eba9d9faac38b1e80762effd96bcc01b99e91ee238e2b3"} Jul 09 13:58:43.484022 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483972 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerDied","Data":"e59d99fdf70edc6abef2abfd52a1d7b56dbc9d60583ff4cf8dfe1356b98bde73"} Jul 09 13:58:43.484022 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.483999 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"9fb400262348bbcd9e099d0564ec4bd88f2e7ed16b6a645a3ea3335dc73339ff"} Jul 09 13:58:43.485222 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.485205 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9j65w" event={"ID":"e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb","Type":"ContainerStarted","Data":"6fbbd218fb11a42c9e69246b1769709c10a14ac4efaec3033ce927ac0168d2b3"} Jul 09 13:58:43.496642 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.496601 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q9nh8" podStartSLOduration=9.007072476 podStartE2EDuration="23.496585292s" totalImagesPullingTime="14.489512816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:42.492156647 +0000 UTC m=+22.706382779" watchObservedRunningTime="2026-07-09 13:58:43.496585292 +0000 UTC m=+23.710811410" Jul 09 13:58:43.512490 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.512457 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fkbs7" podStartSLOduration=4.510929547 podStartE2EDuration="23.512448173s" totalImagesPullingTime="19.001518626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:43.496062339 +0000 UTC m=+23.710288455" watchObservedRunningTime="2026-07-09 13:58:43.512448173 +0000 UTC m=+23.726674288" Jul 09 13:58:43.512812 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.512794 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9j65w" podStartSLOduration=4.489136173 podStartE2EDuration="23.512791192s" totalImagesPullingTime="19.023655019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:43.512236039 +0000 UTC m=+23.726462180" watchObservedRunningTime="2026-07-09 13:58:43.512791192 +0000 UTC m=+23.727017308" Jul 09 13:58:43.526380 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.526342 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p477f" podStartSLOduration=4.512954665 podStartE2EDuration="23.526331402s" totalImagesPullingTime="19.013376737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:43.52628816 +0000 UTC m=+23.740514275" watchObservedRunningTime="2026-07-09 13:58:43.526331402 +0000 UTC m=+23.740557518" Jul 09 13:58:43.563063 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.563031 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9pfvf" podStartSLOduration=4.562325195 podStartE2EDuration="23.563021475s" totalImagesPullingTime="19.00069628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:43.562724425 +0000 UTC m=+23.776950540" watchObservedRunningTime="2026-07-09 13:58:43.563021475 +0000 UTC m=+23.777247591" Jul 09 13:58:43.753238 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.753213 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:43.753684 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.753669 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:43.805484 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:43.805465 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 13:58:44.224590 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.224461 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:58:43.80548058Z","UUID":"4c1af4ec-678a-4bbb-9b8a-ac4b098595f2","Handler":null,"Name":"","Endpoint":""} Jul 09 13:58:44.226076 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.226054 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 13:58:44.226221 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.226096 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 13:58:44.294888 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.294863 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:44.294888 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.294883 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:44.295094 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.294900 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:44.295094 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:44.294991 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:44.295437 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:44.295406 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:44.295618 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:44.295507 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:44.489644 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.489562 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" event={"ID":"9d90cdcf-725c-4b61-8d21-ee37f2feb39d","Type":"ContainerStarted","Data":"7f4db5516edf52ae902826ba55b330c5a0b9fbd4e0c41261df442be4a38e7e10"} Jul 09 13:58:44.491483 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.491451 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g6k8s" event={"ID":"4c632e7c-2b72-4bab-9fd6-751002943a7f","Type":"ContainerStarted","Data":"80d637c6b48bef17727ce10eab4f27778d89c693d68a062a70acd63f87df3924"} Jul 09 13:58:44.492276 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.492257 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:44.492723 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.492691 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q9nh8" Jul 09 13:58:44.507085 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:44.507043 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g6k8s" podStartSLOduration=5.531140698 podStartE2EDuration="24.507030298s" totalImagesPullingTime="18.9758896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:44.506573104 +0000 UTC m=+24.720799239" watchObservedRunningTime="2026-07-09 13:58:44.507030298 +0000 UTC m=+24.721256414" Jul 09 13:58:45.496914 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:45.496704 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 13:58:45.497369 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:45.497344 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"1bcbfc372d4f63b75fc065ce8053d7c810b0e713c72dcdc9c6f59000730c4251"} Jul 09 13:58:45.499552 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:45.499508 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" event={"ID":"9d90cdcf-725c-4b61-8d21-ee37f2feb39d","Type":"ContainerStarted","Data":"47221e5b448f974bb75ea39a942db45d05f8a36ca2ad8e8ac689359e5dee83e2"} Jul 09 13:58:45.518237 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:45.518187 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qpfw" podStartSLOduration=4.204215989 podStartE2EDuration="25.518172383s" totalImagesPullingTime="21.313956394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:45.51798597 +0000 UTC m=+25.732212104" watchObservedRunningTime="2026-07-09 13:58:45.518172383 +0000 UTC m=+25.732398498" Jul 09 13:58:46.295309 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:46.295276 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:46.295492 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:46.295436 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:46.295492 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:46.295282 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:46.295609 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:46.295556 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:46.295609 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:46.295281 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:46.295710 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:46.295628 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:48.294743 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.294569 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:48.295337 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.294569 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:48.295337 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:48.294850 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:48.295337 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.294614 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:48.295337 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:48.294935 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:48.295337 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:48.295012 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:48.510717 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.510696 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 13:58:48.511141 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.511100 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"6d29e3c6c7f783495053c55dcfb4a3664df21b55f7eda1d778119197de645b8f"} Jul 09 13:58:48.511375 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.511357 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:48.511544 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.511528 2553 scope.go:117] "RemoveContainer" containerID="e59d99fdf70edc6abef2abfd52a1d7b56dbc9d60583ff4cf8dfe1356b98bde73" Jul 09 13:58:48.513067 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.513044 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerStarted","Data":"069057f203b93bf92a5007ce0b44953ba5cb9139de76b45aac0c9a947cd0136e"} Jul 09 13:58:48.526154 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:48.526135 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:49.516789 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.516754 2553 generic.go:356] "Generic (PLEG): container finished" podID="a5f66f5f-2878-4162-ae66-44837b44b6ce" containerID="069057f203b93bf92a5007ce0b44953ba5cb9139de76b45aac0c9a947cd0136e" exitCode=0 Jul 09 13:58:49.517377 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.516835 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerDied","Data":"069057f203b93bf92a5007ce0b44953ba5cb9139de76b45aac0c9a947cd0136e"} Jul 09 13:58:49.520772 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.520754 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 13:58:49.521089 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.521068 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" event={"ID":"d640e396-5035-4aab-9fe7-06964070c2fb","Type":"ContainerStarted","Data":"3c0252e7317e301f3416c9853c487598b0b53f98847213a797304b462fe229cf"} Jul 09 13:58:49.521397 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.521381 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:49.521456 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.521440 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:49.537015 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.536994 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:58:49.566818 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:49.566776 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" podStartSLOduration=10.451325389 podStartE2EDuration="29.566762476s" totalImagesPullingTime="19.115437087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:49.566624746 +0000 UTC m=+29.780850882" watchObservedRunningTime="2026-07-09 13:58:49.566762476 +0000 UTC m=+29.780988591" Jul 09 13:58:50.087614 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:50.087583 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftsfn"] Jul 09 13:58:50.087748 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:50.087689 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:50.087809 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:50.087785 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:50.090822 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:50.090797 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whglc"] Jul 09 13:58:50.090934 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:50.090918 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:50.091034 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:50.091011 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:50.091537 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:50.091506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6pjbl"] Jul 09 13:58:50.091627 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:50.091612 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:50.091712 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:50.091694 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:51.527638 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:51.527465 2553 generic.go:356] "Generic (PLEG): container finished" podID="a5f66f5f-2878-4162-ae66-44837b44b6ce" containerID="8d9877fc235b396962e9f867f5729525f5c28cc720877ac88498fd36a2481ffb" exitCode=0 Jul 09 13:58:51.527949 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:51.527546 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerDied","Data":"8d9877fc235b396962e9f867f5729525f5c28cc720877ac88498fd36a2481ffb"} Jul 09 13:58:52.297144 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:52.297101 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:52.297278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:52.297102 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:52.297278 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:52.297222 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:52.297278 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:52.297101 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:52.297395 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:52.297280 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:52.297395 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:52.297348 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:53.534959 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:53.534927 2553 generic.go:356] "Generic (PLEG): container finished" podID="a5f66f5f-2878-4162-ae66-44837b44b6ce" containerID="912dacbf3c3474edc7791f30587accdcbc92b6a32d9da86411f539576cba2511" exitCode=0 Jul 09 13:58:53.535611 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:53.535006 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerDied","Data":"912dacbf3c3474edc7791f30587accdcbc92b6a32d9da86411f539576cba2511"} Jul 09 13:58:53.918716 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:53.918688 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:53.918811 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:53.918799 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:53.918853 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:53.918845 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret podName:863e7fcd-75f6-437a-8094-d5a450a7d826 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:25.918832841 +0000 UTC m=+66.133058936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret") pod "global-pull-secret-syncer-ftsfn" (UID: "863e7fcd-75f6-437a-8094-d5a450a7d826") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:54.018980 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:54.018955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:54.019086 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.019042 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:54.019183 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.019088 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.019072803 +0000 UTC m=+66.233298899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:54.120184 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:54.120160 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:54.120315 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.120300 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:54.120358 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.120321 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:54.120358 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.120330 2553 projected.go:196] Error preparing data for projected volume kube-api-access-kvvm8 for pod openshift-network-diagnostics/network-check-target-whglc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:54.120447 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.120375 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8 podName:4d45d012-bd4a-4b24-bd93-8461d2cd08b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.120358587 +0000 UTC m=+66.334584683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvvm8" (UniqueName: "kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8") pod "network-check-target-whglc" (UID: "4d45d012-bd4a-4b24-bd93-8461d2cd08b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:54.295187 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:54.294963 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:54.295187 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:54.294972 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:54.295187 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.295086 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftsfn" podUID="863e7fcd-75f6-437a-8094-d5a450a7d826" Jul 09 13:58:54.295377 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:54.294973 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:54.295377 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.295272 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pjbl" podUID="b224c32b-7b3b-4d25-84ce-868d610a2ae0" Jul 09 13:58:54.295377 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:54.295291 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whglc" podUID="4d45d012-bd4a-4b24-bd93-8461d2cd08b7" Jul 09 13:58:55.044571 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.044539 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeReady" Jul 09 13:58:55.044990 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.044663 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 13:58:55.085967 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.085899 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bwk8l"] Jul 09 13:58:55.089261 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.089237 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bkx2n"] Jul 09 13:58:55.089383 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.089363 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.091063 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.091041 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.092360 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.092340 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 13:58:55.092781 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.092761 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 13:58:55.093002 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.092986 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf6lw\"" Jul 09 13:58:55.093910 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.093891 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 13:58:55.093999 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.093952 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jssv4\"" Jul 09 13:58:55.094319 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.094193 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 13:58:55.094598 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.094575 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 13:58:55.099128 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.098821 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bwk8l"] Jul 09 13:58:55.101644 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.101583 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bkx2n"] Jul 09 13:58:55.230357 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.230322 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwzz\" (UniqueName: \"kubernetes.io/projected/b861d323-e422-48e5-a5e2-d0f9455aa881-kube-api-access-mcwzz\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.230483 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.230382 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.230483 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.230433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b861d323-e422-48e5-a5e2-d0f9455aa881-config-volume\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.230483 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.230472 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfcf4\" (UniqueName: \"kubernetes.io/projected/702ca2b3-c17e-41b3-af44-5fd6a31cfd88-kube-api-access-jfcf4\") pod \"ingress-canary-bkx2n\" (UID: \"702ca2b3-c17e-41b3-af44-5fd6a31cfd88\") " pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.230620 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.230533 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b861d323-e422-48e5-a5e2-d0f9455aa881-tmp-dir\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.230620 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.230575 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/702ca2b3-c17e-41b3-af44-5fd6a31cfd88-cert\") pod \"ingress-canary-bkx2n\" (UID: \"702ca2b3-c17e-41b3-af44-5fd6a31cfd88\") " pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.331551 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.331521 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.331680 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.331569 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b861d323-e422-48e5-a5e2-d0f9455aa881-config-volume\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.331680 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.331605 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfcf4\" (UniqueName: \"kubernetes.io/projected/702ca2b3-c17e-41b3-af44-5fd6a31cfd88-kube-api-access-jfcf4\") pod \"ingress-canary-bkx2n\" (UID: \"702ca2b3-c17e-41b3-af44-5fd6a31cfd88\") " pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.331680 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.331671 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b861d323-e422-48e5-a5e2-d0f9455aa881-tmp-dir\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.331808 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.331696 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/702ca2b3-c17e-41b3-af44-5fd6a31cfd88-cert\") pod \"ingress-canary-bkx2n\" (UID: \"702ca2b3-c17e-41b3-af44-5fd6a31cfd88\") " pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.331808 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.331716 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwzz\" (UniqueName: \"kubernetes.io/projected/b861d323-e422-48e5-a5e2-d0f9455aa881-kube-api-access-mcwzz\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.331808 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:55.331672 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:55.331808 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:55.331802 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:55.831779993 +0000 UTC m=+36.046006105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:58:55.332175 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.332156 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b861d323-e422-48e5-a5e2-d0f9455aa881-tmp-dir\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.332283 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.332262 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b861d323-e422-48e5-a5e2-d0f9455aa881-config-volume\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.336349 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.336302 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/702ca2b3-c17e-41b3-af44-5fd6a31cfd88-cert\") pod \"ingress-canary-bkx2n\" (UID: \"702ca2b3-c17e-41b3-af44-5fd6a31cfd88\") " pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.342975 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.342956 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwzz\" (UniqueName: \"kubernetes.io/projected/b861d323-e422-48e5-a5e2-d0f9455aa881-kube-api-access-mcwzz\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.343493 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.343474 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfcf4\" (UniqueName: \"kubernetes.io/projected/702ca2b3-c17e-41b3-af44-5fd6a31cfd88-kube-api-access-jfcf4\") pod \"ingress-canary-bkx2n\" (UID: \"702ca2b3-c17e-41b3-af44-5fd6a31cfd88\") " pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.408226 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.408192 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bkx2n" Jul 09 13:58:55.554138 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.553906 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bkx2n"] Jul 09 13:58:55.557763 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:58:55.557734 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702ca2b3_c17e_41b3_af44_5fd6a31cfd88.slice/crio-4347e3ffb349d25ffeab450d040b97b096e764940302418f0dfb236ca1c19e4b WatchSource:0}: Error finding container 4347e3ffb349d25ffeab450d040b97b096e764940302418f0dfb236ca1c19e4b: Status 404 returned error can't find the container with id 4347e3ffb349d25ffeab450d040b97b096e764940302418f0dfb236ca1c19e4b Jul 09 13:58:55.835339 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:55.835314 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:55.835504 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:55.835485 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:55.835582 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:55.835570 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:56.83554738 +0000 UTC m=+37.049773488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:58:56.294769 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.294737 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:58:56.294769 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.294759 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:58:56.295404 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.295126 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:58:56.297964 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.297939 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:58:56.298199 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.298178 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:58:56.299239 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.299078 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:58:56.299239 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.299087 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2p5t2\"" Jul 09 13:58:56.299691 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.299531 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwpwr\"" Jul 09 13:58:56.299691 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.299588 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:58:56.543666 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.543622 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bkx2n" event={"ID":"702ca2b3-c17e-41b3-af44-5fd6a31cfd88","Type":"ContainerStarted","Data":"4347e3ffb349d25ffeab450d040b97b096e764940302418f0dfb236ca1c19e4b"} Jul 09 13:58:56.844366 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:56.844332 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:56.844548 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:56.844467 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:56.844548 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:56.844533 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:58.844515078 +0000 UTC m=+39.058741184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:58:58.858794 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:58.858758 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:58:58.859230 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:58.858864 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:58.859230 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:58:58.858915 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:02.858901708 +0000 UTC m=+43.073127802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:58:59.553240 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:59.553026 2553 generic.go:356] "Generic (PLEG): container finished" podID="a5f66f5f-2878-4162-ae66-44837b44b6ce" containerID="e6f6eebfe0c58320987f3353eced1537a643ec5134026b15301d7e10c4e19411" exitCode=0 Jul 09 13:58:59.553412 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:59.553100 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerDied","Data":"e6f6eebfe0c58320987f3353eced1537a643ec5134026b15301d7e10c4e19411"} Jul 09 13:58:59.554986 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:59.554962 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bkx2n" event={"ID":"702ca2b3-c17e-41b3-af44-5fd6a31cfd88","Type":"ContainerStarted","Data":"e5aa2e33f66215564da6f4577a90d8ac21aa0d3a532fac04d560268994f40410"} Jul 09 13:58:59.596378 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:58:59.596330 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bkx2n" podStartSLOduration=1.273257618 podStartE2EDuration="4.596310269s" totalImagesPullingTime="3.323052651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:59.595260387 +0000 UTC m=+39.809486506" watchObservedRunningTime="2026-07-09 13:58:59.596310269 +0000 UTC m=+39.810536386" Jul 09 13:59:00.561891 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:00.561856 2553 generic.go:356] "Generic (PLEG): container finished" podID="a5f66f5f-2878-4162-ae66-44837b44b6ce" containerID="e40785b478f3bf8b26aa8ff6a389347da7a8bd81be1141ca8248bdefc13a5136" exitCode=0 Jul 09 13:59:00.562589 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:00.561901 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerDied","Data":"e40785b478f3bf8b26aa8ff6a389347da7a8bd81be1141ca8248bdefc13a5136"} Jul 09 13:59:01.567165 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:01.567129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klgkj" event={"ID":"a5f66f5f-2878-4162-ae66-44837b44b6ce","Type":"ContainerStarted","Data":"d6f7092851605d92c3b8afd208d48d856ca491bb1f214a803c4061493d3f8ac2"} Jul 09 13:59:01.590365 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:01.590320 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-klgkj" podStartSLOduration=9.996983632 podStartE2EDuration="41.590306175s" totalImagesPullingTime="31.593322543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:01.58841396 +0000 UTC m=+41.802640077" watchObservedRunningTime="2026-07-09 13:59:01.590306175 +0000 UTC m=+41.804532343" Jul 09 13:59:02.884546 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:02.884516 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:59:02.884885 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:02.884604 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:59:02.884885 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:02.884651 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:10.884637689 +0000 UTC m=+51.098863783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:59:10.936494 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:10.936449 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:59:10.937002 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:10.936578 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:59:10.937002 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:10.936634 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.936619503 +0000 UTC m=+67.150845597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:59:21.539778 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:21.539744 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48d8p" Jul 09 13:59:24.623460 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.623421 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc"] Jul 09 13:59:24.626612 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.626582 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-598c56748b-jjshs"] Jul 09 13:59:24.626771 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.626704 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.628523 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.628497 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.629651 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.629616 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 13:59:24.629812 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.629664 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 13:59:24.629812 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.629695 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5gwtc\"" Jul 09 13:59:24.631214 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.631192 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 13:59:24.631342 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.631242 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 13:59:24.631342 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.631290 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 13:59:24.632023 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.632001 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 13:59:24.632023 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.632006 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 13:59:24.632346 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.632329 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 13:59:24.632396 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.632330 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 13:59:24.632655 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.632621 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7qscq\"" Jul 09 13:59:24.632655 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.632633 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 13:59:24.638580 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.638555 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc"] Jul 09 13:59:24.641513 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.641463 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-598c56748b-jjshs"] Jul 09 13:59:24.724142 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724102 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed0a9e05-e63a-4057-975f-24f38ac5d823-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.724142 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724149 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9d58\" (UniqueName: \"kubernetes.io/projected/ed0a9e05-e63a-4057-975f-24f38ac5d823-kube-api-access-d9d58\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.724298 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.724298 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.724371 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724307 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.724371 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-stats-auth\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.724371 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724352 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b856v\" (UniqueName: \"kubernetes.io/projected/d5840237-f1e6-4287-8890-6dd0fc4d82e0-kube-api-access-b856v\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.724474 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.724373 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-default-certificate\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.824826 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824797 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.824917 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824849 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.824917 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824880 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-stats-auth\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.824917 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824900 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b856v\" (UniqueName: \"kubernetes.io/projected/d5840237-f1e6-4287-8890-6dd0fc4d82e0-kube-api-access-b856v\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.825048 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824921 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-default-certificate\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.825048 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:24.824933 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:24.825048 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824943 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed0a9e05-e63a-4057-975f-24f38ac5d823-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.825048 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.824969 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9d58\" (UniqueName: \"kubernetes.io/projected/ed0a9e05-e63a-4057-975f-24f38ac5d823-kube-api-access-d9d58\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.825048 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:24.824995 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls podName:ed0a9e05-e63a-4057-975f-24f38ac5d823 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:25.324979515 +0000 UTC m=+65.539205612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6v6dc" (UID: "ed0a9e05-e63a-4057-975f-24f38ac5d823") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:24.825048 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.825016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.825309 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:24.825063 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:25.325042758 +0000 UTC m=+65.539268889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : configmap references non-existent config key: service-ca.crt Jul 09 13:59:24.825792 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:24.825769 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:59:24.825956 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:24.825943 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:25.325925445 +0000 UTC m=+65.540151582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : secret "router-metrics-certs-default" not found Jul 09 13:59:24.826574 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.826544 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed0a9e05-e63a-4057-975f-24f38ac5d823-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:24.830861 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.830833 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-stats-auth\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.830950 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.830864 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-default-certificate\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.835520 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.835482 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b856v\" (UniqueName: \"kubernetes.io/projected/d5840237-f1e6-4287-8890-6dd0fc4d82e0-kube-api-access-b856v\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:24.837471 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:24.837451 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9d58\" (UniqueName: \"kubernetes.io/projected/ed0a9e05-e63a-4057-975f-24f38ac5d823-kube-api-access-d9d58\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:25.330145 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:25.330091 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:25.330265 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:25.330191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:25.330265 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:25.330234 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:25.330335 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:25.330270 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:25.330335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:25.330286 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls podName:ed0a9e05-e63a-4057-975f-24f38ac5d823 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.330269709 +0000 UTC m=+66.544495820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6v6dc" (UID: "ed0a9e05-e63a-4057-975f-24f38ac5d823") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:25.330335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:25.330333 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:59:25.330439 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:25.330335 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.330320281 +0000 UTC m=+66.544546375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : configmap references non-existent config key: service-ca.crt Jul 09 13:59:25.330439 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:25.330399 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.33038591 +0000 UTC m=+66.544612007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : secret "router-metrics-certs-default" not found Jul 09 13:59:25.934641 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:25.934605 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:59:25.937710 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:25.937691 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:59:25.947889 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:25.947863 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e7fcd-75f6-437a-8094-d5a450a7d826-original-pull-secret\") pod \"global-pull-secret-syncer-ftsfn\" (UID: \"863e7fcd-75f6-437a-8094-d5a450a7d826\") " pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:59:26.008038 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.008005 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftsfn" Jul 09 13:59:26.035874 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.035847 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 13:59:26.038751 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.038733 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:59:26.047016 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.046997 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 13:59:26.047080 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.047053 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs podName:b224c32b-7b3b-4d25-84ce-868d610a2ae0 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:30.047037828 +0000 UTC m=+130.261263922 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs") pod "network-metrics-daemon-6pjbl" (UID: "b224c32b-7b3b-4d25-84ce-868d610a2ae0") : secret "metrics-daemon-secret" not found Jul 09 13:59:26.128791 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.128760 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftsfn"] Jul 09 13:59:26.132729 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:59:26.132697 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863e7fcd_75f6_437a_8094_d5a450a7d826.slice/crio-25d49f6d33033626f8bf2ad516c3b450889f535e38baea8420d76f3e6164f34e WatchSource:0}: Error finding container 25d49f6d33033626f8bf2ad516c3b450889f535e38baea8420d76f3e6164f34e: Status 404 returned error can't find the container with id 25d49f6d33033626f8bf2ad516c3b450889f535e38baea8420d76f3e6164f34e Jul 09 13:59:26.136444 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.136423 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:59:26.139135 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.139100 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:59:26.149550 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.149534 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:59:26.159885 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.159861 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvvm8\" (UniqueName: \"kubernetes.io/projected/4d45d012-bd4a-4b24-bd93-8461d2cd08b7-kube-api-access-kvvm8\") pod \"network-check-target-whglc\" (UID: \"4d45d012-bd4a-4b24-bd93-8461d2cd08b7\") " pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:59:26.326053 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.326004 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2p5t2\"" Jul 09 13:59:26.334077 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.334058 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:59:26.337564 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.337532 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:26.337663 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.337572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:26.337663 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.337626 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:26.337747 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.337706 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:26.337747 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.337717 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:59:26.337747 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.337730 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:28.337713202 +0000 UTC m=+68.551939314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : configmap references non-existent config key: service-ca.crt Jul 09 13:59:26.337856 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.337765 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls podName:ed0a9e05-e63a-4057-975f-24f38ac5d823 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:28.33774737 +0000 UTC m=+68.551973486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6v6dc" (UID: "ed0a9e05-e63a-4057-975f-24f38ac5d823") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:26.337856 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.337785 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:28.337775615 +0000 UTC m=+68.552001724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : secret "router-metrics-certs-default" not found Jul 09 13:59:26.468888 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.468865 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whglc"] Jul 09 13:59:26.471137 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:59:26.471095 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d45d012_bd4a_4b24_bd93_8461d2cd08b7.slice/crio-eb40f685ae127a0352ab81d621a15915e68e97053c3a36ac3dc670441f7284c0 WatchSource:0}: Error finding container eb40f685ae127a0352ab81d621a15915e68e97053c3a36ac3dc670441f7284c0: Status 404 returned error can't find the container with id eb40f685ae127a0352ab81d621a15915e68e97053c3a36ac3dc670441f7284c0 Jul 09 13:59:26.626591 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.626510 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whglc" event={"ID":"4d45d012-bd4a-4b24-bd93-8461d2cd08b7","Type":"ContainerStarted","Data":"eb40f685ae127a0352ab81d621a15915e68e97053c3a36ac3dc670441f7284c0"} Jul 09 13:59:26.627830 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.627804 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftsfn" event={"ID":"863e7fcd-75f6-437a-8094-d5a450a7d826","Type":"ContainerStarted","Data":"25d49f6d33033626f8bf2ad516c3b450889f535e38baea8420d76f3e6164f34e"} Jul 09 13:59:26.941217 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:26.941188 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:59:26.941582 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.941303 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:59:26.941582 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:26.941354 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls podName:b861d323-e422-48e5-a5e2-d0f9455aa881 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:58.941340432 +0000 UTC m=+99.155566539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls") pod "dns-default-bwk8l" (UID: "b861d323-e422-48e5-a5e2-d0f9455aa881") : secret "dns-default-metrics-tls" not found Jul 09 13:59:28.351732 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:28.351691 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:28.351774 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:28.351820 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:28.351854 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:28.351923 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:32.351902841 +0000 UTC m=+72.566128938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : secret "router-metrics-certs-default" not found Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:28.351942 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:28.351960 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:32.351944215 +0000 UTC m=+72.566170311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : configmap references non-existent config key: service-ca.crt Jul 09 13:59:28.352178 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:28.351996 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls podName:ed0a9e05-e63a-4057-975f-24f38ac5d823 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:32.351981327 +0000 UTC m=+72.566207427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6v6dc" (UID: "ed0a9e05-e63a-4057-975f-24f38ac5d823") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:30.153627 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.153593 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qljpd"] Jul 09 13:59:30.156785 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.156762 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.161618 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.161592 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 13:59:30.161775 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.161622 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 13:59:30.162904 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.162884 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cvk42\"" Jul 09 13:59:30.163002 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.162903 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 13:59:30.163002 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.162906 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 13:59:30.169966 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.169942 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qljpd"] Jul 09 13:59:30.269380 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.269345 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.269531 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.269417 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df64ac93-a9da-4297-8458-2cc4cd1b73df-data-volume\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.269531 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.269469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df64ac93-a9da-4297-8458-2cc4cd1b73df-crio-socket\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.269531 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.269499 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.269694 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.269593 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjl7g\" (UniqueName: \"kubernetes.io/projected/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-api-access-xjl7g\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.370663 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.370632 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.370809 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.370683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df64ac93-a9da-4297-8458-2cc4cd1b73df-data-volume\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.370809 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.370709 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df64ac93-a9da-4297-8458-2cc4cd1b73df-crio-socket\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.370809 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.370728 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.370809 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.370757 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:30.370809 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.370794 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjl7g\" (UniqueName: \"kubernetes.io/projected/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-api-access-xjl7g\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.370809 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.370806 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df64ac93-a9da-4297-8458-2cc4cd1b73df-crio-socket\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.371098 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.370828 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:30.870806192 +0000 UTC m=+71.085032291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : configmap "kube-rbac-proxy" not found Jul 09 13:59:30.371098 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.370921 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.371098 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.370986 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:30.870972345 +0000 UTC m=+71.085198439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.371098 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.371035 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df64ac93-a9da-4297-8458-2cc4cd1b73df-data-volume\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.378959 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.378932 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjl7g\" (UniqueName: \"kubernetes.io/projected/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-api-access-xjl7g\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.874373 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.874343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.874518 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:30.874411 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:30.874518 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.874472 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:30.874518 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.874499 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.874645 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.874530 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:31.87451667 +0000 UTC m=+72.088742765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : configmap "kube-rbac-proxy" not found Jul 09 13:59:30.874645 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:30.874605 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:31.874592414 +0000 UTC m=+72.088818508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:31.643073 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.643029 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whglc" event={"ID":"4d45d012-bd4a-4b24-bd93-8461d2cd08b7","Type":"ContainerStarted","Data":"efd03e8e41108ecc46776058e6e433fe788b8c55e2544ec3bd92f4d12e5dc693"} Jul 09 13:59:31.643568 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.643161 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 13:59:31.645008 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.644977 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftsfn" event={"ID":"863e7fcd-75f6-437a-8094-d5a450a7d826","Type":"ContainerStarted","Data":"46b747556fd1513d27e79b1cbb35e59f0f11fc834710ee738ca425fbc3578ebf"} Jul 09 13:59:31.658914 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.658861 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-whglc" podStartSLOduration=67.236617659 podStartE2EDuration="1m11.658845958s" totalImagesPullingTime="4.422228299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:31.657921047 +0000 UTC m=+71.872147165" watchObservedRunningTime="2026-07-09 13:59:31.658845958 +0000 UTC m=+71.873072133" Jul 09 13:59:31.671955 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.671906 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ftsfn" podStartSLOduration=66.910219423 podStartE2EDuration="1m11.671892135s" totalImagesPullingTime="4.761672712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:31.671694876 +0000 UTC m=+71.885920993" watchObservedRunningTime="2026-07-09 13:59:31.671892135 +0000 UTC m=+71.886118251" Jul 09 13:59:31.881121 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.881081 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:31.881225 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:31.881141 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:31.881225 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:31.881208 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:31.881335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:31.881239 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:31.881335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:31.881274 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:33.881256361 +0000 UTC m=+74.095482470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : configmap "kube-rbac-proxy" not found Jul 09 13:59:31.881335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:31.881294 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:33.881284441 +0000 UTC m=+74.095510542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:32.329583 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:32.329559 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p477f_cfac2c63-25e1-4469-b164-1546ec46a98b/dns-node-resolver/0.log" Jul 09 13:59:32.385306 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:32.385279 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:32.385412 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:32.385327 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:32.385412 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:32.385397 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:32.385521 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:32.385447 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:32.385521 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:32.385492 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:59:32.385521 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:32.385511 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls podName:ed0a9e05-e63a-4057-975f-24f38ac5d823 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:40.385491697 +0000 UTC m=+80.599717828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6v6dc" (UID: "ed0a9e05-e63a-4057-975f-24f38ac5d823") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:32.385662 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:32.385537 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:40.385523777 +0000 UTC m=+80.599749882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : secret "router-metrics-certs-default" not found Jul 09 13:59:32.385662 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:32.385601 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:40.385588997 +0000 UTC m=+80.599815130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : configmap references non-existent config key: service-ca.crt Jul 09 13:59:32.740479 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:32.740456 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9pfvf_5e9c1943-279e-42bf-a186-47c16d6b88aa/node-ca/0.log" Jul 09 13:59:33.530303 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:33.530272 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bkx2n_702ca2b3-c17e-41b3-af44-5fd6a31cfd88/serve-healthcheck-canary/0.log" Jul 09 13:59:33.898079 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:33.898006 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:33.898470 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:33.898079 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:33.898470 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:33.898135 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:33.898470 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:33.898202 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:37.898185743 +0000 UTC m=+78.112411838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : configmap "kube-rbac-proxy" not found Jul 09 13:59:33.898470 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:33.898227 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:33.898470 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:33.898288 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:37.898272831 +0000 UTC m=+78.112498926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:37.924913 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:37.924875 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:37.925335 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:37.924952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:37.925335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:37.925035 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:37.925335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:37.925059 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:37.925335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:37.925094 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:45.925077677 +0000 UTC m=+86.139303772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : configmap "kube-rbac-proxy" not found Jul 09 13:59:37.925335 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:37.925147 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 13:59:45.925103881 +0000 UTC m=+86.139329974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:39.025033 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.025000 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn"] Jul 09 13:59:39.027605 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.027587 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" Jul 09 13:59:39.030253 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.030234 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 13:59:39.030345 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.030234 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 13:59:39.030345 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.030292 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sfrkm\"" Jul 09 13:59:39.037321 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.037298 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn"] Jul 09 13:59:39.134635 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.134609 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74hr\" (UniqueName: \"kubernetes.io/projected/fbd99120-6e92-47a6-a9ca-292f43c4f51a-kube-api-access-d74hr\") pod \"migrator-7f59b54f6c-bjxpn\" (UID: \"fbd99120-6e92-47a6-a9ca-292f43c4f51a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" Jul 09 13:59:39.235867 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.235834 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74hr\" (UniqueName: \"kubernetes.io/projected/fbd99120-6e92-47a6-a9ca-292f43c4f51a-kube-api-access-d74hr\") pod \"migrator-7f59b54f6c-bjxpn\" (UID: \"fbd99120-6e92-47a6-a9ca-292f43c4f51a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" Jul 09 13:59:39.244127 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.244081 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74hr\" (UniqueName: \"kubernetes.io/projected/fbd99120-6e92-47a6-a9ca-292f43c4f51a-kube-api-access-d74hr\") pod \"migrator-7f59b54f6c-bjxpn\" (UID: \"fbd99120-6e92-47a6-a9ca-292f43c4f51a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" Jul 09 13:59:39.336464 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.336396 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" Jul 09 13:59:39.458859 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.458829 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn"] Jul 09 13:59:39.462253 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:59:39.462228 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd99120_6e92_47a6_a9ca_292f43c4f51a.slice/crio-fa1f17b46064b9b39a629c429f9fa4440da829fd33a63d8a375ef6aeb1798796 WatchSource:0}: Error finding container fa1f17b46064b9b39a629c429f9fa4440da829fd33a63d8a375ef6aeb1798796: Status 404 returned error can't find the container with id fa1f17b46064b9b39a629c429f9fa4440da829fd33a63d8a375ef6aeb1798796 Jul 09 13:59:39.664764 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:39.664698 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" event={"ID":"fbd99120-6e92-47a6-a9ca-292f43c4f51a","Type":"ContainerStarted","Data":"fa1f17b46064b9b39a629c429f9fa4440da829fd33a63d8a375ef6aeb1798796"} Jul 09 13:59:40.447836 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:40.447793 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:40.447855 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:40.447902 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:40.447980 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:40.448062 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:56.448041924 +0000 UTC m=+96.662268018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : secret "router-metrics-certs-default" not found Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:40.448076 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:40.448082 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle podName:d5840237-f1e6-4287-8890-6dd0fc4d82e0 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:56.448069462 +0000 UTC m=+96.662295602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle") pod "router-default-598c56748b-jjshs" (UID: "d5840237-f1e6-4287-8890-6dd0fc4d82e0") : configmap references non-existent config key: service-ca.crt Jul 09 13:59:40.448316 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:40.448189 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls podName:ed0a9e05-e63a-4057-975f-24f38ac5d823 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:56.448169715 +0000 UTC m=+96.662395815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6v6dc" (UID: "ed0a9e05-e63a-4057-975f-24f38ac5d823") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:59:41.674814 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:41.674785 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" event={"ID":"fbd99120-6e92-47a6-a9ca-292f43c4f51a","Type":"ContainerStarted","Data":"2679e1b895d2e659b3663839a17d14f22a1556903ea2623400f08373af5b8de9"} Jul 09 13:59:41.675218 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:41.674847 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" event={"ID":"fbd99120-6e92-47a6-a9ca-292f43c4f51a","Type":"ContainerStarted","Data":"687481087bdcb9dd8579678c3cc12e3dd96731045034beafb7bb8252e6752780"} Jul 09 13:59:45.989429 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:45.989299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:45.989429 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:45.989362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:45.989917 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:45.989468 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:45.989917 ip-10-0-132-27 kubenswrapper[2553]: E0709 13:59:45.989522 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls podName:df64ac93-a9da-4297-8458-2cc4cd1b73df nodeName:}" failed. No retries permitted until 2026-07-09 14:00:01.989508125 +0000 UTC m=+102.203734218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qljpd" (UID: "df64ac93-a9da-4297-8458-2cc4cd1b73df") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:45.989917 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:45.989836 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df64ac93-a9da-4297-8458-2cc4cd1b73df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 13:59:56.467313 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.467270 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:56.467856 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.467345 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:56.467856 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.467405 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:56.467937 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.467909 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5840237-f1e6-4287-8890-6dd0fc4d82e0-service-ca-bundle\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:56.469949 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.469925 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5840237-f1e6-4287-8890-6dd0fc4d82e0-metrics-certs\") pod \"router-default-598c56748b-jjshs\" (UID: \"d5840237-f1e6-4287-8890-6dd0fc4d82e0\") " pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:56.470191 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.470170 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed0a9e05-e63a-4057-975f-24f38ac5d823-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6v6dc\" (UID: \"ed0a9e05-e63a-4057-975f-24f38ac5d823\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:56.737519 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.737458 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" Jul 09 13:59:56.744094 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.744074 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:56.870564 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.870513 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bjxpn" podStartSLOduration=15.963125259 podStartE2EDuration="17.870492476s" totalImagesPullingTime="1.907367217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:41.695660654 +0000 UTC m=+81.909886770" watchObservedRunningTime="2026-07-09 13:59:56.870492476 +0000 UTC m=+97.084718592" Jul 09 13:59:56.871012 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.870997 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc"] Jul 09 13:59:56.873948 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:59:56.873922 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0a9e05_e63a_4057_975f_24f38ac5d823.slice/crio-f4663983c32b9eb61adf0674b29bc172759bfeab2e0f6c092ebfdbac8e5a0ad9 WatchSource:0}: Error finding container f4663983c32b9eb61adf0674b29bc172759bfeab2e0f6c092ebfdbac8e5a0ad9: Status 404 returned error can't find the container with id f4663983c32b9eb61adf0674b29bc172759bfeab2e0f6c092ebfdbac8e5a0ad9 Jul 09 13:59:56.889458 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:56.889433 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-598c56748b-jjshs"] Jul 09 13:59:56.892381 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:59:56.892357 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5840237_f1e6_4287_8890_6dd0fc4d82e0.slice/crio-8e8b74bf28f280b448b7108b22276567ef44d0b2602d5681e25152cce77ba717 WatchSource:0}: Error finding container 8e8b74bf28f280b448b7108b22276567ef44d0b2602d5681e25152cce77ba717: Status 404 returned error can't find the container with id 8e8b74bf28f280b448b7108b22276567ef44d0b2602d5681e25152cce77ba717 Jul 09 13:59:57.723837 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:57.723798 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" event={"ID":"ed0a9e05-e63a-4057-975f-24f38ac5d823","Type":"ContainerStarted","Data":"f4663983c32b9eb61adf0674b29bc172759bfeab2e0f6c092ebfdbac8e5a0ad9"} Jul 09 13:59:57.725560 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:57.725525 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-598c56748b-jjshs" event={"ID":"d5840237-f1e6-4287-8890-6dd0fc4d82e0","Type":"ContainerStarted","Data":"2701196a807b19ec3b7295998a957b77dce81fe155d51d05d402312193e923b0"} Jul 09 13:59:57.725704 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:57.725584 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-598c56748b-jjshs" event={"ID":"d5840237-f1e6-4287-8890-6dd0fc4d82e0","Type":"ContainerStarted","Data":"8e8b74bf28f280b448b7108b22276567ef44d0b2602d5681e25152cce77ba717"} Jul 09 13:59:57.744776 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:57.744748 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:57.746618 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:57.746566 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-598c56748b-jjshs" podStartSLOduration=33.746545425 podStartE2EDuration="33.746545425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:57.745676817 +0000 UTC m=+97.959902966" watchObservedRunningTime="2026-07-09 13:59:57.746545425 +0000 UTC m=+97.960771542" Jul 09 13:59:57.747605 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:57.747581 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:58.728681 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:58.728647 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:58.729896 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:58.729868 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-598c56748b-jjshs" Jul 09 13:59:58.987360 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:58.987289 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:59:58.989710 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:58.989668 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b861d323-e422-48e5-a5e2-d0f9455aa881-metrics-tls\") pod \"dns-default-bwk8l\" (UID: \"b861d323-e422-48e5-a5e2-d0f9455aa881\") " pod="openshift-dns/dns-default-bwk8l" Jul 09 13:59:59.004813 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:59.004792 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf6lw\"" Jul 09 13:59:59.012975 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:59.012957 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bwk8l" Jul 09 13:59:59.140424 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:59.140395 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bwk8l"] Jul 09 13:59:59.143267 ip-10-0-132-27 kubenswrapper[2553]: W0709 13:59:59.143239 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb861d323_e422_48e5_a5e2_d0f9455aa881.slice/crio-a603b5892da3b550b6991c150eba21ffb3b6f5c085e519e3fa59b4b62af26131 WatchSource:0}: Error finding container a603b5892da3b550b6991c150eba21ffb3b6f5c085e519e3fa59b4b62af26131: Status 404 returned error can't find the container with id a603b5892da3b550b6991c150eba21ffb3b6f5c085e519e3fa59b4b62af26131 Jul 09 13:59:59.736747 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:59.736704 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" event={"ID":"ed0a9e05-e63a-4057-975f-24f38ac5d823","Type":"ContainerStarted","Data":"fc155a9028973aaf6fcb1a5b35d946e605fa8561e535be13b8ce57df2e340c33"} Jul 09 13:59:59.738004 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:59.737966 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bwk8l" event={"ID":"b861d323-e422-48e5-a5e2-d0f9455aa881","Type":"ContainerStarted","Data":"a603b5892da3b550b6991c150eba21ffb3b6f5c085e519e3fa59b4b62af26131"} Jul 09 13:59:59.753931 ip-10-0-132-27 kubenswrapper[2553]: I0709 13:59:59.753888 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6v6dc" podStartSLOduration=33.86784103 podStartE2EDuration="35.753873515s" totalImagesPullingTime="1.886032485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:59.752840071 +0000 UTC m=+99.967066208" watchObservedRunningTime="2026-07-09 13:59:59.753873515 +0000 UTC m=+99.968099637" Jul 09 14:00:00.358732 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.358698 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-lncf8"] Jul 09 14:00:00.360965 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.360942 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.364903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.364870 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 14:00:00.364903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.364883 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 14:00:00.365087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.364947 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vd9lm\"" Jul 09 14:00:00.373378 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.373323 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-lncf8"] Jul 09 14:00:00.387344 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.387321 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc"] Jul 09 14:00:00.389521 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.389492 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" Jul 09 14:00:00.392822 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.392805 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-frw8z\"" Jul 09 14:00:00.396991 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.396970 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cdd59cb6c-6z49c"] Jul 09 14:00:00.399097 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.399058 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.401458 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.401368 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:00:00.401599 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.401579 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:00:00.401758 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.401609 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n8xtq\"" Jul 09 14:00:00.402016 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.401989 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:00:00.407815 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.407643 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:00:00.409240 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.409222 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc"] Jul 09 14:00:00.411676 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.411660 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cdd59cb6c-6z49c"] Jul 09 14:00:00.444265 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.444229 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cdd59cb6c-6z49c"] Jul 09 14:00:00.444468 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:00:00.444422 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-dzvsc registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" podUID="7e1d5246-a866-41a5-aa76-2f118be1ecc6" Jul 09 14:00:00.498426 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498396 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d31b41c0-f645-486c-82ce-1c4c85afe3a7-nginx-conf\") pod \"networking-console-plugin-6cf856758c-lncf8\" (UID: \"d31b41c0-f645-486c-82ce-1c4c85afe3a7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.498581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498444 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-installation-pull-secrets\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498510 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-certificates\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498568 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxncp\" (UniqueName: \"kubernetes.io/projected/8c9a1449-7496-457e-b96f-bfd09cda5d53-kube-api-access-vxncp\") pod \"network-check-source-869dcfcdcd-hxzgc\" (UID: \"8c9a1449-7496-457e-b96f-bfd09cda5d53\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" Jul 09 14:00:00.498763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498589 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e1d5246-a866-41a5-aa76-2f118be1ecc6-ca-trust-extracted\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498610 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-bound-sa-token\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498649 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-tls\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498677 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-image-registry-private-configuration\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498973 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498801 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-trusted-ca\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.498973 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498841 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d31b41c0-f645-486c-82ce-1c4c85afe3a7-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lncf8\" (UID: \"d31b41c0-f645-486c-82ce-1c4c85afe3a7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.498973 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.498871 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzvsc\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-kube-api-access-dzvsc\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599399 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d31b41c0-f645-486c-82ce-1c4c85afe3a7-nginx-conf\") pod \"networking-console-plugin-6cf856758c-lncf8\" (UID: \"d31b41c0-f645-486c-82ce-1c4c85afe3a7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.599562 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-installation-pull-secrets\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599562 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599453 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-certificates\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599642 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599603 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxncp\" (UniqueName: \"kubernetes.io/projected/8c9a1449-7496-457e-b96f-bfd09cda5d53-kube-api-access-vxncp\") pod \"network-check-source-869dcfcdcd-hxzgc\" (UID: \"8c9a1449-7496-457e-b96f-bfd09cda5d53\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" Jul 09 14:00:00.599693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599652 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e1d5246-a866-41a5-aa76-2f118be1ecc6-ca-trust-extracted\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599748 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599691 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-bound-sa-token\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599748 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599723 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-tls\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-image-registry-private-configuration\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599818 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-trusted-ca\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.599923 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599852 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d31b41c0-f645-486c-82ce-1c4c85afe3a7-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lncf8\" (UID: \"d31b41c0-f645-486c-82ce-1c4c85afe3a7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.599923 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.599877 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzvsc\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-kube-api-access-dzvsc\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.600076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.600053 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e1d5246-a866-41a5-aa76-2f118be1ecc6-ca-trust-extracted\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.600189 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.600166 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d31b41c0-f645-486c-82ce-1c4c85afe3a7-nginx-conf\") pod \"networking-console-plugin-6cf856758c-lncf8\" (UID: \"d31b41c0-f645-486c-82ce-1c4c85afe3a7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.600321 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.600285 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-certificates\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.600878 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.600851 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-trusted-ca\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.602296 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.602270 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-installation-pull-secrets\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.602391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.602350 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-image-registry-private-configuration\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.602391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.602363 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-tls\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.602391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.602377 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d31b41c0-f645-486c-82ce-1c4c85afe3a7-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lncf8\" (UID: \"d31b41c0-f645-486c-82ce-1c4c85afe3a7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.608045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.608015 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzvsc\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-kube-api-access-dzvsc\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.608145 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.608071 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-bound-sa-token\") pod \"image-registry-5cdd59cb6c-6z49c\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.608557 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.608537 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxncp\" (UniqueName: \"kubernetes.io/projected/8c9a1449-7496-457e-b96f-bfd09cda5d53-kube-api-access-vxncp\") pod \"network-check-source-869dcfcdcd-hxzgc\" (UID: \"8c9a1449-7496-457e-b96f-bfd09cda5d53\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" Jul 09 14:00:00.671097 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.671078 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" Jul 09 14:00:00.700180 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.700158 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" Jul 09 14:00:00.740616 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.740589 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.752704 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.752671 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:00.815314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.814855 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-lncf8"] Jul 09 14:00:00.819921 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:00.819892 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31b41c0_f645_486c_82ce_1c4c85afe3a7.slice/crio-a1b6288f76ffc22a01a478e647fd13f5dc8e00ab8f08d07aded81dcc65cbbfab WatchSource:0}: Error finding container a1b6288f76ffc22a01a478e647fd13f5dc8e00ab8f08d07aded81dcc65cbbfab: Status 404 returned error can't find the container with id a1b6288f76ffc22a01a478e647fd13f5dc8e00ab8f08d07aded81dcc65cbbfab Jul 09 14:00:00.864385 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.864361 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc"] Jul 09 14:00:00.867138 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:00.867097 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9a1449_7496_457e_b96f_bfd09cda5d53.slice/crio-d1acc0d92e08a1fcdb45dfb667088f5d16269a417b9d8c3eca26f7ab4985b22d WatchSource:0}: Error finding container d1acc0d92e08a1fcdb45dfb667088f5d16269a417b9d8c3eca26f7ab4985b22d: Status 404 returned error can't find the container with id d1acc0d92e08a1fcdb45dfb667088f5d16269a417b9d8c3eca26f7ab4985b22d Jul 09 14:00:00.901943 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.901915 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-image-registry-private-configuration\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902058 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.901965 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e1d5246-a866-41a5-aa76-2f118be1ecc6-ca-trust-extracted\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902058 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.901990 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-tls\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902058 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902029 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-trusted-ca\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902060 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzvsc\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-kube-api-access-dzvsc\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902091 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-certificates\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902139 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-bound-sa-token\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.902957 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902506 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:00:00.902957 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902576 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-installation-pull-secrets\") pod \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\" (UID: \"7e1d5246-a866-41a5-aa76-2f118be1ecc6\") " Jul 09 14:00:00.903156 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902572 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:00:00.903156 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.902716 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e1d5246-a866-41a5-aa76-2f118be1ecc6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:00:00.903273 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.903233 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e1d5246-a866-41a5-aa76-2f118be1ecc6-ca-trust-extracted\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:00.903273 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.903257 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-trusted-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:00.903374 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.903275 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-certificates\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:00.904793 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.904765 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:00:00.905199 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.905169 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-kube-api-access-dzvsc" (OuterVolumeSpecName: "kube-api-access-dzvsc") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "kube-api-access-dzvsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:00:00.905320 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.905210 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:00:00.905433 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.905409 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:00:00.905679 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:00.905653 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7e1d5246-a866-41a5-aa76-2f118be1ecc6" (UID: "7e1d5246-a866-41a5-aa76-2f118be1ecc6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:00:01.003958 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.003931 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-image-registry-private-configuration\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:01.004041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.003960 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-registry-tls\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:01.004041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.003976 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzvsc\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-kube-api-access-dzvsc\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:01.004041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.003990 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1d5246-a866-41a5-aa76-2f118be1ecc6-bound-sa-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:01.004041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.004003 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e1d5246-a866-41a5-aa76-2f118be1ecc6-installation-pull-secrets\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:00:01.746213 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.746172 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bwk8l" event={"ID":"b861d323-e422-48e5-a5e2-d0f9455aa881","Type":"ContainerStarted","Data":"2539f857a95074c5a2fba500bee2a915e9075c03b551b820a9e62756b2b463a2"} Jul 09 14:00:01.746656 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.746243 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bwk8l" event={"ID":"b861d323-e422-48e5-a5e2-d0f9455aa881","Type":"ContainerStarted","Data":"7c2414fd9612f483388f8585026c29c12e3f91e38a55ee9c0f702109c9f78518"} Jul 09 14:00:01.746656 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.746452 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bwk8l" Jul 09 14:00:01.748289 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.748264 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" event={"ID":"8c9a1449-7496-457e-b96f-bfd09cda5d53","Type":"ContainerStarted","Data":"27b4b8624dbcc99bd732ed8e4aad4796534a0b1205632ef870d5730fd928acd9"} Jul 09 14:00:01.748417 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.748309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" event={"ID":"8c9a1449-7496-457e-b96f-bfd09cda5d53","Type":"ContainerStarted","Data":"d1acc0d92e08a1fcdb45dfb667088f5d16269a417b9d8c3eca26f7ab4985b22d"} Jul 09 14:00:01.749682 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.749662 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cdd59cb6c-6z49c" Jul 09 14:00:01.749777 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.749709 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" event={"ID":"d31b41c0-f645-486c-82ce-1c4c85afe3a7","Type":"ContainerStarted","Data":"a1b6288f76ffc22a01a478e647fd13f5dc8e00ab8f08d07aded81dcc65cbbfab"} Jul 09 14:00:01.766031 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.765989 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bwk8l" podStartSLOduration=65.268569263 podStartE2EDuration="1m6.765974408s" totalImagesPullingTime="1.497405145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:01.764638196 +0000 UTC m=+101.978864312" watchObservedRunningTime="2026-07-09 14:00:01.765974408 +0000 UTC m=+101.980200582" Jul 09 14:00:01.795146 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.795097 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cdd59cb6c-6z49c"] Jul 09 14:00:01.798792 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:01.798767 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cdd59cb6c-6z49c"] Jul 09 14:00:02.011305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.011274 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 14:00:02.013635 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.013601 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df64ac93-a9da-4297-8458-2cc4cd1b73df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qljpd\" (UID: \"df64ac93-a9da-4297-8458-2cc4cd1b73df\") " pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 14:00:02.269122 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.269040 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qljpd" Jul 09 14:00:02.298011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.297986 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1d5246-a866-41a5-aa76-2f118be1ecc6" path="/var/lib/kubelet/pods/7e1d5246-a866-41a5-aa76-2f118be1ecc6/volumes" Jul 09 14:00:02.475705 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.475651 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hxzgc" podStartSLOduration=2.475631132 podStartE2EDuration="2.475631132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:01.812816368 +0000 UTC m=+102.027042503" watchObservedRunningTime="2026-07-09 14:00:02.475631132 +0000 UTC m=+102.689857248" Jul 09 14:00:02.476654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.476630 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qljpd"] Jul 09 14:00:02.479316 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:02.479291 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf64ac93_a9da_4297_8458_2cc4cd1b73df.slice/crio-a770f14a09e1656671a66c4323be2c843c592c678416c635d78d8cf0a471cb6e WatchSource:0}: Error finding container a770f14a09e1656671a66c4323be2c843c592c678416c635d78d8cf0a471cb6e: Status 404 returned error can't find the container with id a770f14a09e1656671a66c4323be2c843c592c678416c635d78d8cf0a471cb6e Jul 09 14:00:02.650022 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.649975 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-whglc" Jul 09 14:00:02.753575 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:02.753549 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qljpd" event={"ID":"df64ac93-a9da-4297-8458-2cc4cd1b73df","Type":"ContainerStarted","Data":"a770f14a09e1656671a66c4323be2c843c592c678416c635d78d8cf0a471cb6e"} Jul 09 14:00:03.762489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:03.762450 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" event={"ID":"d31b41c0-f645-486c-82ce-1c4c85afe3a7","Type":"ContainerStarted","Data":"fbe2e21d8ed8801761e2daebb6c6825388b9b6db8a1759bae5cc5007dfb0e16b"} Jul 09 14:00:03.778873 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:03.778815 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-lncf8" podStartSLOduration=1.874888169 podStartE2EDuration="3.778793882s" totalImagesPullingTime="1.903905713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:03.778216935 +0000 UTC m=+103.992443051" watchObservedRunningTime="2026-07-09 14:00:03.778793882 +0000 UTC m=+103.993020002" Jul 09 14:00:04.311739 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.311706 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-zkmqh"] Jul 09 14:00:04.314125 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.314093 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.316750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.316727 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 14:00:04.317891 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.317872 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 14:00:04.317999 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.317890 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:00:04.317999 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.317872 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pf66v\"" Jul 09 14:00:04.328121 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.328087 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-zkmqh"] Jul 09 14:00:04.429995 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.429967 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.430130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.430004 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-metrics-client-ca\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.430130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.430098 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.430247 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.430151 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n8w\" (UniqueName: \"kubernetes.io/projected/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-kube-api-access-r5n8w\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.531326 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.531299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.531453 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.531330 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n8w\" (UniqueName: \"kubernetes.io/projected/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-kube-api-access-r5n8w\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.531517 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.531478 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.531576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.531533 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-metrics-client-ca\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.532158 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.532135 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-metrics-client-ca\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.533770 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.533744 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.533870 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.533801 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.540259 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.540241 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n8w\" (UniqueName: \"kubernetes.io/projected/d805b128-c321-4f15-a5a3-cc9b1c8e60fa-kube-api-access-r5n8w\") pod \"prometheus-operator-64785b6675-zkmqh\" (UID: \"d805b128-c321-4f15-a5a3-cc9b1c8e60fa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:04.624497 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:04.624441 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" Jul 09 14:00:06.722532 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:06.722502 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-zkmqh"] Jul 09 14:00:06.725431 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:06.725405 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd805b128_c321_4f15_a5a3_cc9b1c8e60fa.slice/crio-e353291e9455c2ab6b8f5fa7ffbb510e1af823bf2ddf7d476b67e41804c40ac3 WatchSource:0}: Error finding container e353291e9455c2ab6b8f5fa7ffbb510e1af823bf2ddf7d476b67e41804c40ac3: Status 404 returned error can't find the container with id e353291e9455c2ab6b8f5fa7ffbb510e1af823bf2ddf7d476b67e41804c40ac3 Jul 09 14:00:06.774090 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:06.774064 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qljpd" event={"ID":"df64ac93-a9da-4297-8458-2cc4cd1b73df","Type":"ContainerStarted","Data":"03c12f296e93ad8b6a9450ec00864ab4b592dbb1eb4b889716a570eceba2c0a5"} Jul 09 14:00:06.775204 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:06.775183 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" event={"ID":"d805b128-c321-4f15-a5a3-cc9b1c8e60fa","Type":"ContainerStarted","Data":"e353291e9455c2ab6b8f5fa7ffbb510e1af823bf2ddf7d476b67e41804c40ac3"} Jul 09 14:00:07.781828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:07.781789 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qljpd" event={"ID":"df64ac93-a9da-4297-8458-2cc4cd1b73df","Type":"ContainerStarted","Data":"82233c9e7f81682a5b67849ecf8df6729f801ba445a61956bbc239924fecbca9"} Jul 09 14:00:10.793012 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:10.792972 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qljpd" event={"ID":"df64ac93-a9da-4297-8458-2cc4cd1b73df","Type":"ContainerStarted","Data":"f49b6bb68ac29c4b67bfde86ecb0043f1019f35b9c84afb665cabdb2b4735258"} Jul 09 14:00:10.794898 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:10.794872 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" event={"ID":"d805b128-c321-4f15-a5a3-cc9b1c8e60fa","Type":"ContainerStarted","Data":"d766d139df6207cf2d2a837f26619290effe6be1ae9380478ffb86765d59af98"} Jul 09 14:00:10.795005 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:10.794923 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" event={"ID":"d805b128-c321-4f15-a5a3-cc9b1c8e60fa","Type":"ContainerStarted","Data":"524038ee2dc961afa56fdad64b1bd00ae728f7fc1a02fb12192afd3024a926ed"} Jul 09 14:00:10.829261 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:10.829216 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qljpd" podStartSLOduration=33.541299021 podStartE2EDuration="40.829201134s" totalImagesPullingTime="7.287902113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:59:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:10.828496154 +0000 UTC m=+111.042722274" watchObservedRunningTime="2026-07-09 14:00:10.829201134 +0000 UTC m=+111.043427249" Jul 09 14:00:10.846567 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:10.846524 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-zkmqh" podStartSLOduration=3.6911123999999997 podStartE2EDuration="6.846509607s" totalImagesPullingTime="3.155397207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:10.845631542 +0000 UTC m=+111.059857650" watchObservedRunningTime="2026-07-09 14:00:10.846509607 +0000 UTC m=+111.060735722" Jul 09 14:00:11.755947 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:11.755923 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bwk8l" Jul 09 14:00:12.687600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.687566 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xkq7z"] Jul 09 14:00:12.689695 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.689676 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.692085 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.692062 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ndd5r\"" Jul 09 14:00:12.692590 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.692571 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:00:12.692883 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.692870 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:00:12.693281 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.693262 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:00:12.794565 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-root\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.794665 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794573 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.794665 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794592 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.794665 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794609 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2t9\" (UniqueName: \"kubernetes.io/projected/a4a0156d-417c-4f3e-851f-cf8feeb6604b-kube-api-access-9k2t9\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.794665 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794654 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4a0156d-417c-4f3e-851f-cf8feeb6604b-metrics-client-ca\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.794795 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-textfile\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.794847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.794740 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-sys\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.795125 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.795075 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-wtmp\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.795240 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.795150 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895844 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-root\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895850 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895869 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2t9\" (UniqueName: \"kubernetes.io/projected/a4a0156d-417c-4f3e-851f-cf8feeb6604b-kube-api-access-9k2t9\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4a0156d-417c-4f3e-851f-cf8feeb6604b-metrics-client-ca\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895944 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-root\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.895994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.895954 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-textfile\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896012 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-sys\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896036 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-wtmp\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896187 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-sys\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896302 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-wtmp\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896303 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-textfile\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896636 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:00:12.896433 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:00:12.896636 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:00:12.896502 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls podName:a4a0156d-417c-4f3e-851f-cf8feeb6604b nodeName:}" failed. No retries permitted until 2026-07-09 14:00:13.396483933 +0000 UTC m=+113.610710031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls") pod "node-exporter-xkq7z" (UID: "a4a0156d-417c-4f3e-851f-cf8feeb6604b") : secret "node-exporter-tls" not found Jul 09 14:00:12.896636 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896522 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.896802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.896704 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4a0156d-417c-4f3e-851f-cf8feeb6604b-metrics-client-ca\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.898340 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.898317 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:12.904667 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:12.904645 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2t9\" (UniqueName: \"kubernetes.io/projected/a4a0156d-417c-4f3e-851f-cf8feeb6604b-kube-api-access-9k2t9\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:13.400344 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.400315 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:13.400462 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:00:13.400441 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:00:13.400519 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:00:13.400506 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls podName:a4a0156d-417c-4f3e-851f-cf8feeb6604b nodeName:}" failed. No retries permitted until 2026-07-09 14:00:14.400488668 +0000 UTC m=+114.614714763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls") pod "node-exporter-xkq7z" (UID: "a4a0156d-417c-4f3e-851f-cf8feeb6604b") : secret "node-exporter-tls" not found Jul 09 14:00:13.723097 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.723068 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:00:13.725936 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.725915 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.729290 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729269 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hvx27\"" Jul 09 14:00:13.729568 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729538 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:00:13.729674 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729634 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:00:13.729733 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729717 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:00:13.729733 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729727 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:00:13.729826 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729759 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:00:13.729884 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729853 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:00:13.729970 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.729881 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:00:13.730121 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.730093 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:00:13.730643 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.730627 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:00:13.741854 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.741834 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:00:13.904918 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.904892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905049 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.904923 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905049 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.904942 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-out\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905049 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.904964 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905049 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tblrl\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-kube-api-access-tblrl\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905122 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-web-config\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905193 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905242 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-volume\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905265 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905311 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905332 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905369 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:13.905529 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:13.905406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006039 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.005975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006039 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006011 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tblrl\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-kube-api-access-tblrl\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006039 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-web-config\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006272 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006272 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006233 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-volume\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006372 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006273 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006372 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006332 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006372 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006352 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006571 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006548 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006623 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006608 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006672 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006647 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006729 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006673 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.006729 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.006697 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-out\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.007304 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.007278 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.008939 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.008898 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.009225 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.009204 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-web-config\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.009386 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.009360 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.009627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.009573 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.010026 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.010007 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.010188 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.010021 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-volume\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.010559 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.010513 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.010729 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.010709 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.010792 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.010767 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-out\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.011256 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.011236 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.011551 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.011527 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.013603 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.013577 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tblrl\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-kube-api-access-tblrl\") pod \"alertmanager-main-0\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.037096 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.037067 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:00:14.167085 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.167055 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:00:14.169155 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:14.169124 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47de86dd_5f09_4d01_b2b3_b0eb6fab0d68.slice/crio-e820cf0c459655b606eb371bcfd8eebd0d720ed5fd6dc8465bc5cfba025ce477 WatchSource:0}: Error finding container e820cf0c459655b606eb371bcfd8eebd0d720ed5fd6dc8465bc5cfba025ce477: Status 404 returned error can't find the container with id e820cf0c459655b606eb371bcfd8eebd0d720ed5fd6dc8465bc5cfba025ce477 Jul 09 14:00:14.409568 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.409504 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:14.411605 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.411585 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4a0156d-417c-4f3e-851f-cf8feeb6604b-node-exporter-tls\") pod \"node-exporter-xkq7z\" (UID: \"a4a0156d-417c-4f3e-851f-cf8feeb6604b\") " pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:14.499339 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.499317 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xkq7z" Jul 09 14:00:14.509430 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:14.509410 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a0156d_417c_4f3e_851f_cf8feeb6604b.slice/crio-bc217ededfbd534c32c25b46146267c6fa01f353203d92b41e83489ca138e10b WatchSource:0}: Error finding container bc217ededfbd534c32c25b46146267c6fa01f353203d92b41e83489ca138e10b: Status 404 returned error can't find the container with id bc217ededfbd534c32c25b46146267c6fa01f353203d92b41e83489ca138e10b Jul 09 14:00:14.633087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.633063 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f5bfdd544-599cv"] Jul 09 14:00:14.635751 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.635736 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.638353 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638338 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 14:00:14.638543 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638516 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-90iqmdruo007r\"" Jul 09 14:00:14.638625 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638515 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 14:00:14.638625 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638571 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 14:00:14.638625 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638583 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p5pfw\"" Jul 09 14:00:14.638769 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638618 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 14:00:14.638769 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.638631 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 14:00:14.647601 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.647583 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5bfdd544-599cv"] Jul 09 14:00:14.809703 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.809675 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkq7z" event={"ID":"a4a0156d-417c-4f3e-851f-cf8feeb6604b","Type":"ContainerStarted","Data":"bc217ededfbd534c32c25b46146267c6fa01f353203d92b41e83489ca138e10b"} Jul 09 14:00:14.810848 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.810828 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"e820cf0c459655b606eb371bcfd8eebd0d720ed5fd6dc8465bc5cfba025ce477"} Jul 09 14:00:14.813077 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813056 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813149 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813088 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813149 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813128 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0366765f-b092-482f-b94b-d037c431a69a-metrics-client-ca\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813175 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-tls\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813339 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813268 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813339 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813305 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-grpc-tls\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.813435 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.813354 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5zg\" (UniqueName: \"kubernetes.io/projected/0366765f-b092-482f-b94b-d037c431a69a-kube-api-access-ds5zg\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914428 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914403 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-tls\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914530 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914443 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914530 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914461 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914530 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914479 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-grpc-tls\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914530 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914523 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5zg\" (UniqueName: \"kubernetes.io/projected/0366765f-b092-482f-b94b-d037c431a69a-kube-api-access-ds5zg\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914576 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914614 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.914726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.914639 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0366765f-b092-482f-b94b-d037c431a69a-metrics-client-ca\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.915515 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.915467 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0366765f-b092-482f-b94b-d037c431a69a-metrics-client-ca\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.917212 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.917189 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.917325 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.917309 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-grpc-tls\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.917482 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.917465 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.917649 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.917629 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-tls\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.917901 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.917886 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.917936 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.917886 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0366765f-b092-482f-b94b-d037c431a69a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.923571 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.923556 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5zg\" (UniqueName: \"kubernetes.io/projected/0366765f-b092-482f-b94b-d037c431a69a-kube-api-access-ds5zg\") pod \"thanos-querier-7f5bfdd544-599cv\" (UID: \"0366765f-b092-482f-b94b-d037c431a69a\") " pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:14.945392 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:14.945373 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:15.073319 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:15.073219 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5bfdd544-599cv"] Jul 09 14:00:15.076149 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:15.076121 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0366765f_b092_482f_b94b_d037c431a69a.slice/crio-4ab0b44876cc503eeb53936319fd19c026d87b6ac9afb07cae2ce90b486c4ade WatchSource:0}: Error finding container 4ab0b44876cc503eeb53936319fd19c026d87b6ac9afb07cae2ce90b486c4ade: Status 404 returned error can't find the container with id 4ab0b44876cc503eeb53936319fd19c026d87b6ac9afb07cae2ce90b486c4ade Jul 09 14:00:15.815622 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:15.815585 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"4ab0b44876cc503eeb53936319fd19c026d87b6ac9afb07cae2ce90b486c4ade"} Jul 09 14:00:16.821781 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.821745 2553 generic.go:356] "Generic (PLEG): container finished" podID="a4a0156d-417c-4f3e-851f-cf8feeb6604b" containerID="b08461723491b5c9f4929e1a63e63dd2ac3a7a9f5290c58cd94a63290119f248" exitCode=0 Jul 09 14:00:16.822185 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.821848 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkq7z" event={"ID":"a4a0156d-417c-4f3e-851f-cf8feeb6604b","Type":"ContainerDied","Data":"b08461723491b5c9f4929e1a63e63dd2ac3a7a9f5290c58cd94a63290119f248"} Jul 09 14:00:16.823637 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.823613 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="51e1e69a0286ddae8a37849359446487139e954a0061e5c7d7703a37110b8e6e" exitCode=0 Jul 09 14:00:16.823730 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.823694 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"51e1e69a0286ddae8a37849359446487139e954a0061e5c7d7703a37110b8e6e"} Jul 09 14:00:16.977433 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.977381 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b4b4b6dc-h28f7"] Jul 09 14:00:16.980892 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.980870 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:16.984716 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.984685 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b2ftz\"" Jul 09 14:00:16.984823 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.984717 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 14:00:16.985023 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.984994 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d5akc7oktrec5\"" Jul 09 14:00:16.985023 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.985004 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 14:00:16.985333 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.985271 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 14:00:16.985412 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.985399 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 14:00:16.990925 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:16.990874 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b4b4b6dc-h28f7"] Jul 09 14:00:17.031730 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031699 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64v7r\" (UniqueName: \"kubernetes.io/projected/782ed496-56cb-4d5f-839e-352e02a349c0-kube-api-access-64v7r\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.031840 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031735 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/782ed496-56cb-4d5f-839e-352e02a349c0-metrics-server-audit-profiles\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.031840 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031779 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/782ed496-56cb-4d5f-839e-352e02a349c0-audit-log\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.031840 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782ed496-56cb-4d5f-839e-352e02a349c0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.031840 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031819 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-client-ca-bundle\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.032018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031844 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-secret-metrics-server-client-certs\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.032018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.031900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-secret-metrics-server-tls\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132529 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/782ed496-56cb-4d5f-839e-352e02a349c0-metrics-server-audit-profiles\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132529 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132519 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/782ed496-56cb-4d5f-839e-352e02a349c0-audit-log\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132682 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132540 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782ed496-56cb-4d5f-839e-352e02a349c0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132682 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132560 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-client-ca-bundle\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132682 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132578 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-secret-metrics-server-client-certs\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132723 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-secret-metrics-server-tls\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.132828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.132804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64v7r\" (UniqueName: \"kubernetes.io/projected/782ed496-56cb-4d5f-839e-352e02a349c0-kube-api-access-64v7r\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.133093 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.133033 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/782ed496-56cb-4d5f-839e-352e02a349c0-audit-log\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.133355 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.133319 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782ed496-56cb-4d5f-839e-352e02a349c0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.133564 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.133546 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/782ed496-56cb-4d5f-839e-352e02a349c0-metrics-server-audit-profiles\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.135004 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.134985 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-secret-metrics-server-client-certs\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.135171 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.135154 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-client-ca-bundle\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.135218 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.135159 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/782ed496-56cb-4d5f-839e-352e02a349c0-secret-metrics-server-tls\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.145183 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.145161 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64v7r\" (UniqueName: \"kubernetes.io/projected/782ed496-56cb-4d5f-839e-352e02a349c0-kube-api-access-64v7r\") pod \"metrics-server-5b4b4b6dc-h28f7\" (UID: \"782ed496-56cb-4d5f-839e-352e02a349c0\") " pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.295673 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.295650 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:17.435698 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.435402 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b4b4b6dc-h28f7"] Jul 09 14:00:17.438178 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:17.438135 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782ed496_56cb_4d5f_839e_352e02a349c0.slice/crio-e4355f53a6af27860a387662647b0bc1f382c1091402a9046eadec97254b87fd WatchSource:0}: Error finding container e4355f53a6af27860a387662647b0bc1f382c1091402a9046eadec97254b87fd: Status 404 returned error can't find the container with id e4355f53a6af27860a387662647b0bc1f382c1091402a9046eadec97254b87fd Jul 09 14:00:17.439414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.439390 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc"] Jul 09 14:00:17.444822 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.444807 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.447338 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.447315 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 14:00:17.447338 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.447328 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kcc8d\"" Jul 09 14:00:17.452350 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.451960 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc"] Jul 09 14:00:17.535776 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.535640 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4f8h\" (UniqueName: \"kubernetes.io/projected/d36f3de2-0d16-4ea0-ac57-3cdebff7ad28-kube-api-access-n4f8h\") pod \"monitoring-plugin-5f68df7f58-c4tbc\" (UID: \"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.535912 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.535821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d36f3de2-0d16-4ea0-ac57-3cdebff7ad28-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c4tbc\" (UID: \"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.636376 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.636311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d36f3de2-0d16-4ea0-ac57-3cdebff7ad28-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c4tbc\" (UID: \"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.636376 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.636354 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4f8h\" (UniqueName: \"kubernetes.io/projected/d36f3de2-0d16-4ea0-ac57-3cdebff7ad28-kube-api-access-n4f8h\") pod \"monitoring-plugin-5f68df7f58-c4tbc\" (UID: \"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.638756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.638732 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d36f3de2-0d16-4ea0-ac57-3cdebff7ad28-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c4tbc\" (UID: \"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.644213 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.644192 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4f8h\" (UniqueName: \"kubernetes.io/projected/d36f3de2-0d16-4ea0-ac57-3cdebff7ad28-kube-api-access-n4f8h\") pod \"monitoring-plugin-5f68df7f58-c4tbc\" (UID: \"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.755492 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.755464 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:17.830300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.830266 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkq7z" event={"ID":"a4a0156d-417c-4f3e-851f-cf8feeb6604b","Type":"ContainerStarted","Data":"325cdc262073ef749290c4eea85bd026c6071cbc29565a7ba2f091277d12170c"} Jul 09 14:00:17.830746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.830371 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkq7z" event={"ID":"a4a0156d-417c-4f3e-851f-cf8feeb6604b","Type":"ContainerStarted","Data":"d712e28d4e3fb05b0e9d1d094517c92b556890692ff0a038f0361fb954b787e8"} Jul 09 14:00:17.831737 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.831709 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" event={"ID":"782ed496-56cb-4d5f-839e-352e02a349c0","Type":"ContainerStarted","Data":"e4355f53a6af27860a387662647b0bc1f382c1091402a9046eadec97254b87fd"} Jul 09 14:00:17.849645 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.849601 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xkq7z" podStartSLOduration=3.9106116909999997 podStartE2EDuration="5.849588973s" totalImagesPullingTime="1.876305559s" totalInitContainerRuntime="62.671723ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:17.849270385 +0000 UTC m=+118.063496539" watchObservedRunningTime="2026-07-09 14:00:17.849588973 +0000 UTC m=+118.063815089" Jul 09 14:00:17.878501 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.878480 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6795566f6f-gpg76"] Jul 09 14:00:17.882090 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.882072 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.885169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.884963 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 14:00:17.885169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.884974 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 14:00:17.885169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.884997 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 14:00:17.885169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.884997 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 14:00:17.885169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.885060 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j9hjd\"" Jul 09 14:00:17.885169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.884969 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 14:00:17.891169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.891151 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 14:00:17.894720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.894698 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6795566f6f-gpg76"] Jul 09 14:00:17.939237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939210 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-secret-telemeter-client\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939252 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-serving-certs-ca-bundle\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939279 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939331 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-telemeter-client-tls\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939389 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drrcw\" (UniqueName: \"kubernetes.io/projected/1c3c1ce1-1050-4be6-be23-c85bd15279e8-kube-api-access-drrcw\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939635 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939415 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-metrics-client-ca\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:17.939635 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:17.939503 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-federate-client-tls\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040698 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040671 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-secret-telemeter-client\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040863 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040714 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-serving-certs-ca-bundle\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040863 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040745 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040863 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040776 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040863 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-telemeter-client-tls\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040863 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040830 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drrcw\" (UniqueName: \"kubernetes.io/projected/1c3c1ce1-1050-4be6-be23-c85bd15279e8-kube-api-access-drrcw\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.040863 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040858 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-metrics-client-ca\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.041213 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.040892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-federate-client-tls\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.041960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.041906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-metrics-client-ca\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.041960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.041942 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-serving-certs-ca-bundle\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.042298 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.042275 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3c1ce1-1050-4be6-be23-c85bd15279e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.043779 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.043754 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.044019 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.043995 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-secret-telemeter-client\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.044134 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.044015 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-telemeter-client-tls\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.044134 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.044003 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c3c1ce1-1050-4be6-be23-c85bd15279e8-federate-client-tls\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.050274 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.050250 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drrcw\" (UniqueName: \"kubernetes.io/projected/1c3c1ce1-1050-4be6-be23-c85bd15279e8-kube-api-access-drrcw\") pod \"telemeter-client-6795566f6f-gpg76\" (UID: \"1c3c1ce1-1050-4be6-be23-c85bd15279e8\") " pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.193702 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.193648 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" Jul 09 14:00:18.196306 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.196279 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc"] Jul 09 14:00:18.197696 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:18.197663 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36f3de2_0d16_4ea0_ac57_3cdebff7ad28.slice/crio-3fa812efb42cb3f3dd6410f72b794c01a600744e30043ad36a8f8c0041abf323 WatchSource:0}: Error finding container 3fa812efb42cb3f3dd6410f72b794c01a600744e30043ad36a8f8c0041abf323: Status 404 returned error can't find the container with id 3fa812efb42cb3f3dd6410f72b794c01a600744e30043ad36a8f8c0041abf323 Jul 09 14:00:18.334320 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.334294 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6795566f6f-gpg76"] Jul 09 14:00:18.340128 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:18.340090 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3c1ce1_1050_4be6_be23_c85bd15279e8.slice/crio-f8bdf7fb671bd6bfa55113ca8429d110524259c51ebe3d5c5e7c004f34b733fb WatchSource:0}: Error finding container f8bdf7fb671bd6bfa55113ca8429d110524259c51ebe3d5c5e7c004f34b733fb: Status 404 returned error can't find the container with id f8bdf7fb671bd6bfa55113ca8429d110524259c51ebe3d5c5e7c004f34b733fb Jul 09 14:00:18.839523 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.839342 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"b38a415d9ff023c784fab945c825447e1ea5e9cf506dd6a338ed33271e2c3548"} Jul 09 14:00:18.839523 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.839430 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"34666e5c81578fb92c31f6bc256b7896ffe990bb238a6d9cdff2ca1c4d6bacd8"} Jul 09 14:00:18.839523 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.839473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"1ccd4c1944ff3aaf0ad7befdf8ac8582a510442c2763797940437a069f5cac7e"} Jul 09 14:00:18.845721 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.845687 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" event={"ID":"1c3c1ce1-1050-4be6-be23-c85bd15279e8","Type":"ContainerStarted","Data":"f8bdf7fb671bd6bfa55113ca8429d110524259c51ebe3d5c5e7c004f34b733fb"} Jul 09 14:00:18.847824 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:18.847768 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" event={"ID":"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28","Type":"ContainerStarted","Data":"3fa812efb42cb3f3dd6410f72b794c01a600744e30043ad36a8f8c0041abf323"} Jul 09 14:00:20.865291 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.865207 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"463669f0aab35e8332ad3cb1fbfd1b0ecd1e0d37809a74ef730fdac541f87e51"} Jul 09 14:00:20.865662 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.865304 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"08ab71bbf7c97e82683f0e41612b9e347d06ba3418534dfe14e2078be7f5c899"} Jul 09 14:00:20.865662 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.865460 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:20.865662 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.865512 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" event={"ID":"0366765f-b092-482f-b94b-d037c431a69a","Type":"ContainerStarted","Data":"948d24351d4b1b82120759b84d92ff834908c6f1367e40913ea361d329de880a"} Jul 09 14:00:20.866770 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.866748 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" event={"ID":"782ed496-56cb-4d5f-839e-352e02a349c0","Type":"ContainerStarted","Data":"73093a9846ab19e3b5b56a9e756e65c42193c794dbb081c1f16fe192f6ca9d20"} Jul 09 14:00:20.869935 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.869916 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"2f442c51a0a8c29a48ed67ae9aa061abd9dad388060248663b2e95dbe4820fb1"} Jul 09 14:00:20.870031 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.869979 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"5375ce859ddef6b2e6581110b91dcb5ab852b5dca196a09047564b3e7c0b747c"} Jul 09 14:00:20.870031 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.870006 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"b3cdff0b3381f448493c36fec5b1771d7b7e3261b882a5282e74162fc9c18f9b"} Jul 09 14:00:20.871441 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.871417 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" event={"ID":"d36f3de2-0d16-4ea0-ac57-3cdebff7ad28","Type":"ContainerStarted","Data":"7a963189a58ea670cc2e50ed5c34b4b5c97f8b4eabdb71a538e53dc02228f5f5"} Jul 09 14:00:20.872174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.872145 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:20.878017 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.877995 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" Jul 09 14:00:20.893565 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.893525 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" podStartSLOduration=1.639582313 podStartE2EDuration="6.893511075s" totalImagesPullingTime="5.253928762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:20.892279194 +0000 UTC m=+121.106505311" watchObservedRunningTime="2026-07-09 14:00:20.893511075 +0000 UTC m=+121.107737195" Jul 09 14:00:20.914548 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.914495 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" podStartSLOduration=1.790272464 podStartE2EDuration="4.914481577s" totalImagesPullingTime="3.124209113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:20.913669236 +0000 UTC m=+121.127895370" watchObservedRunningTime="2026-07-09 14:00:20.914481577 +0000 UTC m=+121.128707692" Jul 09 14:00:20.929362 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:20.929321 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c4tbc" podStartSLOduration=1.5688812570000001 podStartE2EDuration="3.929304685s" totalImagesPullingTime="2.360423428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:20.929050312 +0000 UTC m=+121.143276428" watchObservedRunningTime="2026-07-09 14:00:20.929304685 +0000 UTC m=+121.143530802" Jul 09 14:00:21.879537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:21.879396 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"90e7c64b6afe28340a498a1d30f2380a3eb6132788ed2f24bc1ec0b452ac2f1d"} Jul 09 14:00:21.879537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:21.879479 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"dc735909a66c5adfbf2b5c41b5f51df71a2e703f1d3903b9366930b34df58cc9"} Jul 09 14:00:21.879537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:21.879506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerStarted","Data":"ce255715e818a8737cd6416d68ab82b97e919577fcc2d91e7d48b4d612fb9e7c"} Jul 09 14:00:21.911492 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:21.911436 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.319915264 podStartE2EDuration="8.911419104s" totalImagesPullingTime="5.574095869s" totalInitContainerRuntime="17.407971ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:21.907741115 +0000 UTC m=+122.121967233" watchObservedRunningTime="2026-07-09 14:00:21.911419104 +0000 UTC m=+122.125645220" Jul 09 14:00:22.885988 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:22.885953 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" event={"ID":"1c3c1ce1-1050-4be6-be23-c85bd15279e8","Type":"ContainerStarted","Data":"33c5ed127733548e9d0881a89b655c261bc4e02b4127fe6af456824362bbb906"} Jul 09 14:00:22.886509 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:22.886025 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" event={"ID":"1c3c1ce1-1050-4be6-be23-c85bd15279e8","Type":"ContainerStarted","Data":"ca0eb28a11bfdde24e466a49464306946dccffe6e61bc3b243bc13aae2c28216"} Jul 09 14:00:22.886509 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:22.886054 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" event={"ID":"1c3c1ce1-1050-4be6-be23-c85bd15279e8","Type":"ContainerStarted","Data":"df9c9acbed31126d8d124fa6252e0053e74fcdc18bcd5b4e85e23c445b91540d"} Jul 09 14:00:22.911254 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:22.911210 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6795566f6f-gpg76" podStartSLOduration=2.283786568 podStartE2EDuration="5.911192445s" totalImagesPullingTime="3.627405877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:22.90889358 +0000 UTC m=+123.123119706" watchObservedRunningTime="2026-07-09 14:00:22.911192445 +0000 UTC m=+123.125418561" Jul 09 14:00:26.885994 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:26.885960 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f5bfdd544-599cv" Jul 09 14:00:28.907528 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.907499 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-shg9p"] Jul 09 14:00:28.911391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.911377 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:28.914203 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.914178 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gbrfr\"" Jul 09 14:00:28.914333 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.914270 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:00:28.914333 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.914317 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:00:28.922618 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.922589 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-shg9p"] Jul 09 14:00:28.934574 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:28.934548 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdc7c\" (UniqueName: \"kubernetes.io/projected/297792fb-edb3-4f2e-b529-2456eb00b69c-kube-api-access-xdc7c\") pod \"downloads-68c9cbb497-shg9p\" (UID: \"297792fb-edb3-4f2e-b529-2456eb00b69c\") " pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:29.035100 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:29.035078 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdc7c\" (UniqueName: \"kubernetes.io/projected/297792fb-edb3-4f2e-b529-2456eb00b69c-kube-api-access-xdc7c\") pod \"downloads-68c9cbb497-shg9p\" (UID: \"297792fb-edb3-4f2e-b529-2456eb00b69c\") " pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:29.043857 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:29.043826 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdc7c\" (UniqueName: \"kubernetes.io/projected/297792fb-edb3-4f2e-b529-2456eb00b69c-kube-api-access-xdc7c\") pod \"downloads-68c9cbb497-shg9p\" (UID: \"297792fb-edb3-4f2e-b529-2456eb00b69c\") " pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:29.220192 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:29.220168 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:29.357004 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:29.356979 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-shg9p"] Jul 09 14:00:29.358482 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:29.358454 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297792fb_edb3_4f2e_b529_2456eb00b69c.slice/crio-3e3c479b25e58995b0246add628b47c19adc08cb0b6bd00aaf11dfd1ac949dbf WatchSource:0}: Error finding container 3e3c479b25e58995b0246add628b47c19adc08cb0b6bd00aaf11dfd1ac949dbf: Status 404 returned error can't find the container with id 3e3c479b25e58995b0246add628b47c19adc08cb0b6bd00aaf11dfd1ac949dbf Jul 09 14:00:29.920182 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:29.920146 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-shg9p" event={"ID":"297792fb-edb3-4f2e-b529-2456eb00b69c","Type":"ContainerStarted","Data":"3e3c479b25e58995b0246add628b47c19adc08cb0b6bd00aaf11dfd1ac949dbf"} Jul 09 14:00:30.146049 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:30.146017 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 14:00:30.148558 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:30.148526 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b224c32b-7b3b-4d25-84ce-868d610a2ae0-metrics-certs\") pod \"network-metrics-daemon-6pjbl\" (UID: \"b224c32b-7b3b-4d25-84ce-868d610a2ae0\") " pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 14:00:30.219920 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:30.219866 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwpwr\"" Jul 09 14:00:30.228136 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:30.228100 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pjbl" Jul 09 14:00:30.359334 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:30.359306 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6pjbl"] Jul 09 14:00:30.361081 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:30.361043 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb224c32b_7b3b_4d25_84ce_868d610a2ae0.slice/crio-32a7fe597da97967db7245746a846dacf3d91057fbfd8eab468c72714e7cf724 WatchSource:0}: Error finding container 32a7fe597da97967db7245746a846dacf3d91057fbfd8eab468c72714e7cf724: Status 404 returned error can't find the container with id 32a7fe597da97967db7245746a846dacf3d91057fbfd8eab468c72714e7cf724 Jul 09 14:00:30.926622 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:30.926589 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pjbl" event={"ID":"b224c32b-7b3b-4d25-84ce-868d610a2ae0","Type":"ContainerStarted","Data":"32a7fe597da97967db7245746a846dacf3d91057fbfd8eab468c72714e7cf724"} Jul 09 14:00:32.938552 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:32.938507 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pjbl" event={"ID":"b224c32b-7b3b-4d25-84ce-868d610a2ae0","Type":"ContainerStarted","Data":"8983ad0eb91cbae4e1f517af1556e39666bd48998cc8a7e2fcfa1d4cdcc4548f"} Jul 09 14:00:32.938945 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:32.938577 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pjbl" event={"ID":"b224c32b-7b3b-4d25-84ce-868d610a2ae0","Type":"ContainerStarted","Data":"c694c5250d1c3e33a2f376a59184786c30db5b16f24fe6810f2cea5f46824ef0"} Jul 09 14:00:32.957214 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:32.957167 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6pjbl" podStartSLOduration=130.928667886 podStartE2EDuration="2m12.957149916s" totalImagesPullingTime="2.02848203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:32.954816799 +0000 UTC m=+133.169042916" watchObservedRunningTime="2026-07-09 14:00:32.957149916 +0000 UTC m=+133.171376031" Jul 09 14:00:37.296202 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:37.296164 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:37.296570 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:37.296224 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:39.391129 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.380777 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b89f78b68-wgpms"] Jul 09 14:00:39.391129 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.384295 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.399314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.398999 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:00:39.399314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.399050 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:00:39.399314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.399305 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:00:39.399640 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.399349 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:00:39.399640 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.399500 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r6nk7\"" Jul 09 14:00:39.400616 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.400521 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:00:39.406324 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.403332 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b89f78b68-wgpms"] Jul 09 14:00:39.528696 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.528662 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-serving-cert\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.528903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.528710 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbpzn\" (UniqueName: \"kubernetes.io/projected/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-kube-api-access-hbpzn\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.528903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.528742 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-oauth-config\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.528903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.528799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-service-ca\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.528903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.528825 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-oauth-serving-cert\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.528903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.528873 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-config\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.629435 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.629404 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-service-ca\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.629571 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.629442 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-oauth-serving-cert\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.629571 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.629492 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-config\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.629571 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.629534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-serving-cert\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.629571 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.629568 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbpzn\" (UniqueName: \"kubernetes.io/projected/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-kube-api-access-hbpzn\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.629755 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.629598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-oauth-config\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.630268 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.630214 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-service-ca\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.630387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.630290 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-oauth-serving-cert\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.630448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.630405 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-config\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.632051 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.632029 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-oauth-config\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.632154 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.632034 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-serving-cert\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.637350 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.637320 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbpzn\" (UniqueName: \"kubernetes.io/projected/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-kube-api-access-hbpzn\") pod \"console-b89f78b68-wgpms\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:39.698307 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:39.698280 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:00:46.129212 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:46.129188 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b89f78b68-wgpms"] Jul 09 14:00:46.132294 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:46.132268 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdc9df9_5fc5_48d5_9636_0aa28f5980e4.slice/crio-1b89a402600fbfdedc53f665dae588513425bff821e72bae0cba12afe44e5d1d WatchSource:0}: Error finding container 1b89a402600fbfdedc53f665dae588513425bff821e72bae0cba12afe44e5d1d: Status 404 returned error can't find the container with id 1b89a402600fbfdedc53f665dae588513425bff821e72bae0cba12afe44e5d1d Jul 09 14:00:47.003974 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:47.003932 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b89f78b68-wgpms" event={"ID":"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4","Type":"ContainerStarted","Data":"1b89a402600fbfdedc53f665dae588513425bff821e72bae0cba12afe44e5d1d"} Jul 09 14:00:47.006611 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:47.006550 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-shg9p" event={"ID":"297792fb-edb3-4f2e-b529-2456eb00b69c","Type":"ContainerStarted","Data":"ac8c52aad3f79c4274c3d67cc549db646605dd440700b8850a8b4ea702236a44"} Jul 09 14:00:47.007005 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:47.006958 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:47.019661 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:47.019637 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-shg9p" Jul 09 14:00:47.030840 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:47.030786 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-shg9p" podStartSLOduration=2.277408331 podStartE2EDuration="19.03076709s" totalImagesPullingTime="16.753358759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:47.028275715 +0000 UTC m=+147.242501833" watchObservedRunningTime="2026-07-09 14:00:47.03076709 +0000 UTC m=+147.244993207" Jul 09 14:00:48.410064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.410024 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b667df594-scc8h"] Jul 09 14:00:48.438716 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.438162 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b667df594-scc8h"] Jul 09 14:00:48.438716 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.438300 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.447208 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.447169 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:00:48.509884 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.509850 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-serving-cert\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.510087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.509895 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4zr\" (UniqueName: \"kubernetes.io/projected/14a6395a-2a95-4306-b307-1a06e78bef9f-kube-api-access-zs4zr\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.510087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.509949 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-oauth-config\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.510087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.509976 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-console-config\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.510087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.510015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-oauth-serving-cert\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.510087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.510042 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-service-ca\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.510087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.510069 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-trusted-ca-bundle\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.610875 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.610835 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-serving-cert\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.611030 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.610888 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4zr\" (UniqueName: \"kubernetes.io/projected/14a6395a-2a95-4306-b307-1a06e78bef9f-kube-api-access-zs4zr\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.611030 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.610931 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-oauth-config\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.611030 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.610954 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-console-config\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.611030 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.610984 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-oauth-serving-cert\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.611030 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.611011 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-service-ca\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.611302 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.611042 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-trusted-ca-bundle\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.612383 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.612014 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-console-config\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.612383 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.612034 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-trusted-ca-bundle\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.612641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.612616 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-service-ca\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.613480 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.613440 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-oauth-serving-cert\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.614327 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.614221 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-serving-cert\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.615072 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.615047 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-oauth-config\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.621299 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.621275 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4zr\" (UniqueName: \"kubernetes.io/projected/14a6395a-2a95-4306-b307-1a06e78bef9f-kube-api-access-zs4zr\") pod \"console-7b667df594-scc8h\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:48.752659 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:48.752599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:49.736188 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:49.736149 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b667df594-scc8h"] Jul 09 14:00:49.739778 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:00:49.739745 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a6395a_2a95_4306_b307_1a06e78bef9f.slice/crio-b151b551437086311e10da6f0227e44486f88a3f681e264cb6bcb6a86d143cad WatchSource:0}: Error finding container b151b551437086311e10da6f0227e44486f88a3f681e264cb6bcb6a86d143cad: Status 404 returned error can't find the container with id b151b551437086311e10da6f0227e44486f88a3f681e264cb6bcb6a86d143cad Jul 09 14:00:50.022836 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:50.022798 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b667df594-scc8h" event={"ID":"14a6395a-2a95-4306-b307-1a06e78bef9f","Type":"ContainerStarted","Data":"b151b551437086311e10da6f0227e44486f88a3f681e264cb6bcb6a86d143cad"} Jul 09 14:00:51.029844 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:51.029805 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b667df594-scc8h" event={"ID":"14a6395a-2a95-4306-b307-1a06e78bef9f","Type":"ContainerStarted","Data":"f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6"} Jul 09 14:00:51.031708 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:51.031682 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b89f78b68-wgpms" event={"ID":"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4","Type":"ContainerStarted","Data":"ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e"} Jul 09 14:00:51.052657 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:51.052615 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b667df594-scc8h" podStartSLOduration=2.416746048 podStartE2EDuration="3.052596887s" totalImagesPullingTime="635.850839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:51.050762711 +0000 UTC m=+151.264988856" watchObservedRunningTime="2026-07-09 14:00:51.052596887 +0000 UTC m=+151.266823004" Jul 09 14:00:51.066746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:51.066693 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b89f78b68-wgpms" podStartSLOduration=8.158131746 podStartE2EDuration="12.066672763s" totalImagesPullingTime="3.908541017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:51.066158465 +0000 UTC m=+151.280384609" watchObservedRunningTime="2026-07-09 14:00:51.066672763 +0000 UTC m=+151.280898882" Jul 09 14:00:57.301720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:57.301685 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:57.305658 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:57.305634 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b4b4b6dc-h28f7" Jul 09 14:00:58.753051 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:58.753015 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:58.753592 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:58.753075 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:58.757484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:58.757464 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:59.071044 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:59.070976 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:00:59.124322 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:59.124295 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b89f78b68-wgpms"] Jul 09 14:00:59.698789 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:00:59.698759 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:01:24.144524 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.144421 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b89f78b68-wgpms" podUID="0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" containerName="console" containerID="cri-o://ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e" gracePeriod=15 Jul 09 14:01:24.424210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.424176 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:01:24.480656 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.480628 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-config\") pod \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " Jul 09 14:01:24.480762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.480665 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-oauth-serving-cert\") pod \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " Jul 09 14:01:24.480762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.480688 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-serving-cert\") pod \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " Jul 09 14:01:24.480762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.480736 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-service-ca\") pod \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " Jul 09 14:01:24.480862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.480792 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbpzn\" (UniqueName: \"kubernetes.io/projected/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-kube-api-access-hbpzn\") pod \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " Jul 09 14:01:24.480964 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.480934 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-oauth-config\") pod \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\" (UID: \"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4\") " Jul 09 14:01:24.481068 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.481040 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" (UID: "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:01:24.481156 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.481050 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-config" (OuterVolumeSpecName: "console-config") pod "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" (UID: "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:01:24.481230 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.481147 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" (UID: "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:01:24.481278 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.481227 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:24.481278 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.481243 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-oauth-serving-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:24.481278 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.481253 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-service-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:24.482910 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.482887 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" (UID: "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:24.483001 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.482938 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-kube-api-access-hbpzn" (OuterVolumeSpecName: "kube-api-access-hbpzn") pod "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" (UID: "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4"). InnerVolumeSpecName "kube-api-access-hbpzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:01:24.483001 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.482940 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" (UID: "0cdc9df9-5fc5-48d5-9636-0aa28f5980e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:24.582534 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.582513 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-serving-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:24.582534 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.582533 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbpzn\" (UniqueName: \"kubernetes.io/projected/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-kube-api-access-hbpzn\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:24.582658 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:24.582542 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4-console-oauth-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:25.183208 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.183174 2553 generic.go:356] "Generic (PLEG): container finished" podID="0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" containerID="ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e" exitCode=0 Jul 09 14:01:25.183621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.183229 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b89f78b68-wgpms" event={"ID":"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4","Type":"ContainerDied","Data":"ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e"} Jul 09 14:01:25.183621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.183236 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b89f78b68-wgpms" Jul 09 14:01:25.183621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.183296 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b89f78b68-wgpms" event={"ID":"0cdc9df9-5fc5-48d5-9636-0aa28f5980e4","Type":"ContainerDied","Data":"1b89a402600fbfdedc53f665dae588513425bff821e72bae0cba12afe44e5d1d"} Jul 09 14:01:25.183621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.183319 2553 scope.go:117] "RemoveContainer" containerID="ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e" Jul 09 14:01:25.193273 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.193257 2553 scope.go:117] "RemoveContainer" containerID="ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e" Jul 09 14:01:25.193558 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:01:25.193539 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e\": container with ID starting with ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e not found: ID does not exist" containerID="ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e" Jul 09 14:01:25.193628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.193565 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e"} err="failed to get container status \"ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e\": rpc error: code = NotFound desc = could not find container \"ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e\": container with ID starting with ebabbf6e5b9fec638c56615d6a129dde3471d4ba341ae23475de2ba3ba2c512e not found: ID does not exist" Jul 09 14:01:25.205082 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.205054 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b89f78b68-wgpms"] Jul 09 14:01:25.208835 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:25.208810 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b89f78b68-wgpms"] Jul 09 14:01:26.299461 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:26.299425 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" path="/var/lib/kubelet/pods/0cdc9df9-5fc5-48d5-9636-0aa28f5980e4/volumes" Jul 09 14:01:29.134371 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.134336 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6757dc86dd-4jws7"] Jul 09 14:01:29.134822 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.134804 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" containerName="console" Jul 09 14:01:29.134878 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.134826 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" containerName="console" Jul 09 14:01:29.134936 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.134923 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cdc9df9-5fc5-48d5-9636-0aa28f5980e4" containerName="console" Jul 09 14:01:29.167627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.167598 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6757dc86dd-4jws7"] Jul 09 14:01:29.167760 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.167687 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212252 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212226 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-serving-cert\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212273 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-oauth-serving-cert\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212307 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-service-ca\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-config\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212391 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7bk\" (UniqueName: \"kubernetes.io/projected/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-kube-api-access-lg7bk\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212570 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212423 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-trusted-ca-bundle\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.212570 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.212451 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-oauth-config\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.312853 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.312829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-trusted-ca-bundle\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.312970 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.312859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-oauth-config\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.312970 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.312896 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-serving-cert\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.312970 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.312926 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-oauth-serving-cert\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313084 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313052 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-service-ca\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313163 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313096 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-config\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313163 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7bk\" (UniqueName: \"kubernetes.io/projected/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-kube-api-access-lg7bk\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313739 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313717 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-trusted-ca-bundle\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313839 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313759 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-oauth-serving-cert\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313839 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313772 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-service-ca\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.313974 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.313951 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-config\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.315484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.315455 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-oauth-config\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.315573 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.315490 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-serving-cert\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.321340 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.321324 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7bk\" (UniqueName: \"kubernetes.io/projected/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-kube-api-access-lg7bk\") pod \"console-6757dc86dd-4jws7\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.476253 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.476228 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:29.639466 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:29.639401 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6757dc86dd-4jws7"] Jul 09 14:01:29.641679 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:01:29.641640 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ff6999_0edf_46ed_8a7d_8f950f9ba26e.slice/crio-4499273c97a78f79fb5ba91914933828a0df113163bf94d64cb1f844d7011970 WatchSource:0}: Error finding container 4499273c97a78f79fb5ba91914933828a0df113163bf94d64cb1f844d7011970: Status 404 returned error can't find the container with id 4499273c97a78f79fb5ba91914933828a0df113163bf94d64cb1f844d7011970 Jul 09 14:01:30.205537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:30.205501 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757dc86dd-4jws7" event={"ID":"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e","Type":"ContainerStarted","Data":"a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109"} Jul 09 14:01:30.205960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:30.205556 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757dc86dd-4jws7" event={"ID":"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e","Type":"ContainerStarted","Data":"4499273c97a78f79fb5ba91914933828a0df113163bf94d64cb1f844d7011970"} Jul 09 14:01:30.238332 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:30.238285 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6757dc86dd-4jws7" podStartSLOduration=1.238268889 podStartE2EDuration="1.238268889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:01:30.238230067 +0000 UTC m=+190.452456195" watchObservedRunningTime="2026-07-09 14:01:30.238268889 +0000 UTC m=+190.452495041" Jul 09 14:01:33.008394 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008364 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:01:33.008743 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008629 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="alertmanager" containerID="cri-o://b3cdff0b3381f448493c36fec5b1771d7b7e3261b882a5282e74162fc9c18f9b" gracePeriod=120 Jul 09 14:01:33.008743 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008715 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-metric" containerID="cri-o://dc735909a66c5adfbf2b5c41b5f51df71a2e703f1d3903b9366930b34df58cc9" gracePeriod=120 Jul 09 14:01:33.008859 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008737 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="prom-label-proxy" containerID="cri-o://90e7c64b6afe28340a498a1d30f2380a3eb6132788ed2f24bc1ec0b452ac2f1d" gracePeriod=120 Jul 09 14:01:33.008859 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008756 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-web" containerID="cri-o://2f442c51a0a8c29a48ed67ae9aa061abd9dad388060248663b2e95dbe4820fb1" gracePeriod=120 Jul 09 14:01:33.008859 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008765 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy" containerID="cri-o://ce255715e818a8737cd6416d68ab82b97e919577fcc2d91e7d48b4d612fb9e7c" gracePeriod=120 Jul 09 14:01:33.008859 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.008788 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="config-reloader" containerID="cri-o://5375ce859ddef6b2e6581110b91dcb5ab852b5dca196a09047564b3e7c0b747c" gracePeriod=120 Jul 09 14:01:33.222468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222412 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="90e7c64b6afe28340a498a1d30f2380a3eb6132788ed2f24bc1ec0b452ac2f1d" exitCode=0 Jul 09 14:01:33.222468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222460 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="ce255715e818a8737cd6416d68ab82b97e919577fcc2d91e7d48b4d612fb9e7c" exitCode=0 Jul 09 14:01:33.222468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222468 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="5375ce859ddef6b2e6581110b91dcb5ab852b5dca196a09047564b3e7c0b747c" exitCode=0 Jul 09 14:01:33.222468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222474 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="b3cdff0b3381f448493c36fec5b1771d7b7e3261b882a5282e74162fc9c18f9b" exitCode=0 Jul 09 14:01:33.222658 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222492 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"90e7c64b6afe28340a498a1d30f2380a3eb6132788ed2f24bc1ec0b452ac2f1d"} Jul 09 14:01:33.222658 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222556 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"ce255715e818a8737cd6416d68ab82b97e919577fcc2d91e7d48b4d612fb9e7c"} Jul 09 14:01:33.222658 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222588 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"5375ce859ddef6b2e6581110b91dcb5ab852b5dca196a09047564b3e7c0b747c"} Jul 09 14:01:33.222658 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:33.222612 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"b3cdff0b3381f448493c36fec5b1771d7b7e3261b882a5282e74162fc9c18f9b"} Jul 09 14:01:34.230237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.230206 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="dc735909a66c5adfbf2b5c41b5f51df71a2e703f1d3903b9366930b34df58cc9" exitCode=0 Jul 09 14:01:34.230237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.230233 2553 generic.go:356] "Generic (PLEG): container finished" podID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerID="2f442c51a0a8c29a48ed67ae9aa061abd9dad388060248663b2e95dbe4820fb1" exitCode=0 Jul 09 14:01:34.230689 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.230284 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"dc735909a66c5adfbf2b5c41b5f51df71a2e703f1d3903b9366930b34df58cc9"} Jul 09 14:01:34.230689 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.230353 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"2f442c51a0a8c29a48ed67ae9aa061abd9dad388060248663b2e95dbe4820fb1"} Jul 09 14:01:34.294347 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.294322 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:34.353314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353241 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-cluster-tls-config\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353284 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tblrl\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-kube-api-access-tblrl\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353309 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-web-config\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353337 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353367 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-metrics-client-ca\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353393 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-out\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353437 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-volume\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353492 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-main-db\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353530 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-web\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353817 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353568 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353817 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353601 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-main-tls\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353817 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353632 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-trusted-ca-bundle\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.353817 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.353670 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-tls-assets\") pod \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\" (UID: \"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68\") " Jul 09 14:01:34.354219 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.354183 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:01:34.354641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.354610 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:01:34.354944 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.354919 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:01:34.356629 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.356598 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-kube-api-access-tblrl" (OuterVolumeSpecName: "kube-api-access-tblrl") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "kube-api-access-tblrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:01:34.356726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.356627 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-volume" (OuterVolumeSpecName: "config-volume") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.357604 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.357572 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:01:34.357679 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.357649 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.358143 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.358087 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-out" (OuterVolumeSpecName: "config-out") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:01:34.358249 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.358192 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.358387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.358358 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.359375 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.359353 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.361675 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.361649 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.369338 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.369315 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-web-config" (OuterVolumeSpecName: "web-config") pod "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" (UID: "47de86dd-5f09-4d01-b2b3-b0eb6fab0d68"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:01:34.454833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454798 2553 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-cluster-tls-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454832 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tblrl\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-kube-api-access-tblrl\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454845 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-web-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454855 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454865 2553 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-metrics-client-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454872 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-out\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454881 2553 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-config-volume\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454889 2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-main-db\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454897 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454906 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454914 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-secret-alertmanager-main-tls\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454924 2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:34.454984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:34.454934 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68-tls-assets\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:01:35.237986 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.237952 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47de86dd-5f09-4d01-b2b3-b0eb6fab0d68","Type":"ContainerDied","Data":"e820cf0c459655b606eb371bcfd8eebd0d720ed5fd6dc8465bc5cfba025ce477"} Jul 09 14:01:35.237986 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.237971 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.238450 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.238057 2553 scope.go:117] "RemoveContainer" containerID="90e7c64b6afe28340a498a1d30f2380a3eb6132788ed2f24bc1ec0b452ac2f1d" Jul 09 14:01:35.246753 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.246729 2553 scope.go:117] "RemoveContainer" containerID="dc735909a66c5adfbf2b5c41b5f51df71a2e703f1d3903b9366930b34df58cc9" Jul 09 14:01:35.254312 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.254296 2553 scope.go:117] "RemoveContainer" containerID="ce255715e818a8737cd6416d68ab82b97e919577fcc2d91e7d48b4d612fb9e7c" Jul 09 14:01:35.260771 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.260752 2553 scope.go:117] "RemoveContainer" containerID="2f442c51a0a8c29a48ed67ae9aa061abd9dad388060248663b2e95dbe4820fb1" Jul 09 14:01:35.263751 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.263731 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:01:35.267455 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.267426 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:01:35.268316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.268302 2553 scope.go:117] "RemoveContainer" containerID="5375ce859ddef6b2e6581110b91dcb5ab852b5dca196a09047564b3e7c0b747c" Jul 09 14:01:35.275044 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.275028 2553 scope.go:117] "RemoveContainer" containerID="b3cdff0b3381f448493c36fec5b1771d7b7e3261b882a5282e74162fc9c18f9b" Jul 09 14:01:35.281762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.281737 2553 scope.go:117] "RemoveContainer" containerID="51e1e69a0286ddae8a37849359446487139e954a0061e5c7d7703a37110b8e6e" Jul 09 14:01:35.294396 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294377 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:01:35.294679 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294667 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="init-config-reloader" Jul 09 14:01:35.294720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294681 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="init-config-reloader" Jul 09 14:01:35.294720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294694 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-web" Jul 09 14:01:35.294720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294699 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-web" Jul 09 14:01:35.294720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294710 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="alertmanager" Jul 09 14:01:35.294720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294716 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="alertmanager" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294724 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="prom-label-proxy" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294732 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="prom-label-proxy" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294742 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-metric" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294747 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-metric" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294754 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294759 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294766 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="config-reloader" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294771 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="config-reloader" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294821 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-metric" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294831 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="config-reloader" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294838 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="prom-label-proxy" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294844 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="alertmanager" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294849 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy" Jul 09 14:01:35.294862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.294854 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" containerName="kube-rbac-proxy-web" Jul 09 14:01:35.300295 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.300275 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.303173 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303157 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:01:35.303396 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303376 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:01:35.303501 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303381 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:01:35.303722 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303680 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:01:35.303722 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303695 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:01:35.303722 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303701 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:01:35.303912 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303701 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:01:35.303912 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.303810 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hvx27\"" Jul 09 14:01:35.304033 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.304019 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:01:35.308135 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.308089 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:01:35.312815 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.312795 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:01:35.362549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362503 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-web-config\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362532 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p265p\" (UniqueName: \"kubernetes.io/projected/87974fc2-6517-4e5f-8da8-e61fa1a2130d-kube-api-access-p265p\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362557 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87974fc2-6517-4e5f-8da8-e61fa1a2130d-config-out\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362575 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87974fc2-6517-4e5f-8da8-e61fa1a2130d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362597 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362641 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87974fc2-6517-4e5f-8da8-e61fa1a2130d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362660 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362693 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362676 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87974fc2-6517-4e5f-8da8-e61fa1a2130d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362729 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-config-volume\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362762 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362789 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87974fc2-6517-4e5f-8da8-e61fa1a2130d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.362899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.362831 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463313 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463293 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87974fc2-6517-4e5f-8da8-e61fa1a2130d-config-out\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463410 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463319 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87974fc2-6517-4e5f-8da8-e61fa1a2130d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463410 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463410 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463364 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87974fc2-6517-4e5f-8da8-e61fa1a2130d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463410 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463393 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463604 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463428 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87974fc2-6517-4e5f-8da8-e61fa1a2130d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463604 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463459 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-config-volume\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463604 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463481 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463626 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463687 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87974fc2-6517-4e5f-8da8-e61fa1a2130d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463735 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463740 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87974fc2-6517-4e5f-8da8-e61fa1a2130d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463946 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463767 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-web-config\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.463946 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.463800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p265p\" (UniqueName: \"kubernetes.io/projected/87974fc2-6517-4e5f-8da8-e61fa1a2130d-kube-api-access-p265p\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.464529 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.464503 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87974fc2-6517-4e5f-8da8-e61fa1a2130d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.464622 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.464568 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87974fc2-6517-4e5f-8da8-e61fa1a2130d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.466164 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.466067 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87974fc2-6517-4e5f-8da8-e61fa1a2130d-config-out\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.466364 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.466293 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.466521 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.466496 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.466937 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.466891 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87974fc2-6517-4e5f-8da8-e61fa1a2130d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.466937 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.466932 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.467086 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.466978 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-config-volume\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.467261 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.467239 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-web-config\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.467376 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.467353 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.468193 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.468173 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87974fc2-6517-4e5f-8da8-e61fa1a2130d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.472638 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.472612 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p265p\" (UniqueName: \"kubernetes.io/projected/87974fc2-6517-4e5f-8da8-e61fa1a2130d-kube-api-access-p265p\") pod \"alertmanager-main-0\" (UID: \"87974fc2-6517-4e5f-8da8-e61fa1a2130d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.609958 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.609927 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:01:35.743520 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:35.743487 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:01:35.747321 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:01:35.747293 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87974fc2_6517_4e5f_8da8_e61fa1a2130d.slice/crio-62a9c0142ac5c7b35ca66be04aab857ed6f5023a59af052626ded7eef77b6884 WatchSource:0}: Error finding container 62a9c0142ac5c7b35ca66be04aab857ed6f5023a59af052626ded7eef77b6884: Status 404 returned error can't find the container with id 62a9c0142ac5c7b35ca66be04aab857ed6f5023a59af052626ded7eef77b6884 Jul 09 14:01:36.244931 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:36.244902 2553 generic.go:356] "Generic (PLEG): container finished" podID="87974fc2-6517-4e5f-8da8-e61fa1a2130d" containerID="9c108854508b1f4e7764a82a2e19f105a292eca51aa648d8a9541f5de17dd022" exitCode=0 Jul 09 14:01:36.245280 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:36.244965 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerDied","Data":"9c108854508b1f4e7764a82a2e19f105a292eca51aa648d8a9541f5de17dd022"} Jul 09 14:01:36.245280 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:36.245016 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"62a9c0142ac5c7b35ca66be04aab857ed6f5023a59af052626ded7eef77b6884"} Jul 09 14:01:36.300076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:36.300044 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47de86dd-5f09-4d01-b2b3-b0eb6fab0d68" path="/var/lib/kubelet/pods/47de86dd-5f09-4d01-b2b3-b0eb6fab0d68/volumes" Jul 09 14:01:37.254678 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.254644 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"9c3cdf6bc25b1be6ab17444677277e8f162722b9c3e99e8d223a4424e4cc9f32"} Jul 09 14:01:37.255322 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.255301 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"2d44fe29301589fdfa42f77ded850681a8d16b67066e2081b60f091ca6837e45"} Jul 09 14:01:37.255480 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.255465 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"c5f3fe3585e9a2a09d9d289a0f04349e7aacf4881b6b3592fc59e91858d84da2"} Jul 09 14:01:37.255596 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.255582 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"4da5f3b81f1175c2d47666dcd643b1bf90b2aeb547a2ea440bd42e1fc1497a73"} Jul 09 14:01:37.255764 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.255741 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"ad19fee3ffe8eb21df6c7501e3a047c1008aad9f0e86dc49fc8252e802883cb7"} Jul 09 14:01:37.255859 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.255787 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87974fc2-6517-4e5f-8da8-e61fa1a2130d","Type":"ContainerStarted","Data":"ee4480200e27afc244f0bb6975f937c53ddfe84d6336bc6d4ebbcaf1bb654a3b"} Jul 09 14:01:37.290545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:37.290492 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.275784531 podStartE2EDuration="2.290473978s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.689447ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:01:37.289625612 +0000 UTC m=+197.503851729" watchObservedRunningTime="2026-07-09 14:01:37.290473978 +0000 UTC m=+197.504700095" Jul 09 14:01:39.476884 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:39.476850 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:39.477311 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:39.476920 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:39.482006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:39.481978 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:40.271974 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:40.271947 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:01:40.313851 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:01:40.313823 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b667df594-scc8h"] Jul 09 14:02:05.341013 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.340946 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b667df594-scc8h" podUID="14a6395a-2a95-4306-b307-1a06e78bef9f" containerName="console" containerID="cri-o://f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6" gracePeriod=15 Jul 09 14:02:05.575136 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.575094 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:02:05.691004 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.690978 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-console-config\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691032 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-serving-cert\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691070 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-oauth-serving-cert\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691092 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs4zr\" (UniqueName: \"kubernetes.io/projected/14a6395a-2a95-4306-b307-1a06e78bef9f-kube-api-access-zs4zr\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691320 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691176 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-service-ca\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691374 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691318 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-oauth-config\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691374 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691358 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-trusted-ca-bundle\") pod \"14a6395a-2a95-4306-b307-1a06e78bef9f\" (UID: \"14a6395a-2a95-4306-b307-1a06e78bef9f\") " Jul 09 14:02:05.691515 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691489 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-console-config" (OuterVolumeSpecName: "console-config") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:05.691616 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691590 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:05.691616 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691553 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:05.691824 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691683 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-console-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:05.691824 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691771 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-oauth-serving-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:05.691824 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691786 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-service-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:05.691935 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.691848 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:02:05.693284 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.693244 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:02:05.693371 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.693356 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a6395a-2a95-4306-b307-1a06e78bef9f-kube-api-access-zs4zr" (OuterVolumeSpecName: "kube-api-access-zs4zr") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "kube-api-access-zs4zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:02:05.693439 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.693416 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14a6395a-2a95-4306-b307-1a06e78bef9f" (UID: "14a6395a-2a95-4306-b307-1a06e78bef9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:02:05.792733 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.792711 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-serving-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:05.792733 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.792733 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs4zr\" (UniqueName: \"kubernetes.io/projected/14a6395a-2a95-4306-b307-1a06e78bef9f-kube-api-access-zs4zr\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:05.792858 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.792743 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a6395a-2a95-4306-b307-1a06e78bef9f-console-oauth-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:05.792858 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:05.792751 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a6395a-2a95-4306-b307-1a06e78bef9f-trusted-ca-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:06.374040 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.374006 2553 generic.go:356] "Generic (PLEG): container finished" podID="14a6395a-2a95-4306-b307-1a06e78bef9f" containerID="f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6" exitCode=0 Jul 09 14:02:06.374443 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.374046 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b667df594-scc8h" Jul 09 14:02:06.374443 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.374094 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b667df594-scc8h" event={"ID":"14a6395a-2a95-4306-b307-1a06e78bef9f","Type":"ContainerDied","Data":"f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6"} Jul 09 14:02:06.374443 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.374171 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b667df594-scc8h" event={"ID":"14a6395a-2a95-4306-b307-1a06e78bef9f","Type":"ContainerDied","Data":"b151b551437086311e10da6f0227e44486f88a3f681e264cb6bcb6a86d143cad"} Jul 09 14:02:06.374443 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.374200 2553 scope.go:117] "RemoveContainer" containerID="f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6" Jul 09 14:02:06.382139 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.382102 2553 scope.go:117] "RemoveContainer" containerID="f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6" Jul 09 14:02:06.382425 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:02:06.382403 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6\": container with ID starting with f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6 not found: ID does not exist" containerID="f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6" Jul 09 14:02:06.382482 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.382434 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6"} err="failed to get container status \"f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6\": rpc error: code = NotFound desc = could not find container \"f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6\": container with ID starting with f134bf264c664ba4e1e9e5c981caf67f01b83929c3001aee1a9ad1c66dbacad6 not found: ID does not exist" Jul 09 14:02:06.390295 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.390253 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b667df594-scc8h"] Jul 09 14:02:06.391906 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:06.391887 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b667df594-scc8h"] Jul 09 14:02:08.300615 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:08.300568 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a6395a-2a95-4306-b307-1a06e78bef9f" path="/var/lib/kubelet/pods/14a6395a-2a95-4306-b307-1a06e78bef9f/volumes" Jul 09 14:02:22.548933 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.548894 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9"] Jul 09 14:02:22.549387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.549251 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a6395a-2a95-4306-b307-1a06e78bef9f" containerName="console" Jul 09 14:02:22.549387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.549263 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a6395a-2a95-4306-b307-1a06e78bef9f" containerName="console" Jul 09 14:02:22.549387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.549337 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a6395a-2a95-4306-b307-1a06e78bef9f" containerName="console" Jul 09 14:02:22.552434 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.552415 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.555256 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.555229 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:02:22.556333 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.556312 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vm6nn\"" Jul 09 14:02:22.556452 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.556311 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:02:22.562680 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.562656 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9"] Jul 09 14:02:22.717711 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.717689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.717827 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.717744 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd4zc\" (UniqueName: \"kubernetes.io/projected/3c11b7cc-4279-4b48-871a-5630aed992d6-kube-api-access-vd4zc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.717827 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.717777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.819009 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.818941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd4zc\" (UniqueName: \"kubernetes.io/projected/3c11b7cc-4279-4b48-871a-5630aed992d6-kube-api-access-vd4zc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.819009 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.818982 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.819232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.819024 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.819484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.819461 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.819551 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.819489 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.827159 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.827137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd4zc\" (UniqueName: \"kubernetes.io/projected/3c11b7cc-4279-4b48-871a-5630aed992d6-kube-api-access-vd4zc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.864073 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.864053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:22.992433 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:22.992411 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9"] Jul 09 14:02:22.994858 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:02:22.994829 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c11b7cc_4279_4b48_871a_5630aed992d6.slice/crio-66d2c4a6034888068cf7783279c4bf5d67a936e918d60c14dbf73bc80599c2fd WatchSource:0}: Error finding container 66d2c4a6034888068cf7783279c4bf5d67a936e918d60c14dbf73bc80599c2fd: Status 404 returned error can't find the container with id 66d2c4a6034888068cf7783279c4bf5d67a936e918d60c14dbf73bc80599c2fd Jul 09 14:02:23.444942 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:23.444912 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" event={"ID":"3c11b7cc-4279-4b48-871a-5630aed992d6","Type":"ContainerStarted","Data":"66d2c4a6034888068cf7783279c4bf5d67a936e918d60c14dbf73bc80599c2fd"} Jul 09 14:02:30.475461 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:30.475425 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerID="c9d0d54c8855dc430f847ffa17bbab1f363b0189490a0a5e83238d20a07586d2" exitCode=0 Jul 09 14:02:30.475835 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:30.475513 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" event={"ID":"3c11b7cc-4279-4b48-871a-5630aed992d6","Type":"ContainerDied","Data":"c9d0d54c8855dc430f847ffa17bbab1f363b0189490a0a5e83238d20a07586d2"} Jul 09 14:02:33.491736 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:33.491697 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerID="cd82af0e786a60226194974737b0042fc92b7683365c116d93e83e1350b83b32" exitCode=0 Jul 09 14:02:33.492166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:33.491791 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" event={"ID":"3c11b7cc-4279-4b48-871a-5630aed992d6","Type":"ContainerDied","Data":"cd82af0e786a60226194974737b0042fc92b7683365c116d93e83e1350b83b32"} Jul 09 14:02:45.547211 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:45.547173 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerID="e918e1c2470e493b74e76f2b4e21999c3ad79efe8fe2a3575636e3bcae444044" exitCode=0 Jul 09 14:02:45.547736 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:45.547236 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" event={"ID":"3c11b7cc-4279-4b48-871a-5630aed992d6","Type":"ContainerDied","Data":"e918e1c2470e493b74e76f2b4e21999c3ad79efe8fe2a3575636e3bcae444044"} Jul 09 14:02:46.676543 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.676521 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:46.701065 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.701036 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd4zc\" (UniqueName: \"kubernetes.io/projected/3c11b7cc-4279-4b48-871a-5630aed992d6-kube-api-access-vd4zc\") pod \"3c11b7cc-4279-4b48-871a-5630aed992d6\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " Jul 09 14:02:46.701199 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.701164 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-bundle\") pod \"3c11b7cc-4279-4b48-871a-5630aed992d6\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " Jul 09 14:02:46.701263 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.701211 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-util\") pod \"3c11b7cc-4279-4b48-871a-5630aed992d6\" (UID: \"3c11b7cc-4279-4b48-871a-5630aed992d6\") " Jul 09 14:02:46.701923 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.701898 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-bundle" (OuterVolumeSpecName: "bundle") pod "3c11b7cc-4279-4b48-871a-5630aed992d6" (UID: "3c11b7cc-4279-4b48-871a-5630aed992d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:02:46.703214 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.703191 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c11b7cc-4279-4b48-871a-5630aed992d6-kube-api-access-vd4zc" (OuterVolumeSpecName: "kube-api-access-vd4zc") pod "3c11b7cc-4279-4b48-871a-5630aed992d6" (UID: "3c11b7cc-4279-4b48-871a-5630aed992d6"). InnerVolumeSpecName "kube-api-access-vd4zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:02:46.706684 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.706658 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-util" (OuterVolumeSpecName: "util") pod "3c11b7cc-4279-4b48-871a-5630aed992d6" (UID: "3c11b7cc-4279-4b48-871a-5630aed992d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:02:46.802130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.802063 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd4zc\" (UniqueName: \"kubernetes.io/projected/3c11b7cc-4279-4b48-871a-5630aed992d6-kube-api-access-vd4zc\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:46.802130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.802082 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:46.802130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:46.802092 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11b7cc-4279-4b48-871a-5630aed992d6-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:47.558729 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:47.558704 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" Jul 09 14:02:47.558870 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:47.558695 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndmt9" event={"ID":"3c11b7cc-4279-4b48-871a-5630aed992d6","Type":"ContainerDied","Data":"66d2c4a6034888068cf7783279c4bf5d67a936e918d60c14dbf73bc80599c2fd"} Jul 09 14:02:47.558870 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:47.558825 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66d2c4a6034888068cf7783279c4bf5d67a936e918d60c14dbf73bc80599c2fd" Jul 09 14:02:50.504588 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504561 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44"] Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504847 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="pull" Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504857 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="pull" Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504879 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="util" Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504884 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="util" Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504894 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="extract" Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504900 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="extract" Jul 09 14:02:50.504969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.504949 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c11b7cc-4279-4b48-871a-5630aed992d6" containerName="extract" Jul 09 14:02:50.507250 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.507227 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.511087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.511064 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:02:50.511202 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.511143 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 14:02:50.514831 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.514815 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b69fx\"" Jul 09 14:02:50.529045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.529019 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j52v7\" (UniqueName: \"kubernetes.io/projected/93b8a46c-fcc0-4700-ac16-dca6b0e89611-kube-api-access-j52v7\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lz44\" (UID: \"93b8a46c-fcc0-4700-ac16-dca6b0e89611\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.529198 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.529135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93b8a46c-fcc0-4700-ac16-dca6b0e89611-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lz44\" (UID: \"93b8a46c-fcc0-4700-ac16-dca6b0e89611\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.530820 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.530800 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44"] Jul 09 14:02:50.630317 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.630292 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93b8a46c-fcc0-4700-ac16-dca6b0e89611-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lz44\" (UID: \"93b8a46c-fcc0-4700-ac16-dca6b0e89611\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.630418 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.630330 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j52v7\" (UniqueName: \"kubernetes.io/projected/93b8a46c-fcc0-4700-ac16-dca6b0e89611-kube-api-access-j52v7\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lz44\" (UID: \"93b8a46c-fcc0-4700-ac16-dca6b0e89611\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.630671 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.630656 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93b8a46c-fcc0-4700-ac16-dca6b0e89611-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lz44\" (UID: \"93b8a46c-fcc0-4700-ac16-dca6b0e89611\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.638360 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.638336 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j52v7\" (UniqueName: \"kubernetes.io/projected/93b8a46c-fcc0-4700-ac16-dca6b0e89611-kube-api-access-j52v7\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lz44\" (UID: \"93b8a46c-fcc0-4700-ac16-dca6b0e89611\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.815762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.815705 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" Jul 09 14:02:50.952076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:50.952055 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44"] Jul 09 14:02:50.954371 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:02:50.954346 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b8a46c_fcc0_4700_ac16_dca6b0e89611.slice/crio-acbbb59eb7e0690c7f9566a08c96af01dfecf91763e7d4d12ceed7b1c81e0fe8 WatchSource:0}: Error finding container acbbb59eb7e0690c7f9566a08c96af01dfecf91763e7d4d12ceed7b1c81e0fe8: Status 404 returned error can't find the container with id acbbb59eb7e0690c7f9566a08c96af01dfecf91763e7d4d12ceed7b1c81e0fe8 Jul 09 14:02:51.573637 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:51.573608 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" event={"ID":"93b8a46c-fcc0-4700-ac16-dca6b0e89611","Type":"ContainerStarted","Data":"acbbb59eb7e0690c7f9566a08c96af01dfecf91763e7d4d12ceed7b1c81e0fe8"} Jul 09 14:02:53.584000 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:53.583964 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" event={"ID":"93b8a46c-fcc0-4700-ac16-dca6b0e89611","Type":"ContainerStarted","Data":"bbd06ac8510928d917d02135917024f53a65511aa9a2091214944a1e65c1a5d7"} Jul 09 14:02:53.610731 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:53.610682 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lz44" podStartSLOduration=2.00770719 podStartE2EDuration="3.610663132s" totalImagesPullingTime="1.602955942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:53.608413217 +0000 UTC m=+273.822639351" watchObservedRunningTime="2026-07-09 14:02:53.610663132 +0000 UTC m=+273.824889251" Jul 09 14:02:54.498135 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.498079 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7"] Jul 09 14:02:54.500631 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.500609 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.503587 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.503567 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:02:54.503662 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.503613 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:02:54.504746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.504728 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vm6nn\"" Jul 09 14:02:54.509889 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.509868 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7"] Jul 09 14:02:54.561718 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.561693 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.561803 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.561741 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.561803 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.561790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r4ww\" (UniqueName: \"kubernetes.io/projected/d77479c6-d960-48a8-b855-db3c8c99e578-kube-api-access-8r4ww\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.662970 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.662944 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.663261 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.662998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.663261 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.663024 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r4ww\" (UniqueName: \"kubernetes.io/projected/d77479c6-d960-48a8-b855-db3c8c99e578-kube-api-access-8r4ww\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.663398 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.663367 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.663435 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.663382 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.673456 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.673431 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r4ww\" (UniqueName: \"kubernetes.io/projected/d77479c6-d960-48a8-b855-db3c8c99e578-kube-api-access-8r4ww\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.810609 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.810558 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:54.934577 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:54.934553 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7"] Jul 09 14:02:54.937033 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:02:54.937008 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77479c6_d960_48a8_b855_db3c8c99e578.slice/crio-07f1b271bc82577e3da7520f0f7893353282975a1fbc30ae9f5238a3a68ba927 WatchSource:0}: Error finding container 07f1b271bc82577e3da7520f0f7893353282975a1fbc30ae9f5238a3a68ba927: Status 404 returned error can't find the container with id 07f1b271bc82577e3da7520f0f7893353282975a1fbc30ae9f5238a3a68ba927 Jul 09 14:02:55.164754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.164695 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pbltz"] Jul 09 14:02:55.166904 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.166881 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.169691 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.169669 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h482b\"" Jul 09 14:02:55.169691 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.169676 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:02:55.169833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.169684 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:02:55.176178 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.176158 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pbltz"] Jul 09 14:02:55.268008 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.267986 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae56c0de-c848-47ad-bfc5-effb3c44bd73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pbltz\" (UID: \"ae56c0de-c848-47ad-bfc5-effb3c44bd73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.268101 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.268021 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7j4f\" (UniqueName: \"kubernetes.io/projected/ae56c0de-c848-47ad-bfc5-effb3c44bd73-kube-api-access-r7j4f\") pod \"cert-manager-webhook-6486ffd997-pbltz\" (UID: \"ae56c0de-c848-47ad-bfc5-effb3c44bd73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.368393 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.368367 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7j4f\" (UniqueName: \"kubernetes.io/projected/ae56c0de-c848-47ad-bfc5-effb3c44bd73-kube-api-access-r7j4f\") pod \"cert-manager-webhook-6486ffd997-pbltz\" (UID: \"ae56c0de-c848-47ad-bfc5-effb3c44bd73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.368491 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.368476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae56c0de-c848-47ad-bfc5-effb3c44bd73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pbltz\" (UID: \"ae56c0de-c848-47ad-bfc5-effb3c44bd73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.376973 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.376951 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae56c0de-c848-47ad-bfc5-effb3c44bd73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pbltz\" (UID: \"ae56c0de-c848-47ad-bfc5-effb3c44bd73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.377062 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.376975 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7j4f\" (UniqueName: \"kubernetes.io/projected/ae56c0de-c848-47ad-bfc5-effb3c44bd73-kube-api-access-r7j4f\") pod \"cert-manager-webhook-6486ffd997-pbltz\" (UID: \"ae56c0de-c848-47ad-bfc5-effb3c44bd73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.492181 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.492159 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:55.600009 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.599979 2553 generic.go:356] "Generic (PLEG): container finished" podID="d77479c6-d960-48a8-b855-db3c8c99e578" containerID="2360b2710a8079404c4963a99294150988e25f8f16181e4769b4508a1faa6082" exitCode=0 Jul 09 14:02:55.600163 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.600062 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" event={"ID":"d77479c6-d960-48a8-b855-db3c8c99e578","Type":"ContainerDied","Data":"2360b2710a8079404c4963a99294150988e25f8f16181e4769b4508a1faa6082"} Jul 09 14:02:55.600163 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.600133 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" event={"ID":"d77479c6-d960-48a8-b855-db3c8c99e578","Type":"ContainerStarted","Data":"07f1b271bc82577e3da7520f0f7893353282975a1fbc30ae9f5238a3a68ba927"} Jul 09 14:02:55.623615 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:55.623498 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pbltz"] Jul 09 14:02:55.625813 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:02:55.625787 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae56c0de_c848_47ad_bfc5_effb3c44bd73.slice/crio-e30e7b16e2e4bf0f4021d695564a79816e3e9c6491208ebb79df29de75dc11fa WatchSource:0}: Error finding container e30e7b16e2e4bf0f4021d695564a79816e3e9c6491208ebb79df29de75dc11fa: Status 404 returned error can't find the container with id e30e7b16e2e4bf0f4021d695564a79816e3e9c6491208ebb79df29de75dc11fa Jul 09 14:02:56.606899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:56.606861 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" event={"ID":"ae56c0de-c848-47ad-bfc5-effb3c44bd73","Type":"ContainerStarted","Data":"e30e7b16e2e4bf0f4021d695564a79816e3e9c6491208ebb79df29de75dc11fa"} Jul 09 14:02:57.614143 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:57.614095 2553 generic.go:356] "Generic (PLEG): container finished" podID="d77479c6-d960-48a8-b855-db3c8c99e578" containerID="5d8d0f3ea92e35b262a966e49265b13d09764cef8cc44b57272974931c151754" exitCode=0 Jul 09 14:02:57.614519 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:57.614194 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" event={"ID":"d77479c6-d960-48a8-b855-db3c8c99e578","Type":"ContainerDied","Data":"5d8d0f3ea92e35b262a966e49265b13d09764cef8cc44b57272974931c151754"} Jul 09 14:02:58.622173 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:58.622133 2553 generic.go:356] "Generic (PLEG): container finished" podID="d77479c6-d960-48a8-b855-db3c8c99e578" containerID="4ea2d4ede95a003dd1d58805859582869297adadce791aedd8334283bd6653c5" exitCode=0 Jul 09 14:02:58.622558 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:58.622187 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" event={"ID":"d77479c6-d960-48a8-b855-db3c8c99e578","Type":"ContainerDied","Data":"4ea2d4ede95a003dd1d58805859582869297adadce791aedd8334283bd6653c5"} Jul 09 14:02:59.628091 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.628011 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" event={"ID":"ae56c0de-c848-47ad-bfc5-effb3c44bd73","Type":"ContainerStarted","Data":"54a3f231075a69509cc0e59e9e6fc1b23eb607bc24c722bd51611c5b80cad8b5"} Jul 09 14:02:59.628486 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.628282 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:02:59.647992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.647940 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" podStartSLOduration=0.903474877 podStartE2EDuration="4.647919664s" totalImagesPullingTime="3.744444787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:59.647072242 +0000 UTC m=+279.861298383" watchObservedRunningTime="2026-07-09 14:02:59.647919664 +0000 UTC m=+279.862145781" Jul 09 14:02:59.755669 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.755648 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:02:59.806645 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.806622 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-util\") pod \"d77479c6-d960-48a8-b855-db3c8c99e578\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " Jul 09 14:02:59.806769 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.806652 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r4ww\" (UniqueName: \"kubernetes.io/projected/d77479c6-d960-48a8-b855-db3c8c99e578-kube-api-access-8r4ww\") pod \"d77479c6-d960-48a8-b855-db3c8c99e578\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " Jul 09 14:02:59.806769 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.806670 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-bundle\") pod \"d77479c6-d960-48a8-b855-db3c8c99e578\" (UID: \"d77479c6-d960-48a8-b855-db3c8c99e578\") " Jul 09 14:02:59.807076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.807053 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-bundle" (OuterVolumeSpecName: "bundle") pod "d77479c6-d960-48a8-b855-db3c8c99e578" (UID: "d77479c6-d960-48a8-b855-db3c8c99e578"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:02:59.808628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.808603 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d77479c6-d960-48a8-b855-db3c8c99e578-kube-api-access-8r4ww" (OuterVolumeSpecName: "kube-api-access-8r4ww") pod "d77479c6-d960-48a8-b855-db3c8c99e578" (UID: "d77479c6-d960-48a8-b855-db3c8c99e578"). InnerVolumeSpecName "kube-api-access-8r4ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:02:59.812290 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.812273 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-util" (OuterVolumeSpecName: "util") pod "d77479c6-d960-48a8-b855-db3c8c99e578" (UID: "d77479c6-d960-48a8-b855-db3c8c99e578"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:02:59.908194 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.908143 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:59.908194 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.908164 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r4ww\" (UniqueName: \"kubernetes.io/projected/d77479c6-d960-48a8-b855-db3c8c99e578-kube-api-access-8r4ww\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:02:59.908194 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:02:59.908174 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d77479c6-d960-48a8-b855-db3c8c99e578-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:03:00.634661 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:00.634588 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" event={"ID":"d77479c6-d960-48a8-b855-db3c8c99e578","Type":"ContainerDied","Data":"07f1b271bc82577e3da7520f0f7893353282975a1fbc30ae9f5238a3a68ba927"} Jul 09 14:03:00.634661 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:00.634620 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd57m7" Jul 09 14:03:00.634661 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:00.634645 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07f1b271bc82577e3da7520f0f7893353282975a1fbc30ae9f5238a3a68ba927" Jul 09 14:03:05.636889 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:05.636860 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pbltz" Jul 09 14:03:06.957586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957548 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g"] Jul 09 14:03:06.957976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957892 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="util" Jul 09 14:03:06.957976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957904 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="util" Jul 09 14:03:06.957976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957912 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="extract" Jul 09 14:03:06.957976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957917 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="extract" Jul 09 14:03:06.957976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957931 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="pull" Jul 09 14:03:06.957976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957936 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="pull" Jul 09 14:03:06.958195 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.957993 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77479c6-d960-48a8-b855-db3c8c99e578" containerName="extract" Jul 09 14:03:06.960087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.960067 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:06.962762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.962741 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-29ghs\"" Jul 09 14:03:06.970535 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:06.970511 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g"] Jul 09 14:03:07.057607 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.057587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnhx7\" (UniqueName: \"kubernetes.io/projected/ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e-kube-api-access-gnhx7\") pod \"cert-manager-cainjector-559cdd8c87-xjv9g\" (UID: \"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.057714 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.057633 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xjv9g\" (UID: \"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.158221 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.158191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnhx7\" (UniqueName: \"kubernetes.io/projected/ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e-kube-api-access-gnhx7\") pod \"cert-manager-cainjector-559cdd8c87-xjv9g\" (UID: \"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.158310 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.158251 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xjv9g\" (UID: \"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.167035 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.167007 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xjv9g\" (UID: \"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.167539 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.167516 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnhx7\" (UniqueName: \"kubernetes.io/projected/ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e-kube-api-access-gnhx7\") pod \"cert-manager-cainjector-559cdd8c87-xjv9g\" (UID: \"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.269883 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.269827 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" Jul 09 14:03:07.398270 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.398245 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g"] Jul 09 14:03:07.399903 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:03:07.399876 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddfaae8b_f90e_4b0c_a2dd_ed46d4942f0e.slice/crio-c69317f0e05542706ae4faa501f13b1c243670404ea544fcef461b83e35ce9ef WatchSource:0}: Error finding container c69317f0e05542706ae4faa501f13b1c243670404ea544fcef461b83e35ce9ef: Status 404 returned error can't find the container with id c69317f0e05542706ae4faa501f13b1c243670404ea544fcef461b83e35ce9ef Jul 09 14:03:07.671311 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.671274 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" event={"ID":"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e","Type":"ContainerStarted","Data":"ca86c9c6416fc797169beef19cabf94822ebbf4a636657071a0e10827db201e8"} Jul 09 14:03:07.671552 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.671326 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" event={"ID":"ddfaae8b-f90e-4b0c-a2dd-ed46d4942f0e","Type":"ContainerStarted","Data":"c69317f0e05542706ae4faa501f13b1c243670404ea544fcef461b83e35ce9ef"} Jul 09 14:03:07.687614 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:07.687568 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xjv9g" podStartSLOduration=1.687553282 podStartE2EDuration="1.687553282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:07.685597273 +0000 UTC m=+287.899823406" watchObservedRunningTime="2026-07-09 14:03:07.687553282 +0000 UTC m=+287.901779397" Jul 09 14:03:16.861379 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:16.861343 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq"] Jul 09 14:03:16.884902 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:16.884875 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq"] Jul 09 14:03:16.885058 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:16.884986 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:16.888068 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:16.888043 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:03:16.888217 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:16.888100 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:03:16.889182 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:16.889163 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vm6nn\"" Jul 09 14:03:17.034348 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.034323 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.034455 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.034394 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6bs\" (UniqueName: \"kubernetes.io/projected/282efae8-00f5-44cc-a66d-0d1e322785f8-kube-api-access-8t6bs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.034455 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.034413 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.134976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.134920 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6bs\" (UniqueName: \"kubernetes.io/projected/282efae8-00f5-44cc-a66d-0d1e322785f8-kube-api-access-8t6bs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.134976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.134952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.134976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.134975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.135426 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.135407 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.135426 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.135419 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.156403 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.156372 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6bs\" (UniqueName: \"kubernetes.io/projected/282efae8-00f5-44cc-a66d-0d1e322785f8-kube-api-access-8t6bs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.195073 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.195049 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:17.339807 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.339783 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq"] Jul 09 14:03:17.341563 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:03:17.341535 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282efae8_00f5_44cc_a66d_0d1e322785f8.slice/crio-fe94c6c270dc824bc120eaa15bd906434d09c080c8730bed8927fb38ee1ad660 WatchSource:0}: Error finding container fe94c6c270dc824bc120eaa15bd906434d09c080c8730bed8927fb38ee1ad660: Status 404 returned error can't find the container with id fe94c6c270dc824bc120eaa15bd906434d09c080c8730bed8927fb38ee1ad660 Jul 09 14:03:17.719053 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.719017 2553 generic.go:356] "Generic (PLEG): container finished" podID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerID="dec32e1947bd46686419f0e8a5fba07c0453dfe2e0281c8fc93afbf32c4d12aa" exitCode=0 Jul 09 14:03:17.719184 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.719078 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" event={"ID":"282efae8-00f5-44cc-a66d-0d1e322785f8","Type":"ContainerDied","Data":"dec32e1947bd46686419f0e8a5fba07c0453dfe2e0281c8fc93afbf32c4d12aa"} Jul 09 14:03:17.719184 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:17.719146 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" event={"ID":"282efae8-00f5-44cc-a66d-0d1e322785f8","Type":"ContainerStarted","Data":"fe94c6c270dc824bc120eaa15bd906434d09c080c8730bed8927fb38ee1ad660"} Jul 09 14:03:19.729361 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:19.729328 2553 generic.go:356] "Generic (PLEG): container finished" podID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerID="319182d46f73f6bb3b65894df3b8c6ec0d500a8625bca8a59eecd1589f44ee4d" exitCode=0 Jul 09 14:03:19.729723 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:19.729418 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" event={"ID":"282efae8-00f5-44cc-a66d-0d1e322785f8","Type":"ContainerDied","Data":"319182d46f73f6bb3b65894df3b8c6ec0d500a8625bca8a59eecd1589f44ee4d"} Jul 09 14:03:20.161862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:20.161795 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:03:20.172791 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:20.172769 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:03:20.176674 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:20.176658 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:03:20.736267 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:20.736235 2553 generic.go:356] "Generic (PLEG): container finished" podID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerID="e9b344280d1b6d4e143e599a81f9cd9c80671e8a25886a92bdf008ad1bed61bb" exitCode=0 Jul 09 14:03:20.737682 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:20.736321 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" event={"ID":"282efae8-00f5-44cc-a66d-0d1e322785f8","Type":"ContainerDied","Data":"e9b344280d1b6d4e143e599a81f9cd9c80671e8a25886a92bdf008ad1bed61bb"} Jul 09 14:03:21.868167 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.868143 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:21.972225 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.972202 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t6bs\" (UniqueName: \"kubernetes.io/projected/282efae8-00f5-44cc-a66d-0d1e322785f8-kube-api-access-8t6bs\") pod \"282efae8-00f5-44cc-a66d-0d1e322785f8\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " Jul 09 14:03:21.972379 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.972247 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-util\") pod \"282efae8-00f5-44cc-a66d-0d1e322785f8\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " Jul 09 14:03:21.972379 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.972286 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-bundle\") pod \"282efae8-00f5-44cc-a66d-0d1e322785f8\" (UID: \"282efae8-00f5-44cc-a66d-0d1e322785f8\") " Jul 09 14:03:21.973031 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.973010 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-bundle" (OuterVolumeSpecName: "bundle") pod "282efae8-00f5-44cc-a66d-0d1e322785f8" (UID: "282efae8-00f5-44cc-a66d-0d1e322785f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:03:21.974204 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.974179 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/282efae8-00f5-44cc-a66d-0d1e322785f8-kube-api-access-8t6bs" (OuterVolumeSpecName: "kube-api-access-8t6bs") pod "282efae8-00f5-44cc-a66d-0d1e322785f8" (UID: "282efae8-00f5-44cc-a66d-0d1e322785f8"). InnerVolumeSpecName "kube-api-access-8t6bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:03:21.977846 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:21.977818 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-util" (OuterVolumeSpecName: "util") pod "282efae8-00f5-44cc-a66d-0d1e322785f8" (UID: "282efae8-00f5-44cc-a66d-0d1e322785f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:03:22.073246 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:22.073185 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:03:22.073246 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:22.073213 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282efae8-00f5-44cc-a66d-0d1e322785f8-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:03:22.073246 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:22.073223 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t6bs\" (UniqueName: \"kubernetes.io/projected/282efae8-00f5-44cc-a66d-0d1e322785f8-kube-api-access-8t6bs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:03:22.747925 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:22.747898 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" Jul 09 14:03:22.748085 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:22.747897 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgzspq" event={"ID":"282efae8-00f5-44cc-a66d-0d1e322785f8","Type":"ContainerDied","Data":"fe94c6c270dc824bc120eaa15bd906434d09c080c8730bed8927fb38ee1ad660"} Jul 09 14:03:22.748085 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:22.748018 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe94c6c270dc824bc120eaa15bd906434d09c080c8730bed8927fb38ee1ad660" Jul 09 14:03:29.251516 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.251474 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj"] Jul 09 14:03:29.251996 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.251974 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="util" Jul 09 14:03:29.252080 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.252000 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="util" Jul 09 14:03:29.252080 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.252022 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="extract" Jul 09 14:03:29.252080 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.252032 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="extract" Jul 09 14:03:29.252080 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.252049 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="pull" Jul 09 14:03:29.252080 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.252058 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="pull" Jul 09 14:03:29.252343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.252201 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="282efae8-00f5-44cc-a66d-0d1e322785f8" containerName="extract" Jul 09 14:03:29.254939 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.254916 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.258719 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.258677 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:03:29.258822 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.258805 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 14:03:29.258885 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.258822 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cvjsw\"" Jul 09 14:03:29.258944 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.258880 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 14:03:29.258999 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.258943 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 14:03:29.258999 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.258824 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 14:03:29.264618 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.264599 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj"] Jul 09 14:03:29.424997 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.424972 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9d3e484-9744-487d-8acb-5054f401db48-metrics-cert\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.425150 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.425004 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fclbg\" (UniqueName: \"kubernetes.io/projected/a9d3e484-9744-487d-8acb-5054f401db48-kube-api-access-fclbg\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.425150 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.425084 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9d3e484-9744-487d-8acb-5054f401db48-manager-config\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.425277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.425230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d3e484-9744-487d-8acb-5054f401db48-cert\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.525950 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.525883 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d3e484-9744-487d-8acb-5054f401db48-cert\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.525950 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.525924 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9d3e484-9744-487d-8acb-5054f401db48-metrics-cert\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.525950 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.525942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fclbg\" (UniqueName: \"kubernetes.io/projected/a9d3e484-9744-487d-8acb-5054f401db48-kube-api-access-fclbg\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.526194 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.525994 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9d3e484-9744-487d-8acb-5054f401db48-manager-config\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.526696 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.526672 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9d3e484-9744-487d-8acb-5054f401db48-manager-config\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.528480 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.528458 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9d3e484-9744-487d-8acb-5054f401db48-metrics-cert\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.528566 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.528506 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d3e484-9744-487d-8acb-5054f401db48-cert\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.537870 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.537846 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fclbg\" (UniqueName: \"kubernetes.io/projected/a9d3e484-9744-487d-8acb-5054f401db48-kube-api-access-fclbg\") pod \"lws-controller-manager-86df669b44-kt9wj\" (UID: \"a9d3e484-9744-487d-8acb-5054f401db48\") " pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.564986 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.564966 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:29.695667 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.695644 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj"] Jul 09 14:03:29.697201 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:03:29.697175 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d3e484_9744_487d_8acb_5054f401db48.slice/crio-ed9e6987e5f3e7adcb5aee13272ec32743e7cf12da6c28d28515a7bb393b427e WatchSource:0}: Error finding container ed9e6987e5f3e7adcb5aee13272ec32743e7cf12da6c28d28515a7bb393b427e: Status 404 returned error can't find the container with id ed9e6987e5f3e7adcb5aee13272ec32743e7cf12da6c28d28515a7bb393b427e Jul 09 14:03:29.699008 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.698994 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:03:29.788911 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:29.788849 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" event={"ID":"a9d3e484-9744-487d-8acb-5054f401db48","Type":"ContainerStarted","Data":"ed9e6987e5f3e7adcb5aee13272ec32743e7cf12da6c28d28515a7bb393b427e"} Jul 09 14:03:31.799168 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:31.799126 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" event={"ID":"a9d3e484-9744-487d-8acb-5054f401db48","Type":"ContainerStarted","Data":"649c7161cb9c61a4e71de767ae3b1d41d9a0bad2f8f15d7195997a836f8a92cc"} Jul 09 14:03:31.799599 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:31.799277 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:31.823714 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:31.823670 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" podStartSLOduration=0.911353982 podStartE2EDuration="2.823655955s" totalImagesPullingTime="1.912301973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:31.821237524 +0000 UTC m=+312.035463652" watchObservedRunningTime="2026-07-09 14:03:31.823655955 +0000 UTC m=+312.037882071" Jul 09 14:03:34.233620 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.233579 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg"] Jul 09 14:03:34.236128 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.236092 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.239534 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.239504 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:03:34.239730 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.239709 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:03:34.239854 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.239765 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:03:34.239854 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.239774 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-shds6\"" Jul 09 14:03:34.239854 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.239846 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:03:34.260255 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.260235 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg"] Jul 09 14:03:34.364834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.364812 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-manifests\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.364928 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.364846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf22z\" (UniqueName: \"kubernetes.io/projected/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-kube-api-access-tf22z\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.364928 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.364878 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-tmp\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.365004 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.364940 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.365004 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.364977 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-webhook-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.466034 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.466013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-tmp\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.466138 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.466046 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.466138 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.466065 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-webhook-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.466264 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.466145 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-manifests\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.466264 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.466192 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf22z\" (UniqueName: \"kubernetes.io/projected/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-kube-api-access-tf22z\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.466512 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.466490 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-manifests\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.468344 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.468317 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-tmp\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.468561 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.468543 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.468625 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.468568 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-webhook-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.473764 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.473744 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf22z\" (UniqueName: \"kubernetes.io/projected/2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f-kube-api-access-tf22z\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-zmssg\" (UID: \"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.546333 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.546285 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:34.695118 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.695082 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg"] Jul 09 14:03:34.697460 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:03:34.697429 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca2ead9_2c3c_44a6_98a2_7acdf1d6f71f.slice/crio-36b80160fe30607c41217b22573f53dd050eed751aed152ab55da53f0aac2cb8 WatchSource:0}: Error finding container 36b80160fe30607c41217b22573f53dd050eed751aed152ab55da53f0aac2cb8: Status 404 returned error can't find the container with id 36b80160fe30607c41217b22573f53dd050eed751aed152ab55da53f0aac2cb8 Jul 09 14:03:34.815209 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:34.815144 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" event={"ID":"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f","Type":"ContainerStarted","Data":"36b80160fe30607c41217b22573f53dd050eed751aed152ab55da53f0aac2cb8"} Jul 09 14:03:37.833332 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:37.833301 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" event={"ID":"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f","Type":"ContainerStarted","Data":"4a90577e7b5a3f90c620f55cd1872b4a10c8e3983bbcabbab654e4e1fa4c8f43"} Jul 09 14:03:38.839744 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:38.839717 2553 generic.go:356] "Generic (PLEG): container finished" podID="2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f" containerID="4a90577e7b5a3f90c620f55cd1872b4a10c8e3983bbcabbab654e4e1fa4c8f43" exitCode=0 Jul 09 14:03:38.840099 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:38.839809 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" event={"ID":"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f","Type":"ContainerDied","Data":"4a90577e7b5a3f90c620f55cd1872b4a10c8e3983bbcabbab654e4e1fa4c8f43"} Jul 09 14:03:41.855799 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:41.855711 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" event={"ID":"2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f","Type":"ContainerStarted","Data":"b2ec06295a2e7dd3db08ea14b550ab36e6444d50e3d165fe972cf999f14ea101"} Jul 09 14:03:41.856190 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:41.855918 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:03:41.882056 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:41.881982 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" podStartSLOduration=1.130876807 podStartE2EDuration="7.881969185s" totalImagesPullingTime="5.683064557s" totalInitContainerRuntime="1.068027821s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:41.879569216 +0000 UTC m=+322.093795352" watchObservedRunningTime="2026-07-09 14:03:41.881969185 +0000 UTC m=+322.096195399" Jul 09 14:03:42.806545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:42.806517 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86df669b44-kt9wj" Jul 09 14:03:52.863584 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:03:52.863552 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-zmssg" Jul 09 14:04:06.185071 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.185039 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4"] Jul 09 14:04:06.193055 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.193035 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.195829 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.195799 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:04:06.195829 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.195816 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mq7qc\"" Jul 09 14:04:06.201981 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.201956 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202092 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202008 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202092 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202034 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202235 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202144 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202235 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202184 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202379 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202379 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202367 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202577 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202556 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.202832 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.202804 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4j9d\" (UniqueName: \"kubernetes.io/projected/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-kube-api-access-k4j9d\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.205218 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.205199 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4"] Jul 09 14:04:06.303214 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303243 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303267 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4j9d\" (UniqueName: \"kubernetes.io/projected/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-kube-api-access-k4j9d\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303289 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303348 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303374 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303426 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303457 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303691 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303549 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303691 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303620 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303691 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303675 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.303956 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303930 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.304032 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.303959 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.304381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.304361 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.305928 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.305902 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.306270 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.306249 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.311372 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.311354 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4j9d\" (UniqueName: \"kubernetes.io/projected/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-kube-api-access-k4j9d\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.311462 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.311387 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86075e0-aa2f-4ec4-84ab-8b4678156b7a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qq5g4\" (UID: \"c86075e0-aa2f-4ec4-84ab-8b4678156b7a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.504310 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.504258 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:06.646581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.646557 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4"] Jul 09 14:04:06.648633 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:04:06.648601 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86075e0_aa2f_4ec4_84ab_8b4678156b7a.slice/crio-001720455e58cdb32c8a54427089eb2d474e3994e8c0c7ef1ff5d1f4be912c21 WatchSource:0}: Error finding container 001720455e58cdb32c8a54427089eb2d474e3994e8c0c7ef1ff5d1f4be912c21: Status 404 returned error can't find the container with id 001720455e58cdb32c8a54427089eb2d474e3994e8c0c7ef1ff5d1f4be912c21 Jul 09 14:04:06.649967 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.649945 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz"] Jul 09 14:04:06.654837 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.654816 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.657467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.657449 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:04:06.657467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.657452 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:04:06.657765 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.657721 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cstvf\"" Jul 09 14:04:06.657874 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.657861 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:04:06.664346 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.664323 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz"] Jul 09 14:04:06.705959 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.705930 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.706051 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.705984 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/572489cc-7bb4-4040-b657-06616906727f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.706102 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.706066 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/572489cc-7bb4-4040-b657-06616906727f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.706102 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.706093 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572489cc-7bb4-4040-b657-06616906727f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.706217 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.706127 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.706217 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.706145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.706217 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.706185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvd5\" (UniqueName: \"kubernetes.io/projected/572489cc-7bb4-4040-b657-06616906727f-kube-api-access-khvd5\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807227 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807164 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/572489cc-7bb4-4040-b657-06616906727f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807227 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807197 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/572489cc-7bb4-4040-b657-06616906727f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807227 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807217 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572489cc-7bb4-4040-b657-06616906727f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807328 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807365 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807396 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvd5\" (UniqueName: \"kubernetes.io/projected/572489cc-7bb4-4040-b657-06616906727f-kube-api-access-khvd5\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807613 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807485 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.807872 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.807849 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/572489cc-7bb4-4040-b657-06616906727f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.809650 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.809623 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.809720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.809690 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.809836 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.809819 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/572489cc-7bb4-4040-b657-06616906727f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.809873 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.809854 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/572489cc-7bb4-4040-b657-06616906727f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.815990 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.815966 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvd5\" (UniqueName: \"kubernetes.io/projected/572489cc-7bb4-4040-b657-06616906727f-kube-api-access-khvd5\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.816339 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.816321 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572489cc-7bb4-4040-b657-06616906727f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nxdfz\" (UID: \"572489cc-7bb4-4040-b657-06616906727f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.966102 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.966072 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:06.983815 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:06.983784 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" event={"ID":"c86075e0-aa2f-4ec4-84ab-8b4678156b7a","Type":"ContainerStarted","Data":"001720455e58cdb32c8a54427089eb2d474e3994e8c0c7ef1ff5d1f4be912c21"} Jul 09 14:04:07.133608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:07.133579 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz"] Jul 09 14:04:07.136439 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:04:07.136388 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572489cc_7bb4_4040_b657_06616906727f.slice/crio-5b58519fdf381e0171eb02e66b951c9847e099ec69940bb5de2c46541880f8c5 WatchSource:0}: Error finding container 5b58519fdf381e0171eb02e66b951c9847e099ec69940bb5de2c46541880f8c5: Status 404 returned error can't find the container with id 5b58519fdf381e0171eb02e66b951c9847e099ec69940bb5de2c46541880f8c5 Jul 09 14:04:07.990181 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:07.990145 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" event={"ID":"572489cc-7bb4-4040-b657-06616906727f","Type":"ContainerStarted","Data":"5b58519fdf381e0171eb02e66b951c9847e099ec69940bb5de2c46541880f8c5"} Jul 09 14:04:09.561494 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:09.561456 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:04:09.561780 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:09.561524 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:04:09.561780 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:09.561552 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:04:10.002720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:10.002685 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" event={"ID":"c86075e0-aa2f-4ec4-84ab-8b4678156b7a","Type":"ContainerStarted","Data":"c603f3f4c0619af67839b933c9edeb3e6664db453c74d0c7b8627acea9afb8d7"} Jul 09 14:04:10.044392 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:10.044335 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" podStartSLOduration=1.133756051 podStartE2EDuration="4.04431964s" totalImagesPullingTime="2.910563589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:10.043324945 +0000 UTC m=+350.257551062" watchObservedRunningTime="2026-07-09 14:04:10.04431964 +0000 UTC m=+350.258545755" Jul 09 14:04:10.504758 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:10.504725 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:10.509730 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:10.509703 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:11.009141 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:11.009088 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:11.010342 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:11.010317 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qq5g4" Jul 09 14:04:11.575924 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:11.575891 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:04:11.576064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:11.575952 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:04:12.015738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:12.015704 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" event={"ID":"572489cc-7bb4-4040-b657-06616906727f","Type":"ContainerStarted","Data":"d5b47491cb76a7e56a4e509cfb40e9b06b51299d5704ae6855cd9a3f0585c5ee"} Jul 09 14:04:12.016199 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:12.016127 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:04:12.017537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:12.017510 2553 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nxdfz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 14:04:12.017655 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:12.017556 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" podUID="572489cc-7bb4-4040-b657-06616906727f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:04:12.043938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:12.043879 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" podStartSLOduration=1.6075719720000001 podStartE2EDuration="6.043861366s" totalImagesPullingTime="4.436289394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:12.041686919 +0000 UTC m=+352.255913084" watchObservedRunningTime="2026-07-09 14:04:12.043861366 +0000 UTC m=+352.258087484" Jul 09 14:04:13.022813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:04:13.022776 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nxdfz" Jul 09 14:05:14.613503 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.613467 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn"] Jul 09 14:05:14.616244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.616224 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.618805 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.618784 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:05:14.619958 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.619942 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:05:14.620021 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.619961 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ddbx2\"" Jul 09 14:05:14.625402 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.625370 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn"] Jul 09 14:05:14.730221 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.730192 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5cmg\" (UniqueName: \"kubernetes.io/projected/c7df4f2b-8066-44c1-bc83-d78c7009659f-kube-api-access-p5cmg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.730336 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.730239 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.730336 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.730259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.831399 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.831372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5cmg\" (UniqueName: \"kubernetes.io/projected/c7df4f2b-8066-44c1-bc83-d78c7009659f-kube-api-access-p5cmg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.831512 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.831415 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.831512 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.831439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.831763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.831746 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.831798 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.831783 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.840837 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.840819 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5cmg\" (UniqueName: \"kubernetes.io/projected/c7df4f2b-8066-44c1-bc83-d78c7009659f-kube-api-access-p5cmg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:14.927799 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:14.927780 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:15.053892 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.053870 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn"] Jul 09 14:05:15.055729 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:05:15.055706 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7df4f2b_8066_44c1_bc83_d78c7009659f.slice/crio-b0f228d5d980a3e177440733ab6754d0a063b129d4671a17cb9b1d17448f93ff WatchSource:0}: Error finding container b0f228d5d980a3e177440733ab6754d0a063b129d4671a17cb9b1d17448f93ff: Status 404 returned error can't find the container with id b0f228d5d980a3e177440733ab6754d0a063b129d4671a17cb9b1d17448f93ff Jul 09 14:05:15.334017 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.333946 2553 generic.go:356] "Generic (PLEG): container finished" podID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerID="1c0f6f402bfa591b0dd138e026e09ce67f3e234c03b6f30ed85c21e6249eba78" exitCode=0 Jul 09 14:05:15.334017 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.333992 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" event={"ID":"c7df4f2b-8066-44c1-bc83-d78c7009659f","Type":"ContainerDied","Data":"1c0f6f402bfa591b0dd138e026e09ce67f3e234c03b6f30ed85c21e6249eba78"} Jul 09 14:05:15.334193 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.334035 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" event={"ID":"c7df4f2b-8066-44c1-bc83-d78c7009659f","Type":"ContainerStarted","Data":"b0f228d5d980a3e177440733ab6754d0a063b129d4671a17cb9b1d17448f93ff"} Jul 09 14:05:15.415765 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.415736 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m"] Jul 09 14:05:15.418292 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.418277 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.429400 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.429379 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m"] Jul 09 14:05:15.538717 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.538687 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n5dh\" (UniqueName: \"kubernetes.io/projected/11e50e1f-bfb7-4a04-8a70-659115adea4e-kube-api-access-4n5dh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.538828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.538729 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.538828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.538764 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.640223 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.640165 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n5dh\" (UniqueName: \"kubernetes.io/projected/11e50e1f-bfb7-4a04-8a70-659115adea4e-kube-api-access-4n5dh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.640223 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.640196 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.640223 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.640216 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.640634 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.640613 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.640672 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.640613 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.648820 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.648792 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n5dh\" (UniqueName: \"kubernetes.io/projected/11e50e1f-bfb7-4a04-8a70-659115adea4e-kube-api-access-4n5dh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.727487 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.727464 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:15.858468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:15.858342 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m"] Jul 09 14:05:15.861055 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:05:15.861026 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e50e1f_bfb7_4a04_8a70_659115adea4e.slice/crio-f6018e2978ed15a8520fe4dbcfeecf1402fa6ff799959520907087a3b209af75 WatchSource:0}: Error finding container f6018e2978ed15a8520fe4dbcfeecf1402fa6ff799959520907087a3b209af75: Status 404 returned error can't find the container with id f6018e2978ed15a8520fe4dbcfeecf1402fa6ff799959520907087a3b209af75 Jul 09 14:05:16.014265 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.014241 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf"] Jul 09 14:05:16.016794 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.016780 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.025686 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.025666 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf"] Jul 09 14:05:16.144316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.144261 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.144316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.144292 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.144445 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.144390 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdw5m\" (UniqueName: \"kubernetes.io/projected/bad7a7da-31ce-474f-8683-5a849d52ff91-kube-api-access-vdw5m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.245189 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.245162 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdw5m\" (UniqueName: \"kubernetes.io/projected/bad7a7da-31ce-474f-8683-5a849d52ff91-kube-api-access-vdw5m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.245277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.245213 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.245277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.245244 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.245630 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.245607 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.245630 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.245621 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.253976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.253947 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdw5m\" (UniqueName: \"kubernetes.io/projected/bad7a7da-31ce-474f-8683-5a849d52ff91-kube-api-access-vdw5m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.326961 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.326935 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:16.340914 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.340886 2553 generic.go:356] "Generic (PLEG): container finished" podID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerID="6a078550ba5cc4a3533dbd5b0213ab654dc83ab82b248ee4efa42282fec741ac" exitCode=0 Jul 09 14:05:16.341011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.340946 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" event={"ID":"11e50e1f-bfb7-4a04-8a70-659115adea4e","Type":"ContainerDied","Data":"6a078550ba5cc4a3533dbd5b0213ab654dc83ab82b248ee4efa42282fec741ac"} Jul 09 14:05:16.341011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.340992 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" event={"ID":"11e50e1f-bfb7-4a04-8a70-659115adea4e","Type":"ContainerStarted","Data":"f6018e2978ed15a8520fe4dbcfeecf1402fa6ff799959520907087a3b209af75"} Jul 09 14:05:16.412310 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.412217 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb"] Jul 09 14:05:16.418600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.418577 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.425564 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.425537 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb"] Jul 09 14:05:16.462856 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.462835 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf"] Jul 09 14:05:16.463552 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:05:16.463530 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad7a7da_31ce_474f_8683_5a849d52ff91.slice/crio-dc20e7627fca28baf603cbf47308a10480743b62e56a0a2d76beb9400df27be0 WatchSource:0}: Error finding container dc20e7627fca28baf603cbf47308a10480743b62e56a0a2d76beb9400df27be0: Status 404 returned error can't find the container with id dc20e7627fca28baf603cbf47308a10480743b62e56a0a2d76beb9400df27be0 Jul 09 14:05:16.547010 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.546976 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.547153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.547016 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.547153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.547121 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgw2\" (UniqueName: \"kubernetes.io/projected/d0b9e1a0-677b-4926-b091-d0548a191fdc-kube-api-access-dcgw2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.648441 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.648414 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.648720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.648446 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.648720 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.648486 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgw2\" (UniqueName: \"kubernetes.io/projected/d0b9e1a0-677b-4926-b091-d0548a191fdc-kube-api-access-dcgw2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.648792 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.648735 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.648826 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.648781 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.656752 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.656726 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgw2\" (UniqueName: \"kubernetes.io/projected/d0b9e1a0-677b-4926-b091-d0548a191fdc-kube-api-access-dcgw2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.730732 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.730700 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:16.854576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:16.854551 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb"] Jul 09 14:05:16.856023 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:05:16.855994 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b9e1a0_677b_4926_b091_d0548a191fdc.slice/crio-a2ec8e7073479e5bc0569884277cc55f35aac3facaee9c993e90b018b00a56b5 WatchSource:0}: Error finding container a2ec8e7073479e5bc0569884277cc55f35aac3facaee9c993e90b018b00a56b5: Status 404 returned error can't find the container with id a2ec8e7073479e5bc0569884277cc55f35aac3facaee9c993e90b018b00a56b5 Jul 09 14:05:17.347727 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:17.347703 2553 generic.go:356] "Generic (PLEG): container finished" podID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerID="0afcbf06553c7ed9b5e1625e1716dbb2686301b0db02a878cb3f261307e7ddf1" exitCode=0 Jul 09 14:05:17.347815 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:17.347777 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" event={"ID":"bad7a7da-31ce-474f-8683-5a849d52ff91","Type":"ContainerDied","Data":"0afcbf06553c7ed9b5e1625e1716dbb2686301b0db02a878cb3f261307e7ddf1"} Jul 09 14:05:17.347857 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:17.347821 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" event={"ID":"bad7a7da-31ce-474f-8683-5a849d52ff91","Type":"ContainerStarted","Data":"dc20e7627fca28baf603cbf47308a10480743b62e56a0a2d76beb9400df27be0"} Jul 09 14:05:17.349352 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:17.349333 2553 generic.go:356] "Generic (PLEG): container finished" podID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerID="90375bf74bf37c0d4e33d357256224673fbf0b9557cc602e005aa54e15487af8" exitCode=0 Jul 09 14:05:17.349450 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:17.349359 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" event={"ID":"d0b9e1a0-677b-4926-b091-d0548a191fdc","Type":"ContainerDied","Data":"90375bf74bf37c0d4e33d357256224673fbf0b9557cc602e005aa54e15487af8"} Jul 09 14:05:17.349450 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:17.349390 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" event={"ID":"d0b9e1a0-677b-4926-b091-d0548a191fdc","Type":"ContainerStarted","Data":"a2ec8e7073479e5bc0569884277cc55f35aac3facaee9c993e90b018b00a56b5"} Jul 09 14:05:18.356278 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:18.356244 2553 generic.go:356] "Generic (PLEG): container finished" podID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerID="fd040e1fb4486f65355909bc93c15fc9dc4ddd4655932217023ce177576ac531" exitCode=0 Jul 09 14:05:18.356668 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:18.356314 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" event={"ID":"11e50e1f-bfb7-4a04-8a70-659115adea4e","Type":"ContainerDied","Data":"fd040e1fb4486f65355909bc93c15fc9dc4ddd4655932217023ce177576ac531"} Jul 09 14:05:18.358216 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:18.358197 2553 generic.go:356] "Generic (PLEG): container finished" podID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerID="85e9a0b61ec6ac20beebbbcc4fad5b8c2ba7551ed54f646c82c845cab88494f5" exitCode=0 Jul 09 14:05:18.358292 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:18.358249 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" event={"ID":"c7df4f2b-8066-44c1-bc83-d78c7009659f","Type":"ContainerDied","Data":"85e9a0b61ec6ac20beebbbcc4fad5b8c2ba7551ed54f646c82c845cab88494f5"} Jul 09 14:05:19.365687 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.365651 2553 generic.go:356] "Generic (PLEG): container finished" podID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerID="dcf6db0a93c25ab956c536831712436bc09ef4ec86dd24d1c9faf9597913b919" exitCode=0 Jul 09 14:05:19.366066 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.365749 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" event={"ID":"d0b9e1a0-677b-4926-b091-d0548a191fdc","Type":"ContainerDied","Data":"dcf6db0a93c25ab956c536831712436bc09ef4ec86dd24d1c9faf9597913b919"} Jul 09 14:05:19.368384 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.368354 2553 generic.go:356] "Generic (PLEG): container finished" podID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerID="c05cf642fe0b68f80aaffad683a778a6520b522e937379af71a72127912f3e5e" exitCode=0 Jul 09 14:05:19.368481 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.368442 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" event={"ID":"c7df4f2b-8066-44c1-bc83-d78c7009659f","Type":"ContainerDied","Data":"c05cf642fe0b68f80aaffad683a778a6520b522e937379af71a72127912f3e5e"} Jul 09 14:05:19.370466 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.370442 2553 generic.go:356] "Generic (PLEG): container finished" podID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerID="1ce5ccfdfb7c9a4770b39993e7c17fba960ab65a676beb59d899bcd49aa2658a" exitCode=0 Jul 09 14:05:19.370575 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.370531 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" event={"ID":"bad7a7da-31ce-474f-8683-5a849d52ff91","Type":"ContainerDied","Data":"1ce5ccfdfb7c9a4770b39993e7c17fba960ab65a676beb59d899bcd49aa2658a"} Jul 09 14:05:19.373179 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.373157 2553 generic.go:356] "Generic (PLEG): container finished" podID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerID="3d273982daee8a91428d33fa7bb8d80dc38ea2bc51d5d04328b8e8833bcd1f52" exitCode=0 Jul 09 14:05:19.373291 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:19.373192 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" event={"ID":"11e50e1f-bfb7-4a04-8a70-659115adea4e","Type":"ContainerDied","Data":"3d273982daee8a91428d33fa7bb8d80dc38ea2bc51d5d04328b8e8833bcd1f52"} Jul 09 14:05:20.380209 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.380174 2553 generic.go:356] "Generic (PLEG): container finished" podID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerID="bc5cbd11f4eae77473da4dee7592ccdd5007c5e488a2b4b5ca7a4e44122010ee" exitCode=0 Jul 09 14:05:20.380670 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.380236 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" event={"ID":"bad7a7da-31ce-474f-8683-5a849d52ff91","Type":"ContainerDied","Data":"bc5cbd11f4eae77473da4dee7592ccdd5007c5e488a2b4b5ca7a4e44122010ee"} Jul 09 14:05:20.382237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.382214 2553 generic.go:356] "Generic (PLEG): container finished" podID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerID="c61c76f358bf79b1b1626c3d63702925b729797500a4652725bd88de73827b92" exitCode=0 Jul 09 14:05:20.382347 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.382237 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" event={"ID":"d0b9e1a0-677b-4926-b091-d0548a191fdc","Type":"ContainerDied","Data":"c61c76f358bf79b1b1626c3d63702925b729797500a4652725bd88de73827b92"} Jul 09 14:05:20.541170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.541149 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:20.558385 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.558364 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:20.685814 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.685788 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n5dh\" (UniqueName: \"kubernetes.io/projected/11e50e1f-bfb7-4a04-8a70-659115adea4e-kube-api-access-4n5dh\") pod \"11e50e1f-bfb7-4a04-8a70-659115adea4e\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " Jul 09 14:05:20.685960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.685841 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-util\") pod \"11e50e1f-bfb7-4a04-8a70-659115adea4e\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " Jul 09 14:05:20.685960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.685932 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-bundle\") pod \"c7df4f2b-8066-44c1-bc83-d78c7009659f\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " Jul 09 14:05:20.685960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.685948 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-util\") pod \"c7df4f2b-8066-44c1-bc83-d78c7009659f\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " Jul 09 14:05:20.686144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.685971 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-bundle\") pod \"11e50e1f-bfb7-4a04-8a70-659115adea4e\" (UID: \"11e50e1f-bfb7-4a04-8a70-659115adea4e\") " Jul 09 14:05:20.686144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.686007 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5cmg\" (UniqueName: \"kubernetes.io/projected/c7df4f2b-8066-44c1-bc83-d78c7009659f-kube-api-access-p5cmg\") pod \"c7df4f2b-8066-44c1-bc83-d78c7009659f\" (UID: \"c7df4f2b-8066-44c1-bc83-d78c7009659f\") " Jul 09 14:05:20.686478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.686451 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-bundle" (OuterVolumeSpecName: "bundle") pod "c7df4f2b-8066-44c1-bc83-d78c7009659f" (UID: "c7df4f2b-8066-44c1-bc83-d78c7009659f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:20.686644 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.686615 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-bundle" (OuterVolumeSpecName: "bundle") pod "11e50e1f-bfb7-4a04-8a70-659115adea4e" (UID: "11e50e1f-bfb7-4a04-8a70-659115adea4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:20.688545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.688516 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e50e1f-bfb7-4a04-8a70-659115adea4e-kube-api-access-4n5dh" (OuterVolumeSpecName: "kube-api-access-4n5dh") pod "11e50e1f-bfb7-4a04-8a70-659115adea4e" (UID: "11e50e1f-bfb7-4a04-8a70-659115adea4e"). InnerVolumeSpecName "kube-api-access-4n5dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:20.688640 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.688622 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7df4f2b-8066-44c1-bc83-d78c7009659f-kube-api-access-p5cmg" (OuterVolumeSpecName: "kube-api-access-p5cmg") pod "c7df4f2b-8066-44c1-bc83-d78c7009659f" (UID: "c7df4f2b-8066-44c1-bc83-d78c7009659f"). InnerVolumeSpecName "kube-api-access-p5cmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:20.692013 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.691982 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-util" (OuterVolumeSpecName: "util") pod "c7df4f2b-8066-44c1-bc83-d78c7009659f" (UID: "c7df4f2b-8066-44c1-bc83-d78c7009659f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:20.692514 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.692494 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-util" (OuterVolumeSpecName: "util") pod "11e50e1f-bfb7-4a04-8a70-659115adea4e" (UID: "11e50e1f-bfb7-4a04-8a70-659115adea4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:20.786950 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.786927 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:20.786950 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.786947 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7df4f2b-8066-44c1-bc83-d78c7009659f-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:20.787064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.786956 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:20.787064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.786965 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5cmg\" (UniqueName: \"kubernetes.io/projected/c7df4f2b-8066-44c1-bc83-d78c7009659f-kube-api-access-p5cmg\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:20.787064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.786975 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n5dh\" (UniqueName: \"kubernetes.io/projected/11e50e1f-bfb7-4a04-8a70-659115adea4e-kube-api-access-4n5dh\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:20.787064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:20.786983 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e50e1f-bfb7-4a04-8a70-659115adea4e-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:21.389628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.389596 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" Jul 09 14:05:21.390021 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.389601 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn" event={"ID":"c7df4f2b-8066-44c1-bc83-d78c7009659f","Type":"ContainerDied","Data":"b0f228d5d980a3e177440733ab6754d0a063b129d4671a17cb9b1d17448f93ff"} Jul 09 14:05:21.390021 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.389730 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0f228d5d980a3e177440733ab6754d0a063b129d4671a17cb9b1d17448f93ff" Jul 09 14:05:21.392050 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.392032 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" Jul 09 14:05:21.392169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.392066 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m" event={"ID":"11e50e1f-bfb7-4a04-8a70-659115adea4e","Type":"ContainerDied","Data":"f6018e2978ed15a8520fe4dbcfeecf1402fa6ff799959520907087a3b209af75"} Jul 09 14:05:21.392169 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.392127 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6018e2978ed15a8520fe4dbcfeecf1402fa6ff799959520907087a3b209af75" Jul 09 14:05:21.546505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.546482 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:21.549365 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.549350 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:21.592043 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592022 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-util\") pod \"bad7a7da-31ce-474f-8683-5a849d52ff91\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " Jul 09 14:05:21.592153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592074 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-bundle\") pod \"d0b9e1a0-677b-4926-b091-d0548a191fdc\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " Jul 09 14:05:21.592153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592131 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-bundle\") pod \"bad7a7da-31ce-474f-8683-5a849d52ff91\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " Jul 09 14:05:21.592277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592195 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcgw2\" (UniqueName: \"kubernetes.io/projected/d0b9e1a0-677b-4926-b091-d0548a191fdc-kube-api-access-dcgw2\") pod \"d0b9e1a0-677b-4926-b091-d0548a191fdc\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " Jul 09 14:05:21.592277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592246 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdw5m\" (UniqueName: \"kubernetes.io/projected/bad7a7da-31ce-474f-8683-5a849d52ff91-kube-api-access-vdw5m\") pod \"bad7a7da-31ce-474f-8683-5a849d52ff91\" (UID: \"bad7a7da-31ce-474f-8683-5a849d52ff91\") " Jul 09 14:05:21.592277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592271 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-util\") pod \"d0b9e1a0-677b-4926-b091-d0548a191fdc\" (UID: \"d0b9e1a0-677b-4926-b091-d0548a191fdc\") " Jul 09 14:05:21.592586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.592536 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-bundle" (OuterVolumeSpecName: "bundle") pod "d0b9e1a0-677b-4926-b091-d0548a191fdc" (UID: "d0b9e1a0-677b-4926-b091-d0548a191fdc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:21.593070 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.593045 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-bundle" (OuterVolumeSpecName: "bundle") pod "bad7a7da-31ce-474f-8683-5a849d52ff91" (UID: "bad7a7da-31ce-474f-8683-5a849d52ff91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:21.598760 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.598731 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad7a7da-31ce-474f-8683-5a849d52ff91-kube-api-access-vdw5m" (OuterVolumeSpecName: "kube-api-access-vdw5m") pod "bad7a7da-31ce-474f-8683-5a849d52ff91" (UID: "bad7a7da-31ce-474f-8683-5a849d52ff91"). InnerVolumeSpecName "kube-api-access-vdw5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:21.599030 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.599011 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b9e1a0-677b-4926-b091-d0548a191fdc-kube-api-access-dcgw2" (OuterVolumeSpecName: "kube-api-access-dcgw2") pod "d0b9e1a0-677b-4926-b091-d0548a191fdc" (UID: "d0b9e1a0-677b-4926-b091-d0548a191fdc"). InnerVolumeSpecName "kube-api-access-dcgw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:21.601759 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.601734 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-util" (OuterVolumeSpecName: "util") pod "bad7a7da-31ce-474f-8683-5a849d52ff91" (UID: "bad7a7da-31ce-474f-8683-5a849d52ff91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:21.602002 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.601982 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-util" (OuterVolumeSpecName: "util") pod "d0b9e1a0-677b-4926-b091-d0548a191fdc" (UID: "d0b9e1a0-677b-4926-b091-d0548a191fdc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:21.693618 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.693592 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcgw2\" (UniqueName: \"kubernetes.io/projected/d0b9e1a0-677b-4926-b091-d0548a191fdc-kube-api-access-dcgw2\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:21.693618 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.693616 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdw5m\" (UniqueName: \"kubernetes.io/projected/bad7a7da-31ce-474f-8683-5a849d52ff91-kube-api-access-vdw5m\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:21.693762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.693631 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:21.693762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.693646 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-util\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:21.693762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.693658 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b9e1a0-677b-4926-b091-d0548a191fdc-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:21.693762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:21.693671 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bad7a7da-31ce-474f-8683-5a849d52ff91-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:05:22.399714 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:22.399687 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" Jul 09 14:05:22.400062 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:22.399682 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf" event={"ID":"bad7a7da-31ce-474f-8683-5a849d52ff91","Type":"ContainerDied","Data":"dc20e7627fca28baf603cbf47308a10480743b62e56a0a2d76beb9400df27be0"} Jul 09 14:05:22.400062 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:22.399824 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc20e7627fca28baf603cbf47308a10480743b62e56a0a2d76beb9400df27be0" Jul 09 14:05:22.401844 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:22.401827 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" Jul 09 14:05:22.401959 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:22.401859 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb" event={"ID":"d0b9e1a0-677b-4926-b091-d0548a191fdc","Type":"ContainerDied","Data":"a2ec8e7073479e5bc0569884277cc55f35aac3facaee9c993e90b018b00a56b5"} Jul 09 14:05:22.401959 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:22.401898 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2ec8e7073479e5bc0569884277cc55f35aac3facaee9c993e90b018b00a56b5" Jul 09 14:05:43.323729 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.323643 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76c68ffdd5-xm9vz"] Jul 09 14:05:43.324201 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324181 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="util" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324203 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="util" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324216 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="pull" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324224 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="pull" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324251 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="pull" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324261 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="pull" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324274 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="extract" Jul 09 14:05:43.324282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324283 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324293 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324301 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324316 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="util" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324324 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="util" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324337 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324344 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324356 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="util" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324365 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="util" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324375 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="pull" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324383 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="pull" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324398 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="pull" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324406 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="pull" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324415 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324422 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324432 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="util" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324440 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="util" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324536 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="11e50e1f-bfb7-4a04-8a70-659115adea4e" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324550 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad7a7da-31ce-474f-8683-5a849d52ff91" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324562 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7df4f2b-8066-44c1-bc83-d78c7009659f" containerName="extract" Jul 09 14:05:43.324608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.324572 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b9e1a0-677b-4926-b091-d0548a191fdc" containerName="extract" Jul 09 14:05:43.327448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.327423 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.338043 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.338021 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c68ffdd5-xm9vz"] Jul 09 14:05:43.355853 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.355821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg69f\" (UniqueName: \"kubernetes.io/projected/9e1e30b8-b6d7-492a-97c6-c962e3844f53-kube-api-access-qg69f\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.355955 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.355877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-oauth-serving-cert\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.355955 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.355906 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-service-ca\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.355955 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.355929 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-serving-cert\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.356096 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.356074 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-trusted-ca-bundle\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.356254 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.356229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-oauth-config\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.356368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.356274 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-config\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.456897 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.456867 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg69f\" (UniqueName: \"kubernetes.io/projected/9e1e30b8-b6d7-492a-97c6-c962e3844f53-kube-api-access-qg69f\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.456976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.456901 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-oauth-serving-cert\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.456976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.456917 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-service-ca\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.456976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.456942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-serving-cert\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.457091 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.456994 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-trusted-ca-bundle\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.457091 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.457027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-oauth-config\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.457091 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.457052 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-config\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.457834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.457807 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-service-ca\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.457834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.457825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-config\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.457979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.457879 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-oauth-serving-cert\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.458028 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.457978 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1e30b8-b6d7-492a-97c6-c962e3844f53-trusted-ca-bundle\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.459592 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.459562 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-serving-cert\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.459676 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.459622 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e1e30b8-b6d7-492a-97c6-c962e3844f53-console-oauth-config\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.465496 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.465475 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg69f\" (UniqueName: \"kubernetes.io/projected/9e1e30b8-b6d7-492a-97c6-c962e3844f53-kube-api-access-qg69f\") pod \"console-76c68ffdd5-xm9vz\" (UID: \"9e1e30b8-b6d7-492a-97c6-c962e3844f53\") " pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.637762 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.637711 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:43.768963 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:43.768876 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c68ffdd5-xm9vz"] Jul 09 14:05:43.771189 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:05:43.771161 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1e30b8_b6d7_492a_97c6_c962e3844f53.slice/crio-c62f0d730b09edd1929aa69751aad6a4ac188cc78c473d22558022eaea91e56e WatchSource:0}: Error finding container c62f0d730b09edd1929aa69751aad6a4ac188cc78c473d22558022eaea91e56e: Status 404 returned error can't find the container with id c62f0d730b09edd1929aa69751aad6a4ac188cc78c473d22558022eaea91e56e Jul 09 14:05:44.518311 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:44.518280 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c68ffdd5-xm9vz" event={"ID":"9e1e30b8-b6d7-492a-97c6-c962e3844f53","Type":"ContainerStarted","Data":"65df4e9c43f79ce75d2f4f72410862ac31db5611e8a49ce976c63cb4cc9154bd"} Jul 09 14:05:44.518678 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:44.518327 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c68ffdd5-xm9vz" event={"ID":"9e1e30b8-b6d7-492a-97c6-c962e3844f53","Type":"ContainerStarted","Data":"c62f0d730b09edd1929aa69751aad6a4ac188cc78c473d22558022eaea91e56e"} Jul 09 14:05:44.539503 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:44.539456 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76c68ffdd5-xm9vz" podStartSLOduration=1.5394404019999999 podStartE2EDuration="1.539440402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:44.536573416 +0000 UTC m=+444.750799550" watchObservedRunningTime="2026-07-09 14:05:44.539440402 +0000 UTC m=+444.753666517" Jul 09 14:05:53.638297 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:53.638248 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:53.638297 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:53.638312 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:53.643079 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:53.643051 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:54.574382 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:54.574345 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76c68ffdd5-xm9vz" Jul 09 14:05:54.622045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:05:54.622010 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6757dc86dd-4jws7"] Jul 09 14:06:19.646154 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:19.646094 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6757dc86dd-4jws7" podUID="e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" containerName="console" containerID="cri-o://a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109" gracePeriod=15 Jul 09 14:06:19.890284 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:19.890261 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:06:20.045344 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045318 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-trusted-ca-bundle\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045362 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-oauth-config\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045393 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-serving-cert\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045417 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg7bk\" (UniqueName: \"kubernetes.io/projected/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-kube-api-access-lg7bk\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045436 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-oauth-serving-cert\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045455 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-service-ca\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045478 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-config\") pod \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\" (UID: \"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e\") " Jul 09 14:06:20.045819 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045785 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:06:20.045975 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045922 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:06:20.045975 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.045919 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:06:20.046103 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.046005 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-config" (OuterVolumeSpecName: "console-config") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:06:20.047468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.047449 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:06:20.047927 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.047892 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:06:20.047927 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.047915 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-kube-api-access-lg7bk" (OuterVolumeSpecName: "kube-api-access-lg7bk") pod "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" (UID: "e0ff6999-0edf-46ed-8a7d-8f950f9ba26e"). InnerVolumeSpecName "kube-api-access-lg7bk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:06:20.146182 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146158 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-service-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.146182 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146178 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.146306 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146187 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-trusted-ca-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.146306 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146195 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-oauth-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.146306 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146204 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-console-serving-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.146306 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146211 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg7bk\" (UniqueName: \"kubernetes.io/projected/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-kube-api-access-lg7bk\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.146306 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.146220 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e-oauth-serving-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.714951 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.714918 2553 generic.go:356] "Generic (PLEG): container finished" podID="e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" containerID="a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109" exitCode=0 Jul 09 14:06:20.715352 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.714965 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6757dc86dd-4jws7" Jul 09 14:06:20.715352 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.715005 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757dc86dd-4jws7" event={"ID":"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e","Type":"ContainerDied","Data":"a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109"} Jul 09 14:06:20.715352 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.715062 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6757dc86dd-4jws7" event={"ID":"e0ff6999-0edf-46ed-8a7d-8f950f9ba26e","Type":"ContainerDied","Data":"4499273c97a78f79fb5ba91914933828a0df113163bf94d64cb1f844d7011970"} Jul 09 14:06:20.715352 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.715085 2553 scope.go:117] "RemoveContainer" containerID="a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109" Jul 09 14:06:20.724189 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.724171 2553 scope.go:117] "RemoveContainer" containerID="a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109" Jul 09 14:06:20.724445 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:06:20.724425 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109\": container with ID starting with a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109 not found: ID does not exist" containerID="a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109" Jul 09 14:06:20.724496 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.724453 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109"} err="failed to get container status \"a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109\": rpc error: code = NotFound desc = could not find container \"a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109\": container with ID starting with a116653e1592844e5acfcec1b0aa13115f4b7620cea37e4c202279964228c109 not found: ID does not exist" Jul 09 14:06:20.733564 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.733540 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6757dc86dd-4jws7"] Jul 09 14:06:20.739580 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:20.739559 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6757dc86dd-4jws7"] Jul 09 14:06:22.301117 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:22.301068 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" path="/var/lib/kubelet/pods/e0ff6999-0edf-46ed-8a7d-8f950f9ba26e/volumes" Jul 09 14:06:35.795132 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.795088 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2"] Jul 09 14:06:35.795685 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.795655 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" containerName="console" Jul 09 14:06:35.795685 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.795674 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" containerName="console" Jul 09 14:06:35.795803 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.795783 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ff6999-0edf-46ed-8a7d-8f950f9ba26e" containerName="console" Jul 09 14:06:35.800512 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.800490 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.803191 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.803167 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9tgkx\"" Jul 09 14:06:35.810072 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.810052 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2"] Jul 09 14:06:35.867629 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867607 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.867721 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867646 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.867783 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.867819 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867804 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b75831-c044-4b15-a092-d43fcd2ff011-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.867860 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867832 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b75831-c044-4b15-a092-d43fcd2ff011-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.867911 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867893 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.867968 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867935 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.868022 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.867963 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b75831-c044-4b15-a092-d43fcd2ff011-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.868022 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.868000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcs74\" (UniqueName: \"kubernetes.io/projected/38b75831-c044-4b15-a092-d43fcd2ff011-kube-api-access-hcs74\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969373 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969344 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969373 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969375 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b75831-c044-4b15-a092-d43fcd2ff011-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969395 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b75831-c044-4b15-a092-d43fcd2ff011-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969428 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969456 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969483 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b75831-c044-4b15-a092-d43fcd2ff011-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969548 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcs74\" (UniqueName: \"kubernetes.io/projected/38b75831-c044-4b15-a092-d43fcd2ff011-kube-api-access-hcs74\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969642 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969704 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969902 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969783 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.969902 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.970002 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.969959 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.970054 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.970010 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.970383 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.970281 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38b75831-c044-4b15-a092-d43fcd2ff011-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.971912 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.971876 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38b75831-c044-4b15-a092-d43fcd2ff011-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.972021 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.971931 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38b75831-c044-4b15-a092-d43fcd2ff011-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.977044 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.977020 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38b75831-c044-4b15-a092-d43fcd2ff011-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:35.977232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:35.977216 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcs74\" (UniqueName: \"kubernetes.io/projected/38b75831-c044-4b15-a092-d43fcd2ff011-kube-api-access-hcs74\") pod \"maas-default-gateway-openshift-default-5896d4dd49-n4zk2\" (UID: \"38b75831-c044-4b15-a092-d43fcd2ff011\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:36.112288 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.112229 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:36.250381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.250357 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2"] Jul 09 14:06:36.252068 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:06:36.252040 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b75831_c044_4b15_a092_d43fcd2ff011.slice/crio-1bc73051ed2a527b8621052d952e4c8cec9c29141d149f7bfeba16bd35fc4f7f WatchSource:0}: Error finding container 1bc73051ed2a527b8621052d952e4c8cec9c29141d149f7bfeba16bd35fc4f7f: Status 404 returned error can't find the container with id 1bc73051ed2a527b8621052d952e4c8cec9c29141d149f7bfeba16bd35fc4f7f Jul 09 14:06:36.254061 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.254027 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:06:36.254145 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.254091 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:06:36.254190 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.254147 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:06:36.813605 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.813567 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" event={"ID":"38b75831-c044-4b15-a092-d43fcd2ff011","Type":"ContainerStarted","Data":"593a43ddb0c21172415f8b925fc6be4b09e8f9770eede64cbb0877007096f73d"} Jul 09 14:06:36.813986 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.813629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" event={"ID":"38b75831-c044-4b15-a092-d43fcd2ff011","Type":"ContainerStarted","Data":"1bc73051ed2a527b8621052d952e4c8cec9c29141d149f7bfeba16bd35fc4f7f"} Jul 09 14:06:36.834346 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:36.834307 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" podStartSLOduration=1.834292997 podStartE2EDuration="1.834292997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:36.833432425 +0000 UTC m=+497.047658542" watchObservedRunningTime="2026-07-09 14:06:36.834292997 +0000 UTC m=+497.048519110" Jul 09 14:06:37.112979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:37.112916 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:37.117933 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:37.117910 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:37.820040 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:37.820008 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:06:37.820945 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:06:37.820923 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:07:51.444898 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.444864 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zbh4h"] Jul 09 14:07:51.448263 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.448247 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.450999 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.450980 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mvvl2\"" Jul 09 14:07:51.451087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.451022 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 14:07:51.457803 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.457778 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zbh4h"] Jul 09 14:07:51.561930 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.561901 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbfed569-6e30-4b55-a18c-38048ef669a0-plugins-config-volume\") pod \"payload-processing-58f86c7798-zbh4h\" (UID: \"dbfed569-6e30-4b55-a18c-38048ef669a0\") " pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.562075 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.561939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wskdd\" (UniqueName: \"kubernetes.io/projected/dbfed569-6e30-4b55-a18c-38048ef669a0-kube-api-access-wskdd\") pod \"payload-processing-58f86c7798-zbh4h\" (UID: \"dbfed569-6e30-4b55-a18c-38048ef669a0\") " pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.662586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.662545 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbfed569-6e30-4b55-a18c-38048ef669a0-plugins-config-volume\") pod \"payload-processing-58f86c7798-zbh4h\" (UID: \"dbfed569-6e30-4b55-a18c-38048ef669a0\") " pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.662586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.662583 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wskdd\" (UniqueName: \"kubernetes.io/projected/dbfed569-6e30-4b55-a18c-38048ef669a0-kube-api-access-wskdd\") pod \"payload-processing-58f86c7798-zbh4h\" (UID: \"dbfed569-6e30-4b55-a18c-38048ef669a0\") " pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.663447 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.663421 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbfed569-6e30-4b55-a18c-38048ef669a0-plugins-config-volume\") pod \"payload-processing-58f86c7798-zbh4h\" (UID: \"dbfed569-6e30-4b55-a18c-38048ef669a0\") " pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.670590 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.670566 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wskdd\" (UniqueName: \"kubernetes.io/projected/dbfed569-6e30-4b55-a18c-38048ef669a0-kube-api-access-wskdd\") pod \"payload-processing-58f86c7798-zbh4h\" (UID: \"dbfed569-6e30-4b55-a18c-38048ef669a0\") " pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.759378 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.759321 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:51.888237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:51.888212 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zbh4h"] Jul 09 14:07:51.889612 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:07:51.889588 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfed569_6e30_4b55_a18c_38048ef669a0.slice/crio-83475e3bb0e349826df2489bf4a8ba842e53922254196d58945d0fa92b73ede4 WatchSource:0}: Error finding container 83475e3bb0e349826df2489bf4a8ba842e53922254196d58945d0fa92b73ede4: Status 404 returned error can't find the container with id 83475e3bb0e349826df2489bf4a8ba842e53922254196d58945d0fa92b73ede4 Jul 09 14:07:52.244052 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:52.244017 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" event={"ID":"dbfed569-6e30-4b55-a18c-38048ef669a0","Type":"ContainerStarted","Data":"83475e3bb0e349826df2489bf4a8ba842e53922254196d58945d0fa92b73ede4"} Jul 09 14:07:54.258883 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:54.258849 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" event={"ID":"dbfed569-6e30-4b55-a18c-38048ef669a0","Type":"ContainerStarted","Data":"4b4cac4b6ef9fc1912b71599fd4dd0a59a41b3558f9166509266ab3427b6b198"} Jul 09 14:07:54.259290 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:54.258912 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:07:54.277223 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:07:54.277176 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" podStartSLOduration=1.4725933119999999 podStartE2EDuration="3.277161865s" totalImagesPullingTime="1.804568553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:07:54.274527916 +0000 UTC m=+574.488754032" watchObservedRunningTime="2026-07-09 14:07:54.277161865 +0000 UTC m=+574.491387981" Jul 09 14:08:01.299534 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:01.299495 2553 generic.go:356] "Generic (PLEG): container finished" podID="38b75831-c044-4b15-a092-d43fcd2ff011" containerID="593a43ddb0c21172415f8b925fc6be4b09e8f9770eede64cbb0877007096f73d" exitCode=0 Jul 09 14:08:01.300076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:01.299583 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" event={"ID":"38b75831-c044-4b15-a092-d43fcd2ff011","Type":"ContainerDied","Data":"593a43ddb0c21172415f8b925fc6be4b09e8f9770eede64cbb0877007096f73d"} Jul 09 14:08:01.300076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:01.299986 2553 scope.go:117] "RemoveContainer" containerID="593a43ddb0c21172415f8b925fc6be4b09e8f9770eede64cbb0877007096f73d" Jul 09 14:08:01.301151 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:01.301100 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:08:01.301238 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:01.301221 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:08:01.301295 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:01.301263 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:08:02.305520 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:02.305490 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" event={"ID":"38b75831-c044-4b15-a092-d43fcd2ff011","Type":"ContainerStarted","Data":"e782176c5cdabbbdb8d9d35f7d94296d4e30ebb5c88488e95c96c4e5a0ebd3ff"} Jul 09 14:08:03.113342 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:03.113312 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:08:03.114409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:03.114388 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-n4zk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 09 14:08:03.114467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:03.114435 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" podUID="38b75831-c044-4b15-a092-d43fcd2ff011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 09 14:08:04.113563 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:04.113530 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-n4zk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 09 14:08:04.113928 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:04.113583 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" podUID="38b75831-c044-4b15-a092-d43fcd2ff011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 09 14:08:05.113186 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:05.113150 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-n4zk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 09 14:08:05.113366 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:05.113216 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" podUID="38b75831-c044-4b15-a092-d43fcd2ff011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 09 14:08:05.266654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:05.266621 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zbh4h" Jul 09 14:08:06.116651 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:06.116620 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:08:06.117019 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:06.116989 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:08:06.117684 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:06.117663 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-n4zk2" Jul 09 14:08:09.222928 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.222896 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq"] Jul 09 14:08:09.229148 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.229128 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.232980 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.232955 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 09 14:08:09.233130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.232967 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cjpmt\"" Jul 09 14:08:09.233130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.232971 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:08:09.233264 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.232975 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:08:09.236689 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.236655 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq"] Jul 09 14:08:09.316582 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.316557 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.316690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.316587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.316690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.316610 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb9bl\" (UniqueName: \"kubernetes.io/projected/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-kube-api-access-rb9bl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.316786 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.316733 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.316786 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.316764 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.316786 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.316783 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.417836 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.417800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.417973 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.417843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb9bl\" (UniqueName: \"kubernetes.io/projected/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-kube-api-access-rb9bl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.417973 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.417896 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.418090 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.417984 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.418090 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.418013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.418090 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.418067 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.418301 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.418281 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.418361 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.418346 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.418436 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.418416 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.420054 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.420033 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.420401 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.420385 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.426515 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.426496 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb9bl\" (UniqueName: \"kubernetes.io/projected/df01c6c6-451b-4ac8-8ab7-0044fe5624a0-kube-api-access-rb9bl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq\" (UID: \"df01c6c6-451b-4ac8-8ab7-0044fe5624a0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.541252 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.541200 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:09.677802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:09.677765 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq"] Jul 09 14:08:09.680679 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:08:09.680656 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf01c6c6_451b_4ac8_8ab7_0044fe5624a0.slice/crio-52bd9e6e1f93f18390b152437b5e8d1c9aa30a8ba4adeb43dc0fc1954ebeecf1 WatchSource:0}: Error finding container 52bd9e6e1f93f18390b152437b5e8d1c9aa30a8ba4adeb43dc0fc1954ebeecf1: Status 404 returned error can't find the container with id 52bd9e6e1f93f18390b152437b5e8d1c9aa30a8ba4adeb43dc0fc1954ebeecf1 Jul 09 14:08:10.349668 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:10.349626 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" event={"ID":"df01c6c6-451b-4ac8-8ab7-0044fe5624a0","Type":"ContainerStarted","Data":"52bd9e6e1f93f18390b152437b5e8d1c9aa30a8ba4adeb43dc0fc1954ebeecf1"} Jul 09 14:08:11.357252 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:11.357213 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" event={"ID":"df01c6c6-451b-4ac8-8ab7-0044fe5624a0","Type":"ContainerStarted","Data":"d4cd3de380168fd2961522f2c90992f14b672f90964b25a4b4fd391e823f91a8"} Jul 09 14:08:11.378506 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:11.378455 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" podStartSLOduration=1.244128035 podStartE2EDuration="2.378440311s" totalImagesPullingTime="1.134312276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:11.375775749 +0000 UTC m=+591.590001869" watchObservedRunningTime="2026-07-09 14:08:11.378440311 +0000 UTC m=+591.592666460" Jul 09 14:08:19.541865 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:19.541828 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:19.542317 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:19.541899 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:19.554606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:19.554580 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:08:20.210875 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:20.210843 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:08:20.211050 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:20.210911 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:08:20.419913 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:08:20.419889 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq" Jul 09 14:13:20.249031 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:13:20.248955 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:13:20.251428 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:13:20.250174 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:15:00.145343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.145301 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9"] Jul 09 14:15:00.149162 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.149135 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:15:00.152969 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.152946 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 14:15:00.153094 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.152951 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 14:15:00.154155 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.154138 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5r4q9\"" Jul 09 14:15:00.169427 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.169407 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9"] Jul 09 14:15:00.259229 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.259204 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gsc\" (UniqueName: \"kubernetes.io/projected/c75a3695-2a96-4262-92be-6971d21a2cc9-kube-api-access-m9gsc\") pod \"maas-api-key-cleanup-29726775-zfzw9\" (UID: \"c75a3695-2a96-4262-92be-6971d21a2cc9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:15:00.360384 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.360354 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gsc\" (UniqueName: \"kubernetes.io/projected/c75a3695-2a96-4262-92be-6971d21a2cc9-kube-api-access-m9gsc\") pod \"maas-api-key-cleanup-29726775-zfzw9\" (UID: \"c75a3695-2a96-4262-92be-6971d21a2cc9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:15:00.369428 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.369404 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gsc\" (UniqueName: \"kubernetes.io/projected/c75a3695-2a96-4262-92be-6971d21a2cc9-kube-api-access-m9gsc\") pod \"maas-api-key-cleanup-29726775-zfzw9\" (UID: \"c75a3695-2a96-4262-92be-6971d21a2cc9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:15:00.460864 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.460847 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:15:00.607410 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.607380 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9"] Jul 09 14:15:00.608290 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:15:00.608265 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75a3695_2a96_4262_92be_6971d21a2cc9.slice/crio-4b31fddae8480f65b13be4acc4d3619335e4a0af6e61e60c913186c2a43ee45a WatchSource:0}: Error finding container 4b31fddae8480f65b13be4acc4d3619335e4a0af6e61e60c913186c2a43ee45a: Status 404 returned error can't find the container with id 4b31fddae8480f65b13be4acc4d3619335e4a0af6e61e60c913186c2a43ee45a Jul 09 14:15:00.610296 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.610279 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:15:00.633439 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:00.633403 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" event={"ID":"c75a3695-2a96-4262-92be-6971d21a2cc9","Type":"ContainerStarted","Data":"4b31fddae8480f65b13be4acc4d3619335e4a0af6e61e60c913186c2a43ee45a"} Jul 09 14:15:03.652047 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:03.652014 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" event={"ID":"c75a3695-2a96-4262-92be-6971d21a2cc9","Type":"ContainerStarted","Data":"f4cda371ec9dee0db55c088020e8dbd6dfd95ddac7cbc7a0faab54bb94df9fd8"} Jul 09 14:15:03.668932 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:15:03.668890 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" podStartSLOduration=1.611197975 podStartE2EDuration="3.668874798s" totalImagesPullingTime="2.057676823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:15:03.668850356 +0000 UTC m=+1003.883076494" watchObservedRunningTime="2026-07-09 14:15:03.668874798 +0000 UTC m=+1003.883100914" Jul 09 14:16:00.013355 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:00.013314 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9"] Jul 09 14:16:00.013898 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:00.013529 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" podUID="c75a3695-2a96-4262-92be-6971d21a2cc9" containerName="cleanup" containerID="cri-o://f4cda371ec9dee0db55c088020e8dbd6dfd95ddac7cbc7a0faab54bb94df9fd8" gracePeriod=30 Jul 09 14:16:30.156226 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:30.156192 2553 generic.go:356] "Generic (PLEG): container finished" podID="c75a3695-2a96-4262-92be-6971d21a2cc9" containerID="f4cda371ec9dee0db55c088020e8dbd6dfd95ddac7cbc7a0faab54bb94df9fd8" exitCode=137 Jul 09 14:16:30.156566 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:30.156253 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" event={"ID":"c75a3695-2a96-4262-92be-6971d21a2cc9","Type":"ContainerDied","Data":"f4cda371ec9dee0db55c088020e8dbd6dfd95ddac7cbc7a0faab54bb94df9fd8"} Jul 09 14:16:30.208732 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:30.208709 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:16:30.282310 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:30.282246 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9gsc\" (UniqueName: \"kubernetes.io/projected/c75a3695-2a96-4262-92be-6971d21a2cc9-kube-api-access-m9gsc\") pod \"c75a3695-2a96-4262-92be-6971d21a2cc9\" (UID: \"c75a3695-2a96-4262-92be-6971d21a2cc9\") " Jul 09 14:16:30.284230 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:30.284208 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75a3695-2a96-4262-92be-6971d21a2cc9-kube-api-access-m9gsc" (OuterVolumeSpecName: "kube-api-access-m9gsc") pod "c75a3695-2a96-4262-92be-6971d21a2cc9" (UID: "c75a3695-2a96-4262-92be-6971d21a2cc9"). InnerVolumeSpecName "kube-api-access-m9gsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:16:30.383811 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:30.383783 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9gsc\" (UniqueName: \"kubernetes.io/projected/c75a3695-2a96-4262-92be-6971d21a2cc9-kube-api-access-m9gsc\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:16:31.163093 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:31.163064 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" Jul 09 14:16:31.163093 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:31.163072 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9" event={"ID":"c75a3695-2a96-4262-92be-6971d21a2cc9","Type":"ContainerDied","Data":"4b31fddae8480f65b13be4acc4d3619335e4a0af6e61e60c913186c2a43ee45a"} Jul 09 14:16:31.163640 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:31.163167 2553 scope.go:117] "RemoveContainer" containerID="f4cda371ec9dee0db55c088020e8dbd6dfd95ddac7cbc7a0faab54bb94df9fd8" Jul 09 14:16:31.182625 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:31.182597 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9"] Jul 09 14:16:31.184835 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:31.184813 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-zfzw9"] Jul 09 14:16:32.301220 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:16:32.301190 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75a3695-2a96-4262-92be-6971d21a2cc9" path="/var/lib/kubelet/pods/c75a3695-2a96-4262-92be-6971d21a2cc9/volumes" Jul 09 14:18:20.286648 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:18:20.286541 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:18:20.290604 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:18:20.288875 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:23:14.496599 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.496559 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn"] Jul 09 14:23:14.497603 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.497490 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75a3695-2a96-4262-92be-6971d21a2cc9" containerName="cleanup" Jul 09 14:23:14.497603 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.497510 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75a3695-2a96-4262-92be-6971d21a2cc9" containerName="cleanup" Jul 09 14:23:14.497742 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.497715 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75a3695-2a96-4262-92be-6971d21a2cc9" containerName="cleanup" Jul 09 14:23:14.501482 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.501461 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.504161 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.504140 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c6ebe748-openshift-default-dockercfg-b4r2k\"" Jul 09 14:23:14.522244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.522218 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn"] Jul 09 14:23:14.563193 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563173 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-envoy\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563288 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563204 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224d6190-9056-4a12-813f-62ba3352d457-istiod-ca-cert\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563288 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563235 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-certs\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563369 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563307 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-socket\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563369 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-credential-socket\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563369 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-data\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563481 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563395 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224d6190-9056-4a12-813f-62ba3352d457-istio-podinfo\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563481 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563419 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-istio-token\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.563565 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.563489 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cnlx\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-kube-api-access-4cnlx\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.664690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-certs\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.664847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664707 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-socket\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.664847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664733 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-credential-socket\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.664847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664761 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-data\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.664847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224d6190-9056-4a12-813f-62ba3352d457-istio-podinfo\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.664847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-istio-token\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665211 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.664891 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cnlx\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-kube-api-access-4cnlx\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665211 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665094 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-envoy\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665211 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665123 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-certs\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665211 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665160 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224d6190-9056-4a12-813f-62ba3352d457-istiod-ca-cert\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665211 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665202 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-data\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665218 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-credential-socket\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665162 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-socket\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.665808 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.665789 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224d6190-9056-4a12-813f-62ba3352d457-istiod-ca-cert\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.667158 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.667141 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-envoy\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.667387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.667368 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224d6190-9056-4a12-813f-62ba3352d457-istio-podinfo\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.672802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.672774 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-istio-token\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.672990 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.672972 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cnlx\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-kube-api-access-4cnlx\") pod \"e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.810919 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.810864 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:14.945933 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.945902 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn"] Jul 09 14:23:14.947220 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:23:14.947192 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224d6190_9056_4a12_813f_62ba3352d457.slice/crio-a4b62f0815a8e724289dac3a5ac980597bd17e43ddb01e043cdb51d666aee6f1 WatchSource:0}: Error finding container a4b62f0815a8e724289dac3a5ac980597bd17e43ddb01e043cdb51d666aee6f1: Status 404 returned error can't find the container with id a4b62f0815a8e724289dac3a5ac980597bd17e43ddb01e043cdb51d666aee6f1 Jul 09 14:23:14.949949 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.949909 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:14.950060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.949981 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:14.950060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:14.950019 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:15.415132 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:15.415082 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" event={"ID":"224d6190-9056-4a12-813f-62ba3352d457","Type":"ContainerStarted","Data":"2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39"} Jul 09 14:23:15.415297 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:15.415151 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" event={"ID":"224d6190-9056-4a12-813f-62ba3352d457","Type":"ContainerStarted","Data":"a4b62f0815a8e724289dac3a5ac980597bd17e43ddb01e043cdb51d666aee6f1"} Jul 09 14:23:15.438669 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:15.438620 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" podStartSLOduration=1.438605163 podStartE2EDuration="1.438605163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:15.434729572 +0000 UTC m=+1495.648955688" watchObservedRunningTime="2026-07-09 14:23:15.438605163 +0000 UTC m=+1495.652831278" Jul 09 14:23:15.811945 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:15.811869 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:16.816914 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:16.816884 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:17.426307 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:17.426279 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:17.427085 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:17.427066 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:20.353699 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:20.353600 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:23:20.359003 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:20.358974 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:23:20.928475 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:20.928438 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn"] Jul 09 14:23:20.928669 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:20.928643 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" podUID="224d6190-9056-4a12-813f-62ba3352d457" containerName="istio-proxy" containerID="cri-o://2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39" gracePeriod=30 Jul 09 14:23:26.271470 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.271448 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:26.401011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.400949 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-socket\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.400995 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cnlx\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-kube-api-access-4cnlx\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401032 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224d6190-9056-4a12-813f-62ba3352d457-istio-podinfo\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401057 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-data\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401083 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-certs\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401097 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-istio-token\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401128 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224d6190-9056-4a12-813f-62ba3352d457-istiod-ca-cert\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401210 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401152 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-credential-socket\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401224 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-envoy\") pod \"224d6190-9056-4a12-813f-62ba3352d457\" (UID: \"224d6190-9056-4a12-813f-62ba3352d457\") " Jul 09 14:23:26.401525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401246 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:26.401525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401445 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:26.401688 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401549 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/224d6190-9056-4a12-813f-62ba3352d457-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:23:26.401688 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401558 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.401688 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401578 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.401688 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.401589 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:26.402146 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.402099 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-data" (OuterVolumeSpecName: "istio-data") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:26.403565 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.403539 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/224d6190-9056-4a12-813f-62ba3352d457-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:23:26.403565 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.403559 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-kube-api-access-4cnlx" (OuterVolumeSpecName: "kube-api-access-4cnlx") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "kube-api-access-4cnlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:23:26.403831 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.403815 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:26.403908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.403884 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-istio-token" (OuterVolumeSpecName: "istio-token") pod "224d6190-9056-4a12-813f-62ba3352d457" (UID: "224d6190-9056-4a12-813f-62ba3352d457"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:23:26.483893 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.483861 2553 generic.go:356] "Generic (PLEG): container finished" podID="224d6190-9056-4a12-813f-62ba3352d457" containerID="2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39" exitCode=0 Jul 09 14:23:26.484006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.483909 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" Jul 09 14:23:26.484006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.483912 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" event={"ID":"224d6190-9056-4a12-813f-62ba3352d457","Type":"ContainerDied","Data":"2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39"} Jul 09 14:23:26.484158 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.484036 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn" event={"ID":"224d6190-9056-4a12-813f-62ba3352d457","Type":"ContainerDied","Data":"a4b62f0815a8e724289dac3a5ac980597bd17e43ddb01e043cdb51d666aee6f1"} Jul 09 14:23:26.484158 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.484062 2553 scope.go:117] "RemoveContainer" containerID="2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39" Jul 09 14:23:26.493267 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.493252 2553 scope.go:117] "RemoveContainer" containerID="2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39" Jul 09 14:23:26.493518 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:23:26.493493 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39\": container with ID starting with 2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39 not found: ID does not exist" containerID="2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39" Jul 09 14:23:26.493605 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.493525 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39"} err="failed to get container status \"2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39\": rpc error: code = NotFound desc = could not find container \"2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39\": container with ID starting with 2cd633d955bf85b901f937b1131042c863f8b08fb25715ad2cc5fe580add3d39 not found: ID does not exist" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502559 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cnlx\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-kube-api-access-4cnlx\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502585 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224d6190-9056-4a12-813f-62ba3352d457-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502598 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502610 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224d6190-9056-4a12-813f-62ba3352d457-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502624 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224d6190-9056-4a12-813f-62ba3352d457-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502636 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.502641 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.502647 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224d6190-9056-4a12-813f-62ba3352d457-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:26.505463 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.505443 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn"] Jul 09 14:23:26.508890 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:26.508871 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c6ebe748-openshift-default-5f84bfd759-bz7hn"] Jul 09 14:23:27.364242 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.364211 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr"] Jul 09 14:23:27.364686 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.364623 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224d6190-9056-4a12-813f-62ba3352d457" containerName="istio-proxy" Jul 09 14:23:27.364686 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.364635 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="224d6190-9056-4a12-813f-62ba3352d457" containerName="istio-proxy" Jul 09 14:23:27.364805 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.364697 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="224d6190-9056-4a12-813f-62ba3352d457" containerName="istio-proxy" Jul 09 14:23:27.369283 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.369260 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.379056 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.379035 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f7f85c0a-gw-openshift-default-dockercfg-tsbxs\"" Jul 09 14:23:27.390566 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.390544 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr"] Jul 09 14:23:27.512388 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512357 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-socket\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512550 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-token\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512550 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512442 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-data\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512550 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512476 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vj8\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-kube-api-access-w2vj8\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512550 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512506 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-envoy\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512550 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512532 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-certs\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-credential-socket\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-podinfo\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.512756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.512583 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20dba00-8094-41fb-a109-b02ceea4cd44-istiod-ca-cert\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.613955 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.613928 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-envoy\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.613955 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.613957 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-certs\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.613980 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-credential-socket\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.613997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-podinfo\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614012 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20dba00-8094-41fb-a109-b02ceea4cd44-istiod-ca-cert\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-socket\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614099 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-token\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614502 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614184 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-data\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614502 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614269 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vj8\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-kube-api-access-w2vj8\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614502 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614384 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-certs\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614683 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614659 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-data\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614772 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614753 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-credential-socket\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614874 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614754 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-socket\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.614955 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.614931 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20dba00-8094-41fb-a109-b02ceea4cd44-istiod-ca-cert\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.616341 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.616319 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-envoy\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.616585 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.616562 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-podinfo\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.622572 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.622549 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-token\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.622922 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.622893 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vj8\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-kube-api-access-w2vj8\") pod \"e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.685828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.685805 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:27.823725 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.823694 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr"] Jul 09 14:23:27.825368 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:23:27.825337 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20dba00_8094_41fb_a109_b02ceea4cd44.slice/crio-62fc9a4943330c228e83ba202886001a054966dac0d1eaab928179ff74fa599b WatchSource:0}: Error finding container 62fc9a4943330c228e83ba202886001a054966dac0d1eaab928179ff74fa599b: Status 404 returned error can't find the container with id 62fc9a4943330c228e83ba202886001a054966dac0d1eaab928179ff74fa599b Jul 09 14:23:27.827442 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.827407 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:27.827547 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.827471 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:27.827547 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:27.827499 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:28.300654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:28.300617 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224d6190-9056-4a12-813f-62ba3352d457" path="/var/lib/kubelet/pods/224d6190-9056-4a12-813f-62ba3352d457/volumes" Jul 09 14:23:28.498173 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:28.498144 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" event={"ID":"b20dba00-8094-41fb-a109-b02ceea4cd44","Type":"ContainerStarted","Data":"5fd5f5ee3c204067c9e65844ded49c3aa4a965d7251ecdaf569b81e7bbf7f943"} Jul 09 14:23:28.498635 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:28.498188 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" event={"ID":"b20dba00-8094-41fb-a109-b02ceea4cd44","Type":"ContainerStarted","Data":"62fc9a4943330c228e83ba202886001a054966dac0d1eaab928179ff74fa599b"} Jul 09 14:23:28.521348 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:28.521302 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" podStartSLOduration=1.52128904 podStartE2EDuration="1.52128904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:28.518631949 +0000 UTC m=+1508.732858065" watchObservedRunningTime="2026-07-09 14:23:28.52128904 +0000 UTC m=+1508.735515156" Jul 09 14:23:28.687018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:28.686987 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:28.691558 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:28.691532 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:29.504249 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:29.504224 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:29.505059 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:29.505040 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:33.424498 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:33.424465 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr"] Jul 09 14:23:33.424985 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:33.424677 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" podUID="b20dba00-8094-41fb-a109-b02ceea4cd44" containerName="istio-proxy" containerID="cri-o://5fd5f5ee3c204067c9e65844ded49c3aa4a965d7251ecdaf569b81e7bbf7f943" gracePeriod=30 Jul 09 14:23:38.566570 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.566539 2553 generic.go:356] "Generic (PLEG): container finished" podID="b20dba00-8094-41fb-a109-b02ceea4cd44" containerID="5fd5f5ee3c204067c9e65844ded49c3aa4a965d7251ecdaf569b81e7bbf7f943" exitCode=0 Jul 09 14:23:38.566981 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.566612 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" event={"ID":"b20dba00-8094-41fb-a109-b02ceea4cd44","Type":"ContainerDied","Data":"5fd5f5ee3c204067c9e65844ded49c3aa4a965d7251ecdaf569b81e7bbf7f943"} Jul 09 14:23:38.681895 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.681867 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:38.717385 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717323 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-envoy\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717388 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-socket\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717445 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-certs\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717473 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20dba00-8094-41fb-a109-b02ceea4cd44-istiod-ca-cert\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717657 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717506 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2vj8\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-kube-api-access-w2vj8\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717657 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717535 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-credential-socket\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717657 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717571 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-token\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717657 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717614 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-podinfo\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717657 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717637 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-data\") pod \"b20dba00-8094-41fb-a109-b02ceea4cd44\" (UID: \"b20dba00-8094-41fb-a109-b02ceea4cd44\") " Jul 09 14:23:38.717910 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717697 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:38.717985 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.717966 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.718190 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.718151 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:38.718291 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.718275 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b20dba00-8094-41fb-a109-b02ceea4cd44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:23:38.718355 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.718317 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:38.718523 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.718487 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-data" (OuterVolumeSpecName: "istio-data") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:38.719707 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.719684 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:38.720355 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.720329 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:23:38.720586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.720564 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-kube-api-access-w2vj8" (OuterVolumeSpecName: "kube-api-access-w2vj8") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "kube-api-access-w2vj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:23:38.720652 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.720592 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-token" (OuterVolumeSpecName: "istio-token") pod "b20dba00-8094-41fb-a109-b02ceea4cd44" (UID: "b20dba00-8094-41fb-a109-b02ceea4cd44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:23:38.818366 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818341 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818366 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818364 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818373 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818380 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818388 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20dba00-8094-41fb-a109-b02ceea4cd44-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818396 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2vj8\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-kube-api-access-w2vj8\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818405 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20dba00-8094-41fb-a109-b02ceea4cd44-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:38.818505 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:38.818413 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20dba00-8094-41fb-a109-b02ceea4cd44-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:39.573956 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.573926 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" event={"ID":"b20dba00-8094-41fb-a109-b02ceea4cd44","Type":"ContainerDied","Data":"62fc9a4943330c228e83ba202886001a054966dac0d1eaab928179ff74fa599b"} Jul 09 14:23:39.574416 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.573933 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr" Jul 09 14:23:39.574416 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.574002 2553 scope.go:117] "RemoveContainer" containerID="5fd5f5ee3c204067c9e65844ded49c3aa4a965d7251ecdaf569b81e7bbf7f943" Jul 09 14:23:39.588971 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.588950 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4"] Jul 09 14:23:39.589371 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.589356 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20dba00-8094-41fb-a109-b02ceea4cd44" containerName="istio-proxy" Jul 09 14:23:39.589421 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.589374 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20dba00-8094-41fb-a109-b02ceea4cd44" containerName="istio-proxy" Jul 09 14:23:39.589457 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.589446 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20dba00-8094-41fb-a109-b02ceea4cd44" containerName="istio-proxy" Jul 09 14:23:39.592653 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.592634 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.595119 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.595087 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0fc73082-openshift-default-dockercfg-g9zph\"" Jul 09 14:23:39.605377 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.605353 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4"] Jul 09 14:23:39.609345 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.609328 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr"] Jul 09 14:23:39.611647 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.611626 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f7f85c0a-gw-openshift-default-5bc966d7bc-bnbpr"] Jul 09 14:23:39.625046 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625020 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-token\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625155 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625047 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-credential-socket\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625155 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625076 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-certs\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625169 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s6g2\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-kube-api-access-2s6g2\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625199 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-data\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625218 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-socket\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625235 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-podinfo\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625449 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625276 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istiod-ca-cert\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.625449 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.625384 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-envoy\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726012 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.725942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s6g2\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-kube-api-access-2s6g2\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726012 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.725976 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-data\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726012 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.725994 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-socket\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726296 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726186 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-podinfo\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726296 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726241 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istiod-ca-cert\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726296 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726294 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-socket\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-envoy\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726358 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-token\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726358 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-data\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726381 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-credential-socket\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726409 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-certs\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726737 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726688 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-credential-socket\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726778 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726741 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-certs\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.726931 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.726907 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istiod-ca-cert\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.728409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.728390 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-envoy\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.728629 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.728611 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-podinfo\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.734868 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.734843 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s6g2\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-kube-api-access-2s6g2\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.734965 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.734876 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-token\") pod \"e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:39.903549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:39.903479 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:40.035511 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.035480 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4"] Jul 09 14:23:40.036669 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:23:40.036641 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bde49e_d5ee_48bc_97d4_96861b7239c4.slice/crio-32ac330bff61d83d7ad446ed1a3c2c84314bb7bc837c4ee0a229e8f44965870e WatchSource:0}: Error finding container 32ac330bff61d83d7ad446ed1a3c2c84314bb7bc837c4ee0a229e8f44965870e: Status 404 returned error can't find the container with id 32ac330bff61d83d7ad446ed1a3c2c84314bb7bc837c4ee0a229e8f44965870e Jul 09 14:23:40.038854 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.038823 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:40.038930 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.038886 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:40.038930 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.038913 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:40.302153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.302099 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20dba00-8094-41fb-a109-b02ceea4cd44" path="/var/lib/kubelet/pods/b20dba00-8094-41fb-a109-b02ceea4cd44/volumes" Jul 09 14:23:40.581266 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.581175 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" event={"ID":"b2bde49e-d5ee-48bc-97d4-96861b7239c4","Type":"ContainerStarted","Data":"e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb"} Jul 09 14:23:40.581266 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.581236 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" event={"ID":"b2bde49e-d5ee-48bc-97d4-96861b7239c4","Type":"ContainerStarted","Data":"32ac330bff61d83d7ad446ed1a3c2c84314bb7bc837c4ee0a229e8f44965870e"} Jul 09 14:23:40.605245 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.605198 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" podStartSLOduration=1.605184461 podStartE2EDuration="1.605184461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:40.603940497 +0000 UTC m=+1520.818166614" watchObservedRunningTime="2026-07-09 14:23:40.605184461 +0000 UTC m=+1520.819410577" Jul 09 14:23:40.904068 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:40.903988 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:41.909233 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:41.909205 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:42.596830 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:42.596738 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:42.597707 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:42.597687 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:51.655549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.655456 2553 generic.go:356] "Generic (PLEG): container finished" podID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerID="e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb" exitCode=0 Jul 09 14:23:51.655890 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.655546 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" event={"ID":"b2bde49e-d5ee-48bc-97d4-96861b7239c4","Type":"ContainerDied","Data":"e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb"} Jul 09 14:23:51.655947 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.655930 2553 scope.go:117] "RemoveContainer" containerID="e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb" Jul 09 14:23:51.657017 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.656985 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:51.657080 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.657062 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:51.657134 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.657102 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:51.978650 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:51.978617 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4"] Jul 09 14:23:52.663276 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:52.663239 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" event={"ID":"b2bde49e-d5ee-48bc-97d4-96861b7239c4","Type":"ContainerStarted","Data":"c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103"} Jul 09 14:23:52.663700 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:52.663302 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" containerID="cri-o://c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103" gracePeriod=30 Jul 09 14:23:57.597567 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.597534 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:57.914460 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.914436 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:57.983087 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983063 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-socket\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983099 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-token\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983147 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istiod-ca-cert\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983163 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-certs\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983188 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-credential-socket\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983205 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-envoy\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983247 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s6g2\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-kube-api-access-2s6g2\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983289 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-podinfo\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983313 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-data\") pod \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\" (UID: \"b2bde49e-d5ee-48bc-97d4-96861b7239c4\") " Jul 09 14:23:57.983576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983396 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:57.983576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983485 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:57.983788 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983563 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:23:57.983788 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983698 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:57.983788 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983716 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:57.983957 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.983801 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:57.984271 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.984245 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:57.985603 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.985579 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:23:57.985764 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.985744 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:23:57.985830 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.985765 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-kube-api-access-2s6g2" (OuterVolumeSpecName: "kube-api-access-2s6g2") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "kube-api-access-2s6g2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:23:57.985830 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:57.985784 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2bde49e-d5ee-48bc-97d4-96861b7239c4" (UID: "b2bde49e-d5ee-48bc-97d4-96861b7239c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:23:58.084072 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084047 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.084072 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084069 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.084236 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084078 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.084236 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084086 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.084236 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084094 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s6g2\" (UniqueName: \"kubernetes.io/projected/b2bde49e-d5ee-48bc-97d4-96861b7239c4-kube-api-access-2s6g2\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.084236 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084103 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.084236 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.084132 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bde49e-d5ee-48bc-97d4-96861b7239c4-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:23:58.233329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.233302 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr"] Jul 09 14:23:58.233695 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.233683 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" Jul 09 14:23:58.233743 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.233696 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" Jul 09 14:23:58.233778 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.233766 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" Jul 09 14:23:58.233778 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.233776 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" Jul 09 14:23:58.236144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.236123 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.238851 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.238830 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-387a3dbb-openshift-default-dockercfg-2czzw\"" Jul 09 14:23:58.250046 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.250025 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr"] Jul 09 14:23:58.286414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286393 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88ae4d45-250d-407e-922e-011a17c236fe-istio-podinfo\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286422 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-data\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286445 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2ht2\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-kube-api-access-d2ht2\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286478 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-envoy\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286516 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-istio-token\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286540 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88ae4d45-250d-407e-922e-011a17c236fe-istiod-ca-cert\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286775 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286611 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-socket\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286775 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286648 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-certs\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.286775 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.286665 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-credential-socket\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387243 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387216 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-certs\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387251 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-credential-socket\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88ae4d45-250d-407e-922e-011a17c236fe-istio-podinfo\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387302 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-data\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387325 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2ht2\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-kube-api-access-d2ht2\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-envoy\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387374 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-istio-token\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387399 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88ae4d45-250d-407e-922e-011a17c236fe-istiod-ca-cert\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387457 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-socket\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387670 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-certs\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387846 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387714 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-credential-socket\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.387981 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387958 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-data\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.388024 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.387997 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-socket\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.388206 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.388187 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88ae4d45-250d-407e-922e-011a17c236fe-istiod-ca-cert\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.389695 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.389667 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-envoy\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.389841 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.389825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88ae4d45-250d-407e-922e-011a17c236fe-istio-podinfo\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.396219 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.396198 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-istio-token\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.396308 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.396262 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2ht2\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-kube-api-access-d2ht2\") pod \"e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.547500 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.547449 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:23:58.682754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.682726 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr"] Jul 09 14:23:58.683687 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:23:58.683659 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ae4d45_250d_407e_922e_011a17c236fe.slice/crio-b2eb2a46e876f8508ee491414494e8176cab9dad14decd04ab4dbd44468e5df3 WatchSource:0}: Error finding container b2eb2a46e876f8508ee491414494e8176cab9dad14decd04ab4dbd44468e5df3: Status 404 returned error can't find the container with id b2eb2a46e876f8508ee491414494e8176cab9dad14decd04ab4dbd44468e5df3 Jul 09 14:23:58.686343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.686306 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:58.686448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.686406 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:58.686508 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.686455 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:23:58.696635 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.696613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" event={"ID":"88ae4d45-250d-407e-922e-011a17c236fe","Type":"ContainerStarted","Data":"b2eb2a46e876f8508ee491414494e8176cab9dad14decd04ab4dbd44468e5df3"} Jul 09 14:23:58.698278 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.698256 2553 generic.go:356] "Generic (PLEG): container finished" podID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerID="c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103" exitCode=0 Jul 09 14:23:58.698384 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.698323 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" Jul 09 14:23:58.698384 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.698347 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" event={"ID":"b2bde49e-d5ee-48bc-97d4-96861b7239c4","Type":"ContainerDied","Data":"c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103"} Jul 09 14:23:58.698500 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.698416 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4" event={"ID":"b2bde49e-d5ee-48bc-97d4-96861b7239c4","Type":"ContainerDied","Data":"32ac330bff61d83d7ad446ed1a3c2c84314bb7bc837c4ee0a229e8f44965870e"} Jul 09 14:23:58.698500 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.698445 2553 scope.go:117] "RemoveContainer" containerID="c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103" Jul 09 14:23:58.711887 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.711872 2553 scope.go:117] "RemoveContainer" containerID="e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb" Jul 09 14:23:58.732117 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.732087 2553 scope.go:117] "RemoveContainer" containerID="c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103" Jul 09 14:23:58.732406 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:23:58.732385 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103\": container with ID starting with c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103 not found: ID does not exist" containerID="c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103" Jul 09 14:23:58.732501 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.732411 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103"} err="failed to get container status \"c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103\": rpc error: code = NotFound desc = could not find container \"c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103\": container with ID starting with c097ea10c10b04d77b5feeb525d8953f25c28ebefd4205719c7684e9418dc103 not found: ID does not exist" Jul 09 14:23:58.732501 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.732428 2553 scope.go:117] "RemoveContainer" containerID="e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb" Jul 09 14:23:58.732674 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:23:58.732657 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb\": container with ID starting with e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb not found: ID does not exist" containerID="e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb" Jul 09 14:23:58.732733 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.732678 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb"} err="failed to get container status \"e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb\": rpc error: code = NotFound desc = could not find container \"e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb\": container with ID starting with e3e47b4416046342258c1d5bc86e1f8ec7d43e907613c323da59e7510144fbeb not found: ID does not exist" Jul 09 14:23:58.742896 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.742878 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4"] Jul 09 14:23:58.747413 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:58.747394 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0fc73082-openshift-default-5d77b6849-p5gd4"] Jul 09 14:23:59.705716 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:59.705682 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" event={"ID":"88ae4d45-250d-407e-922e-011a17c236fe","Type":"ContainerStarted","Data":"f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a"} Jul 09 14:23:59.744788 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:23:59.744744 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" podStartSLOduration=1.744730618 podStartE2EDuration="1.744730618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:59.741994971 +0000 UTC m=+1539.956221088" watchObservedRunningTime="2026-07-09 14:23:59.744730618 +0000 UTC m=+1539.958956734" Jul 09 14:24:00.302674 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:00.302642 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" path="/var/lib/kubelet/pods/b2bde49e-d5ee-48bc-97d4-96861b7239c4/volumes" Jul 09 14:24:00.547887 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:00.547853 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:24:00.552390 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:00.552369 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:24:00.713257 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:00.713233 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:24:00.714065 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:00.714044 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:24:03.956828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:03.956791 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr"] Jul 09 14:24:03.957351 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:03.956980 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" podUID="88ae4d45-250d-407e-922e-011a17c236fe" containerName="istio-proxy" containerID="cri-o://f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a" gracePeriod=30 Jul 09 14:24:09.213457 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.213433 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:24:09.287342 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287283 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-certs\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287350 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-socket\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287378 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88ae4d45-250d-407e-922e-011a17c236fe-istiod-ca-cert\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287397 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-istio-token\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287417 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-credential-socket\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287467 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287452 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2ht2\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-kube-api-access-d2ht2\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287520 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88ae4d45-250d-407e-922e-011a17c236fe-istio-podinfo\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287551 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-data\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287546 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:24:09.287738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287605 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-envoy\") pod \"88ae4d45-250d-407e-922e-011a17c236fe\" (UID: \"88ae4d45-250d-407e-922e-011a17c236fe\") " Jul 09 14:24:09.287738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287700 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:24:09.287980 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287779 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:24:09.287980 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287805 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88ae4d45-250d-407e-922e-011a17c236fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:24:09.287980 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.287855 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:24:09.288170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.288010 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.288170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.288033 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.288170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.288047 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88ae4d45-250d-407e-922e-011a17c236fe-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.288170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.288061 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.288170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.288074 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.289679 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.289645 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88ae4d45-250d-407e-922e-011a17c236fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:24:09.289804 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.289685 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:24:09.289804 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.289743 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:24:09.289804 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.289751 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-kube-api-access-d2ht2" (OuterVolumeSpecName: "kube-api-access-d2ht2") pod "88ae4d45-250d-407e-922e-011a17c236fe" (UID: "88ae4d45-250d-407e-922e-011a17c236fe"). InnerVolumeSpecName "kube-api-access-d2ht2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:24:09.388745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.388721 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.388745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.388743 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2ht2\" (UniqueName: \"kubernetes.io/projected/88ae4d45-250d-407e-922e-011a17c236fe-kube-api-access-d2ht2\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.388882 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.388755 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88ae4d45-250d-407e-922e-011a17c236fe-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.388882 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.388763 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88ae4d45-250d-407e-922e-011a17c236fe-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:24:09.765648 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.765617 2553 generic.go:356] "Generic (PLEG): container finished" podID="88ae4d45-250d-407e-922e-011a17c236fe" containerID="f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a" exitCode=0 Jul 09 14:24:09.765794 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.765653 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" event={"ID":"88ae4d45-250d-407e-922e-011a17c236fe","Type":"ContainerDied","Data":"f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a"} Jul 09 14:24:09.765794 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.765668 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" Jul 09 14:24:09.765794 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.765691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr" event={"ID":"88ae4d45-250d-407e-922e-011a17c236fe","Type":"ContainerDied","Data":"b2eb2a46e876f8508ee491414494e8176cab9dad14decd04ab4dbd44468e5df3"} Jul 09 14:24:09.765794 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.765713 2553 scope.go:117] "RemoveContainer" containerID="f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a" Jul 09 14:24:09.775318 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.775304 2553 scope.go:117] "RemoveContainer" containerID="f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a" Jul 09 14:24:09.775575 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:24:09.775558 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a\": container with ID starting with f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a not found: ID does not exist" containerID="f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a" Jul 09 14:24:09.775629 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.775584 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a"} err="failed to get container status \"f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a\": rpc error: code = NotFound desc = could not find container \"f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a\": container with ID starting with f5a1ec11701e2d1d1e81ff05596a011c30b09b5f85022fc675b109dd8b16d19a not found: ID does not exist" Jul 09 14:24:09.788682 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.788659 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr"] Jul 09 14:24:09.792394 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:09.792374 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-387a3dbb-openshift-default-58db49f54c-vbjqr"] Jul 09 14:24:10.310170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:24:10.310127 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ae4d45-250d-407e-922e-011a17c236fe" path="/var/lib/kubelet/pods/88ae4d45-250d-407e-922e-011a17c236fe/volumes" Jul 09 14:25:45.467609 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.467536 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq"] Jul 09 14:25:45.468060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.467900 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ae4d45-250d-407e-922e-011a17c236fe" containerName="istio-proxy" Jul 09 14:25:45.468060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.467911 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ae4d45-250d-407e-922e-011a17c236fe" containerName="istio-proxy" Jul 09 14:25:45.468060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.467923 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" Jul 09 14:25:45.468060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.467930 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2bde49e-d5ee-48bc-97d4-96861b7239c4" containerName="istio-proxy" Jul 09 14:25:45.468060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.467984 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="88ae4d45-250d-407e-922e-011a17c236fe" containerName="istio-proxy" Jul 09 14:25:45.470447 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.470431 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.473058 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.473041 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a0eef674-openshift-default-dockercfg-rv9sg\"" Jul 09 14:25:45.489833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.489807 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq"] Jul 09 14:25:45.563197 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563155 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-data\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563365 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563220 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq668\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-kube-api-access-nq668\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563365 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563274 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b60bfe5-0712-477a-9839-4ada762b1043-istio-podinfo\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563644 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563617 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-istio-token\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563782 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-credential-socket\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563782 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563778 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-socket\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563801 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-envoy\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563862 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-certs\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.563999 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.563901 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b60bfe5-0712-477a-9839-4ada762b1043-istiod-ca-cert\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664472 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-socket\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664472 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-envoy\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-certs\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664526 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b60bfe5-0712-477a-9839-4ada762b1043-istiod-ca-cert\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664562 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-data\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq668\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-kube-api-access-nq668\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664612 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b60bfe5-0712-477a-9839-4ada762b1043-istio-podinfo\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664909 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664760 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-istio-token\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.664909 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664836 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-credential-socket\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.665016 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.664930 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-certs\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.665083 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.665015 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-socket\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.665201 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.665179 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-data\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.665274 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.665206 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-credential-socket\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.665680 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.665653 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b60bfe5-0712-477a-9839-4ada762b1043-istiod-ca-cert\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.666907 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.666880 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-envoy\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.667094 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.667078 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b60bfe5-0712-477a-9839-4ada762b1043-istio-podinfo\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.672948 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.672929 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-istio-token\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.673159 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.673140 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq668\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-kube-api-access-nq668\") pod \"e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.783910 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.783856 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:45.920696 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.920672 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq"] Jul 09 14:25:45.922800 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:25:45.922775 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b60bfe5_0712_477a_9839_4ada762b1043.slice/crio-11c5cbbe3249ba25a260d36c408e75cf6ce512fc8ad37729dc35f8f7868e5765 WatchSource:0}: Error finding container 11c5cbbe3249ba25a260d36c408e75cf6ce512fc8ad37729dc35f8f7868e5765: Status 404 returned error can't find the container with id 11c5cbbe3249ba25a260d36c408e75cf6ce512fc8ad37729dc35f8f7868e5765 Jul 09 14:25:45.925397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.925368 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:25:45.925465 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.925430 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:25:45.925465 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:45.925461 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:25:46.306039 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:46.306000 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" event={"ID":"5b60bfe5-0712-477a-9839-4ada762b1043","Type":"ContainerStarted","Data":"ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c"} Jul 09 14:25:46.306229 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:46.306057 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" event={"ID":"5b60bfe5-0712-477a-9839-4ada762b1043","Type":"ContainerStarted","Data":"11c5cbbe3249ba25a260d36c408e75cf6ce512fc8ad37729dc35f8f7868e5765"} Jul 09 14:25:46.329290 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:46.329241 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" podStartSLOduration=1.329226788 podStartE2EDuration="1.329226788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:25:46.326519372 +0000 UTC m=+1646.540745500" watchObservedRunningTime="2026-07-09 14:25:46.329226788 +0000 UTC m=+1646.543452903" Jul 09 14:25:46.784334 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:46.784300 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:46.788834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:46.788815 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:47.311947 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:47.311915 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:47.312873 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:47.312848 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:25:59.384369 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:59.384334 2553 generic.go:356] "Generic (PLEG): container finished" podID="5b60bfe5-0712-477a-9839-4ada762b1043" containerID="ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c" exitCode=0 Jul 09 14:25:59.384834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:59.384408 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" event={"ID":"5b60bfe5-0712-477a-9839-4ada762b1043","Type":"ContainerDied","Data":"ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c"} Jul 09 14:25:59.384834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:59.384809 2553 scope.go:117] "RemoveContainer" containerID="ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c" Jul 09 14:25:59.385934 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:59.385897 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:25:59.386064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:59.385991 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:25:59.386064 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:25:59.386047 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:00.391958 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:00.391923 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" event={"ID":"5b60bfe5-0712-477a-9839-4ada762b1043","Type":"ContainerStarted","Data":"e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05"} Jul 09 14:26:00.784777 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:00.784739 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:26:00.786000 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:00.785974 2553 patch_prober.go:28] interesting pod/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 09 14:26:00.786141 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:00.786028 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 09 14:26:01.784876 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:01.784844 2553 patch_prober.go:28] interesting pod/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 09 14:26:01.785319 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:01.784896 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 09 14:26:02.312382 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:02.312354 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:26:02.785009 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:02.784977 2553 patch_prober.go:28] interesting pod/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 09 14:26:02.785396 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:02.785032 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 09 14:26:03.785146 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:03.785094 2553 patch_prober.go:28] interesting pod/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 09 14:26:03.785507 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:03.785166 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 09 14:26:04.788413 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:04.788384 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:26:04.789522 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:04.789502 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:26:06.788023 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:06.787988 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq"] Jul 09 14:26:06.788413 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:06.788221 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" containerID="cri-o://e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05" gracePeriod=30 Jul 09 14:26:12.050513 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.050490 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:26:12.119439 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119383 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-istio-token\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119439 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119414 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-certs\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119477 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-socket\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119504 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq668\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-kube-api-access-nq668\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119545 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b60bfe5-0712-477a-9839-4ada762b1043-istiod-ca-cert\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119608 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119571 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-envoy\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119622 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-data\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119646 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b60bfe5-0712-477a-9839-4ada762b1043-istio-podinfo\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119705 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-credential-socket\") pod \"5b60bfe5-0712-477a-9839-4ada762b1043\" (UID: \"5b60bfe5-0712-477a-9839-4ada762b1043\") " Jul 09 14:26:12.119984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119814 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:26:12.119984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119830 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:26:12.119984 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.119904 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b60bfe5-0712-477a-9839-4ada762b1043-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:26:12.120163 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.120028 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:26:12.120232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.120182 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.120232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.120203 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.120232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.120216 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b60bfe5-0712-477a-9839-4ada762b1043-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.120392 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.120243 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.120634 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.120614 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:26:12.121756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.121734 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b60bfe5-0712-477a-9839-4ada762b1043-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:26:12.121850 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.121794 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-kube-api-access-nq668" (OuterVolumeSpecName: "kube-api-access-nq668") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "kube-api-access-nq668". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:26:12.122021 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.122001 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:26:12.122076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.122003 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b60bfe5-0712-477a-9839-4ada762b1043" (UID: "5b60bfe5-0712-477a-9839-4ada762b1043"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:26:12.220602 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.220579 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.220602 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.220599 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b60bfe5-0712-477a-9839-4ada762b1043-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.220737 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.220608 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.220737 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.220616 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq668\" (UniqueName: \"kubernetes.io/projected/5b60bfe5-0712-477a-9839-4ada762b1043-kube-api-access-nq668\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.220737 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.220625 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b60bfe5-0712-477a-9839-4ada762b1043-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:26:12.463835 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.463805 2553 generic.go:356] "Generic (PLEG): container finished" podID="5b60bfe5-0712-477a-9839-4ada762b1043" containerID="e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05" exitCode=0 Jul 09 14:26:12.463938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.463846 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" event={"ID":"5b60bfe5-0712-477a-9839-4ada762b1043","Type":"ContainerDied","Data":"e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05"} Jul 09 14:26:12.463938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.463908 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" event={"ID":"5b60bfe5-0712-477a-9839-4ada762b1043","Type":"ContainerDied","Data":"11c5cbbe3249ba25a260d36c408e75cf6ce512fc8ad37729dc35f8f7868e5765"} Jul 09 14:26:12.463938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.463933 2553 scope.go:117] "RemoveContainer" containerID="e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05" Jul 09 14:26:12.464074 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.463856 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq" Jul 09 14:26:12.473254 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.473238 2553 scope.go:117] "RemoveContainer" containerID="ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c" Jul 09 14:26:12.481450 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.481433 2553 scope.go:117] "RemoveContainer" containerID="e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05" Jul 09 14:26:12.481745 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:26:12.481722 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05\": container with ID starting with e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05 not found: ID does not exist" containerID="e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05" Jul 09 14:26:12.481799 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.481756 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05"} err="failed to get container status \"e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05\": rpc error: code = NotFound desc = could not find container \"e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05\": container with ID starting with e09aaee451b073e1d835db9481ca78f4b0425dfb9bc3fae5e7486e3b9d8d4c05 not found: ID does not exist" Jul 09 14:26:12.481799 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.481779 2553 scope.go:117] "RemoveContainer" containerID="ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c" Jul 09 14:26:12.482068 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:26:12.482047 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c\": container with ID starting with ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c not found: ID does not exist" containerID="ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c" Jul 09 14:26:12.482137 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.482075 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c"} err="failed to get container status \"ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c\": rpc error: code = NotFound desc = could not find container \"ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c\": container with ID starting with ea4c65bbb58ede28e288bdd34774535a0f4c3bce92fc4bf70e503c7356a6ab9c not found: ID does not exist" Jul 09 14:26:12.482885 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.482867 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq"] Jul 09 14:26:12.491248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:12.491228 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a0eef674-openshift-default-656b96cf67-wlvkq"] Jul 09 14:26:14.301712 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:14.301671 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" path="/var/lib/kubelet/pods/5b60bfe5-0712-477a-9839-4ada762b1043/volumes" Jul 09 14:26:26.569356 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569325 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k"] Jul 09 14:26:26.569745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569693 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" Jul 09 14:26:26.569745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569704 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" Jul 09 14:26:26.569745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569721 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" Jul 09 14:26:26.569745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569727 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" Jul 09 14:26:26.569894 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569789 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" Jul 09 14:26:26.569894 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.569796 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b60bfe5-0712-477a-9839-4ada762b1043" containerName="istio-proxy" Jul 09 14:26:26.572830 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.572810 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.575285 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.575264 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-546e6b43-openshift-default-dockercfg-chfhf\"" Jul 09 14:26:26.585882 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.585851 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k"] Jul 09 14:26:26.636014 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.635994 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-istio-token\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636136 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636023 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-data\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636136 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636044 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f36a257-162a-42f7-b492-28822668f124-istio-podinfo\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636136 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636076 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmwzc\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-kube-api-access-vmwzc\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636191 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-certs\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636248 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-socket\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636292 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-envoy\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636318 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f36a257-162a-42f7-b492-28822668f124-istiod-ca-cert\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.636368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.636345 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-credential-socket\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.736913 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.736884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-istio-token\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.736913 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.736916 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-data\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.736938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f36a257-162a-42f7-b492-28822668f124-istio-podinfo\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.736981 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmwzc\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-kube-api-access-vmwzc\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-certs\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737053 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-socket\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737091 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-envoy\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737166 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737143 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f36a257-162a-42f7-b492-28822668f124-istiod-ca-cert\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737479 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737361 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-data\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737479 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737416 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-credential-socket\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737479 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737459 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-certs\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737490 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-socket\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737782 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737763 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-credential-socket\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.737867 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.737850 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f36a257-162a-42f7-b492-28822668f124-istiod-ca-cert\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.739332 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.739314 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-envoy\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.739555 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.739536 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f36a257-162a-42f7-b492-28822668f124-istio-podinfo\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.747153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.747128 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmwzc\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-kube-api-access-vmwzc\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.747539 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.747515 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-istio-token\") pod \"e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:26.882787 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:26.882723 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:27.015818 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.015795 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k"] Jul 09 14:26:27.017437 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:26:27.017406 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f36a257_162a_42f7_b492_28822668f124.slice/crio-27f8b29db04d0d3ea374ca6d1f0dd653777eb8a025c4b8640655abccb44e0bbc WatchSource:0}: Error finding container 27f8b29db04d0d3ea374ca6d1f0dd653777eb8a025c4b8640655abccb44e0bbc: Status 404 returned error can't find the container with id 27f8b29db04d0d3ea374ca6d1f0dd653777eb8a025c4b8640655abccb44e0bbc Jul 09 14:26:27.019791 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.019747 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:27.019871 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.019851 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:27.019929 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.019906 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:27.550379 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.550344 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" event={"ID":"2f36a257-162a-42f7-b492-28822668f124","Type":"ContainerStarted","Data":"5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4"} Jul 09 14:26:27.550542 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.550398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" event={"ID":"2f36a257-162a-42f7-b492-28822668f124","Type":"ContainerStarted","Data":"27f8b29db04d0d3ea374ca6d1f0dd653777eb8a025c4b8640655abccb44e0bbc"} Jul 09 14:26:27.575084 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.575032 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podStartSLOduration=1.575017084 podStartE2EDuration="1.575017084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:26:27.57204387 +0000 UTC m=+1687.786269987" watchObservedRunningTime="2026-07-09 14:26:27.575017084 +0000 UTC m=+1687.789243199" Jul 09 14:26:27.883567 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:27.883491 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:28.888888 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:28.888859 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:29.561097 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:29.561064 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:29.561916 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:29.561897 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:43.637879 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:43.637841 2553 generic.go:356] "Generic (PLEG): container finished" podID="2f36a257-162a-42f7-b492-28822668f124" containerID="5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4" exitCode=0 Jul 09 14:26:43.638355 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:43.637913 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" event={"ID":"2f36a257-162a-42f7-b492-28822668f124","Type":"ContainerDied","Data":"5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4"} Jul 09 14:26:43.638355 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:43.638334 2553 scope.go:117] "RemoveContainer" containerID="5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4" Jul 09 14:26:43.639386 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:43.639358 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:43.639468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:43.639421 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:43.639468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:43.639452 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:26:44.561949 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:44.561921 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:44.645070 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:44.645039 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" event={"ID":"2f36a257-162a-42f7-b492-28822668f124","Type":"ContainerStarted","Data":"ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192"} Jul 09 14:26:44.883079 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:44.882976 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:44.884342 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:44.884312 2553 patch_prober.go:28] interesting pod/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 09 14:26:44.884490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:44.884363 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 09 14:26:45.884069 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:45.884032 2553 patch_prober.go:28] interesting pod/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 09 14:26:45.884441 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:45.884089 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 09 14:26:46.883024 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:46.882987 2553 patch_prober.go:28] interesting pod/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 09 14:26:46.883245 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:46.883037 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 09 14:26:47.883552 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:47.883512 2553 patch_prober.go:28] interesting pod/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 09 14:26:47.884002 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:47.883574 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 09 14:26:48.921906 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:48.921862 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:48.922383 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:48.922281 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:26:48.923081 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:26:48.923059 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:28:01.397191 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:01.397159 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k"] Jul 09 14:28:01.397593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:01.397430 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" containerID="cri-o://ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192" gracePeriod=30 Jul 09 14:28:03.924558 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:03.924518 2553 patch_prober.go:28] interesting pod/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 14:28:03.925004 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:03.924582 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:28:06.640491 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.640468 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:28:06.757145 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757124 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-certs\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757184 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmwzc\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-kube-api-access-vmwzc\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757217 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-istio-token\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757237 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-socket\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757257 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-envoy\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757292 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-data\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757348 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f36a257-162a-42f7-b492-28822668f124-istiod-ca-cert\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757394 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f36a257-162a-42f7-b492-28822668f124-istio-podinfo\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757399 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:06.757581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757418 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-credential-socket\") pod \"2f36a257-162a-42f7-b492-28822668f124\" (UID: \"2f36a257-162a-42f7-b492-28822668f124\") " Jul 09 14:28:06.757581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757558 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:06.757833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757740 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f36a257-162a-42f7-b492-28822668f124-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:28:06.757833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757750 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.757833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757771 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.757833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.757775 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:06.758396 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.758361 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:06.759552 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.759520 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-kube-api-access-vmwzc" (OuterVolumeSpecName: "kube-api-access-vmwzc") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "kube-api-access-vmwzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:28:06.759654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.759549 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:28:06.759654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.759599 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:28:06.759728 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.759667 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f36a257-162a-42f7-b492-28822668f124-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f36a257-162a-42f7-b492-28822668f124" (UID: "2f36a257-162a-42f7-b492-28822668f124"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:28:06.858208 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858185 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f36a257-162a-42f7-b492-28822668f124-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.858208 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858206 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f36a257-162a-42f7-b492-28822668f124-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.858329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858215 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.858329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858225 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmwzc\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-kube-api-access-vmwzc\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.858329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858236 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f36a257-162a-42f7-b492-28822668f124-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.858329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858251 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:06.858329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:06.858259 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f36a257-162a-42f7-b492-28822668f124-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:28:07.116881 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.116816 2553 generic.go:356] "Generic (PLEG): container finished" podID="2f36a257-162a-42f7-b492-28822668f124" containerID="ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192" exitCode=0 Jul 09 14:28:07.116881 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.116874 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" Jul 09 14:28:07.116997 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.116905 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" event={"ID":"2f36a257-162a-42f7-b492-28822668f124","Type":"ContainerDied","Data":"ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192"} Jul 09 14:28:07.116997 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.116982 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k" event={"ID":"2f36a257-162a-42f7-b492-28822668f124","Type":"ContainerDied","Data":"27f8b29db04d0d3ea374ca6d1f0dd653777eb8a025c4b8640655abccb44e0bbc"} Jul 09 14:28:07.117103 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.117005 2553 scope.go:117] "RemoveContainer" containerID="ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192" Jul 09 14:28:07.126547 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.126533 2553 scope.go:117] "RemoveContainer" containerID="5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4" Jul 09 14:28:07.134593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.134578 2553 scope.go:117] "RemoveContainer" containerID="ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192" Jul 09 14:28:07.134827 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:28:07.134809 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192\": container with ID starting with ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192 not found: ID does not exist" containerID="ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192" Jul 09 14:28:07.134874 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.134842 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192"} err="failed to get container status \"ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192\": rpc error: code = NotFound desc = could not find container \"ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192\": container with ID starting with ac8720fedb86ed15387cdbe322ebf270e874aa7945abf54e0e66fdfaf9e0a192 not found: ID does not exist" Jul 09 14:28:07.134874 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.134863 2553 scope.go:117] "RemoveContainer" containerID="5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4" Jul 09 14:28:07.135041 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:28:07.135025 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4\": container with ID starting with 5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4 not found: ID does not exist" containerID="5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4" Jul 09 14:28:07.135095 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.135047 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4"} err="failed to get container status \"5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4\": rpc error: code = NotFound desc = could not find container \"5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4\": container with ID starting with 5ccf14bc8279ccfb95626cf5e2b69050d17e3956401bee6fad18e507f76ebda4 not found: ID does not exist" Jul 09 14:28:07.140023 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.140000 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k"] Jul 09 14:28:07.144069 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:07.144051 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-546e6b43-openshift-default-5ff64789bc-xh96k"] Jul 09 14:28:08.301517 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:08.301475 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f36a257-162a-42f7-b492-28822668f124" path="/var/lib/kubelet/pods/2f36a257-162a-42f7-b492-28822668f124/volumes" Jul 09 14:28:20.390056 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:20.390028 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:28:20.397832 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:20.397811 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:28:56.965228 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.965199 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq"] Jul 09 14:28:56.965654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.965557 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" Jul 09 14:28:56.965654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.965567 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" Jul 09 14:28:56.965654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.965641 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" Jul 09 14:28:56.965654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.965649 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" Jul 09 14:28:56.968950 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.968933 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:56.972672 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.972651 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a8a58b-openshift-default-dockercfg-gbrmw\"" Jul 09 14:28:56.983813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:56.983793 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq"] Jul 09 14:28:57.061350 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6d4t\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-kube-api-access-g6d4t\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061358 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-socket\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061468 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061389 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-data\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061472 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-credential-socket\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061514 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-certs\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061544 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-envoy\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061568 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d193f707-8ff8-4dba-b2d4-c2e738b67967-istiod-ca-cert\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061787 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061608 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-podinfo\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.061787 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.061665 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-token\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162700 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-data\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162738 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-credential-socket\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162961 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162755 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-certs\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162961 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162779 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-envoy\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162961 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d193f707-8ff8-4dba-b2d4-c2e738b67967-istiod-ca-cert\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162961 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162848 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-podinfo\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.162961 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162904 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-token\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.162983 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6d4t\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-kube-api-access-g6d4t\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.163010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-socket\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163349 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.163246 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-data\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163349 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.163317 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-credential-socket\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163349 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.163332 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-socket\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.163574 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-certs\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.163710 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.163621 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d193f707-8ff8-4dba-b2d4-c2e738b67967-istiod-ca-cert\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.165195 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.165175 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-envoy\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.165318 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.165300 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-podinfo\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.172758 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.172731 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6d4t\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-kube-api-access-g6d4t\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.172838 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.172785 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-token\") pod \"e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.278770 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.278718 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:57.415989 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.415960 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq"] Jul 09 14:28:57.416913 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:28:57.416890 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd193f707_8ff8_4dba_b2d4_c2e738b67967.slice/crio-1c6ee9338c61adcb28fdd80309ac7839246c3e8b42afa173d5275fcb82da665f WatchSource:0}: Error finding container 1c6ee9338c61adcb28fdd80309ac7839246c3e8b42afa173d5275fcb82da665f: Status 404 returned error can't find the container with id 1c6ee9338c61adcb28fdd80309ac7839246c3e8b42afa173d5275fcb82da665f Jul 09 14:28:57.418947 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.418909 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:28:57.419062 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.418970 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:28:57.419062 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:57.419001 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:28:58.414621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:58.414587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" event={"ID":"d193f707-8ff8-4dba-b2d4-c2e738b67967","Type":"ContainerStarted","Data":"c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57"} Jul 09 14:28:58.415016 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:58.414639 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" event={"ID":"d193f707-8ff8-4dba-b2d4-c2e738b67967","Type":"ContainerStarted","Data":"1c6ee9338c61adcb28fdd80309ac7839246c3e8b42afa173d5275fcb82da665f"} Jul 09 14:28:58.437094 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:58.437046 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podStartSLOduration=2.43702928 podStartE2EDuration="2.43702928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:28:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:28:58.434472612 +0000 UTC m=+1838.648698755" watchObservedRunningTime="2026-07-09 14:28:58.43702928 +0000 UTC m=+1838.651255395" Jul 09 14:28:59.279198 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:59.279156 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:59.283995 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:59.283965 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:59.420325 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:59.420301 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:28:59.421043 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:28:59.421026 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:29:05.562275 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.562246 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6"] Jul 09 14:29:05.562738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.562682 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" Jul 09 14:29:05.562738 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.562696 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f36a257-162a-42f7-b492-28822668f124" containerName="istio-proxy" Jul 09 14:29:05.566347 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.566326 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.569802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.569781 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e75e34-openshift-default-dockercfg-ctrjl\"" Jul 09 14:29:05.579839 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.579741 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6"] Jul 09 14:29:05.733297 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733263 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-socket\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733459 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733317 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-token\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733459 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733344 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shww\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-kube-api-access-5shww\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733459 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733411 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-envoy\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733562 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733462 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-certs\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733562 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733478 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istiod-ca-cert\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733562 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733505 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-podinfo\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-data\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.733660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.733598 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-credential-socket\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.834656 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.834590 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-certs\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.834656 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.834616 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istiod-ca-cert\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.834656 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.834641 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-podinfo\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.834929 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.834907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-data\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.834996 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.834951 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-certs\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.834996 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.834958 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-credential-socket\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835138 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835023 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-socket\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835138 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835078 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-token\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835253 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835144 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5shww\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-kube-api-access-5shww\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835253 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835185 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-credential-socket\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835253 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835199 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-envoy\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835430 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835407 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istiod-ca-cert\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835492 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835409 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-socket\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.835569 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.835487 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-data\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.837244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.837218 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-podinfo\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.837333 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.837257 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-envoy\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.847585 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.847560 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-token\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.847944 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.847918 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shww\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-kube-api-access-5shww\") pod \"e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:05.877919 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:05.877895 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:06.014953 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.014927 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6"] Jul 09 14:29:06.016085 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:29:06.016059 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3fe5e8_3e6c_47ed_9e90_69aa5f9097a8.slice/crio-7ba1dc1b165c77778158f98068d1aae66329afd52b6423908bb57694ea04cf6b WatchSource:0}: Error finding container 7ba1dc1b165c77778158f98068d1aae66329afd52b6423908bb57694ea04cf6b: Status 404 returned error can't find the container with id 7ba1dc1b165c77778158f98068d1aae66329afd52b6423908bb57694ea04cf6b Jul 09 14:29:06.018240 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.018205 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:06.018304 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.018273 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:06.018348 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.018301 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:06.459849 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.459812 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" event={"ID":"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8","Type":"ContainerStarted","Data":"aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2"} Jul 09 14:29:06.460040 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.459879 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" event={"ID":"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8","Type":"ContainerStarted","Data":"7ba1dc1b165c77778158f98068d1aae66329afd52b6423908bb57694ea04cf6b"} Jul 09 14:29:06.482960 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.482910 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podStartSLOduration=1.482893722 podStartE2EDuration="1.482893722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:29:06.480780959 +0000 UTC m=+1846.695007077" watchObservedRunningTime="2026-07-09 14:29:06.482893722 +0000 UTC m=+1846.697119838" Jul 09 14:29:06.878396 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:06.878323 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:07.883802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:07.883774 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:08.470011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:08.469979 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:08.470818 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:08.470799 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:15.462335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:15.462289 2553 patch_prober.go:28] interesting pod/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 14:29:15.462714 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:15.462366 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 14:29:16.518971 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:16.518895 2553 generic.go:356] "Generic (PLEG): container finished" podID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerID="c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57" exitCode=0 Jul 09 14:29:16.519464 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:16.518971 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" event={"ID":"d193f707-8ff8-4dba-b2d4-c2e738b67967","Type":"ContainerDied","Data":"c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57"} Jul 09 14:29:16.519532 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:16.519462 2553 scope.go:117] "RemoveContainer" containerID="c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57" Jul 09 14:29:16.520842 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:16.520775 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:16.520938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:16.520863 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:16.520938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:16.520907 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:17.530549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:17.530502 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" event={"ID":"d193f707-8ff8-4dba-b2d4-c2e738b67967","Type":"ContainerStarted","Data":"9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae"} Jul 09 14:29:18.279692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:18.279654 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:29:18.279891 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:18.279869 2553 patch_prober.go:28] interesting pod/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 09 14:29:18.279948 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:18.279933 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 09 14:29:19.279191 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:19.279152 2553 patch_prober.go:28] interesting pod/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 09 14:29:19.279587 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:19.279203 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 09 14:29:20.279928 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:20.279893 2553 patch_prober.go:28] interesting pod/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 09 14:29:20.280367 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:20.279946 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 09 14:29:21.279361 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:21.279320 2553 patch_prober.go:28] interesting pod/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 09 14:29:21.279566 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:21.279397 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 09 14:29:22.283007 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:22.282976 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:29:22.283475 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:22.283450 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:29:22.284188 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:22.284168 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:29:23.471441 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.471402 2553 patch_prober.go:28] interesting pod/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 09 14:29:23.471857 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.471470 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 09 14:29:23.575017 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.574970 2553 generic.go:356] "Generic (PLEG): container finished" podID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerID="aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2" exitCode=0 Jul 09 14:29:23.575204 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.575048 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" event={"ID":"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8","Type":"ContainerDied","Data":"aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2"} Jul 09 14:29:23.575458 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.575440 2553 scope.go:117] "RemoveContainer" containerID="aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2" Jul 09 14:29:23.576518 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.576488 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:23.576612 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.576568 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:23.576612 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:23.576603 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:29:24.582811 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:24.582780 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" event={"ID":"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8","Type":"ContainerStarted","Data":"1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f"} Jul 09 14:29:24.878079 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:24.877988 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:24.878344 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:24.878321 2553 patch_prober.go:28] interesting pod/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 09 14:29:24.878390 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:24.878370 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 09 14:29:25.878734 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:25.878704 2553 patch_prober.go:28] interesting pod/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 09 14:29:25.879140 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:25.878755 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 09 14:29:26.878959 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:26.878914 2553 patch_prober.go:28] interesting pod/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 09 14:29:26.879346 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:26.878979 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 09 14:29:27.878718 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:27.878686 2553 patch_prober.go:28] interesting pod/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 09 14:29:27.878883 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:27.878742 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 09 14:29:28.881788 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:28.881757 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:28.882183 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:28.882124 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:29:28.882779 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:29:28.882764 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:30:00.142316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.142279 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf"] Jul 09 14:30:00.146251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.146227 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:30:00.146251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.146238 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d"] Jul 09 14:30:00.149740 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.149718 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5r4q9\"" Jul 09 14:30:00.149976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.149959 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 14:30:00.150279 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.150263 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl"] Jul 09 14:30:00.150421 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.150397 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:30:00.150913 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.150890 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 14:30:00.153885 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.153862 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:00.158307 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.158282 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf"] Jul 09 14:30:00.161279 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.161258 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl"] Jul 09 14:30:00.176297 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.176273 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d"] Jul 09 14:30:00.322733 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.322704 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cssm9\" (UniqueName: \"kubernetes.io/projected/92e33e5e-9b29-4009-b253-7f743e0141bf-kube-api-access-cssm9\") pod \"maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf\" (UID: \"92e33e5e-9b29-4009-b253-7f743e0141bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:30:00.322866 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.322765 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff9l6\" (UniqueName: \"kubernetes.io/projected/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3-kube-api-access-ff9l6\") pod \"maas-api-key-cleanup-29726790-brb4d\" (UID: \"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:30:00.322866 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.322846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngqc\" (UniqueName: \"kubernetes.io/projected/a574535c-98b0-45e2-af8e-0ee54ae90412-kube-api-access-4ngqc\") pod \"maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl\" (UID: \"a574535c-98b0-45e2-af8e-0ee54ae90412\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:00.423665 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.423642 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff9l6\" (UniqueName: \"kubernetes.io/projected/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3-kube-api-access-ff9l6\") pod \"maas-api-key-cleanup-29726790-brb4d\" (UID: \"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:30:00.423767 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.423732 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngqc\" (UniqueName: \"kubernetes.io/projected/a574535c-98b0-45e2-af8e-0ee54ae90412-kube-api-access-4ngqc\") pod \"maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl\" (UID: \"a574535c-98b0-45e2-af8e-0ee54ae90412\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:00.423820 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.423777 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cssm9\" (UniqueName: \"kubernetes.io/projected/92e33e5e-9b29-4009-b253-7f743e0141bf-kube-api-access-cssm9\") pod \"maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf\" (UID: \"92e33e5e-9b29-4009-b253-7f743e0141bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:30:00.432317 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.432293 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngqc\" (UniqueName: \"kubernetes.io/projected/a574535c-98b0-45e2-af8e-0ee54ae90412-kube-api-access-4ngqc\") pod \"maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl\" (UID: \"a574535c-98b0-45e2-af8e-0ee54ae90412\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:00.432434 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.432339 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cssm9\" (UniqueName: \"kubernetes.io/projected/92e33e5e-9b29-4009-b253-7f743e0141bf-kube-api-access-cssm9\") pod \"maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf\" (UID: \"92e33e5e-9b29-4009-b253-7f743e0141bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:30:00.432434 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.432381 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff9l6\" (UniqueName: \"kubernetes.io/projected/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3-kube-api-access-ff9l6\") pod \"maas-api-key-cleanup-29726790-brb4d\" (UID: \"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:30:00.459181 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.459159 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:30:00.470193 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.470029 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:30:00.476841 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.476817 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:00.611878 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.611849 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf"] Jul 09 14:30:00.613932 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:30:00.613894 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e33e5e_9b29_4009_b253_7f743e0141bf.slice/crio-38d53dfe25d1f6b87e7918f891921aa6e2755ecda6ce8c702626db1d154c4f23 WatchSource:0}: Error finding container 38d53dfe25d1f6b87e7918f891921aa6e2755ecda6ce8c702626db1d154c4f23: Status 404 returned error can't find the container with id 38d53dfe25d1f6b87e7918f891921aa6e2755ecda6ce8c702626db1d154c4f23 Jul 09 14:30:00.788078 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.787994 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" event={"ID":"92e33e5e-9b29-4009-b253-7f743e0141bf","Type":"ContainerStarted","Data":"38d53dfe25d1f6b87e7918f891921aa6e2755ecda6ce8c702626db1d154c4f23"} Jul 09 14:30:00.850790 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.850762 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl"] Jul 09 14:30:00.851557 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:30:00.851480 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda574535c_98b0_45e2_af8e_0ee54ae90412.slice/crio-8049b82dc26d96a87199365dcaf1729b86e68837861b662df7ca17bd329566df WatchSource:0}: Error finding container 8049b82dc26d96a87199365dcaf1729b86e68837861b662df7ca17bd329566df: Status 404 returned error can't find the container with id 8049b82dc26d96a87199365dcaf1729b86e68837861b662df7ca17bd329566df Jul 09 14:30:00.854280 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:00.854259 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d"] Jul 09 14:30:00.856326 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:30:00.856303 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbb53a8_b5a6_4d90_9d64_6c70d081b4e3.slice/crio-c4b1a4815f21f66ef76e7cdbe98e948ef269cf1a91c0b42502c235615a158f14 WatchSource:0}: Error finding container c4b1a4815f21f66ef76e7cdbe98e948ef269cf1a91c0b42502c235615a158f14: Status 404 returned error can't find the container with id c4b1a4815f21f66ef76e7cdbe98e948ef269cf1a91c0b42502c235615a158f14 Jul 09 14:30:01.796130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.796071 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" event={"ID":"a574535c-98b0-45e2-af8e-0ee54ae90412","Type":"ContainerStarted","Data":"2b38e15f3fa5acb9678a41f2f19740ab7e704d38d33116e306ff16a01498ad80"} Jul 09 14:30:01.796593 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.796153 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" event={"ID":"a574535c-98b0-45e2-af8e-0ee54ae90412","Type":"ContainerStarted","Data":"8049b82dc26d96a87199365dcaf1729b86e68837861b662df7ca17bd329566df"} Jul 09 14:30:01.797920 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.797891 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" event={"ID":"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3","Type":"ContainerStarted","Data":"c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5"} Jul 09 14:30:01.798006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.797956 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" event={"ID":"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3","Type":"ContainerStarted","Data":"c4b1a4815f21f66ef76e7cdbe98e948ef269cf1a91c0b42502c235615a158f14"} Jul 09 14:30:01.799601 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.799575 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" event={"ID":"92e33e5e-9b29-4009-b253-7f743e0141bf","Type":"ContainerStarted","Data":"53963f9521c610995349f8e5a65f6a10748c562bf6e271f52968699ddb29b641"} Jul 09 14:30:01.815084 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.815035 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" podStartSLOduration=1.815021449 podStartE2EDuration="1.815021449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:01.812466338 +0000 UTC m=+1902.026692468" watchObservedRunningTime="2026-07-09 14:30:01.815021449 +0000 UTC m=+1902.029247564" Jul 09 14:30:01.840655 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.840616 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" podStartSLOduration=1.8406040190000001 podStartE2EDuration="1.840604019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:01.838315908 +0000 UTC m=+1902.052542024" watchObservedRunningTime="2026-07-09 14:30:01.840604019 +0000 UTC m=+1902.054830167" Jul 09 14:30:01.861065 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:01.861017 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" podStartSLOduration=1.861002751 podStartE2EDuration="1.861002751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:01.857777665 +0000 UTC m=+1902.072003799" watchObservedRunningTime="2026-07-09 14:30:01.861002751 +0000 UTC m=+1902.075228868" Jul 09 14:30:13.848220 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:13.848181 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl"] Jul 09 14:30:13.848642 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:13.848371 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" podUID="a574535c-98b0-45e2-af8e-0ee54ae90412" containerName="cleanup" containerID="cri-o://2b38e15f3fa5acb9678a41f2f19740ab7e704d38d33116e306ff16a01498ad80" gracePeriod=30 Jul 09 14:30:44.039140 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.039084 2553 generic.go:356] "Generic (PLEG): container finished" podID="a574535c-98b0-45e2-af8e-0ee54ae90412" containerID="2b38e15f3fa5acb9678a41f2f19740ab7e704d38d33116e306ff16a01498ad80" exitCode=137 Jul 09 14:30:44.039479 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.039138 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" event={"ID":"a574535c-98b0-45e2-af8e-0ee54ae90412","Type":"ContainerDied","Data":"2b38e15f3fa5acb9678a41f2f19740ab7e704d38d33116e306ff16a01498ad80"} Jul 09 14:30:44.039479 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.039193 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" event={"ID":"a574535c-98b0-45e2-af8e-0ee54ae90412","Type":"ContainerDied","Data":"8049b82dc26d96a87199365dcaf1729b86e68837861b662df7ca17bd329566df"} Jul 09 14:30:44.039479 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.039214 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8049b82dc26d96a87199365dcaf1729b86e68837861b662df7ca17bd329566df" Jul 09 14:30:44.044838 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.044818 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:44.203353 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.203328 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ngqc\" (UniqueName: \"kubernetes.io/projected/a574535c-98b0-45e2-af8e-0ee54ae90412-kube-api-access-4ngqc\") pod \"a574535c-98b0-45e2-af8e-0ee54ae90412\" (UID: \"a574535c-98b0-45e2-af8e-0ee54ae90412\") " Jul 09 14:30:44.205348 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.205324 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a574535c-98b0-45e2-af8e-0ee54ae90412-kube-api-access-4ngqc" (OuterVolumeSpecName: "kube-api-access-4ngqc") pod "a574535c-98b0-45e2-af8e-0ee54ae90412" (UID: "a574535c-98b0-45e2-af8e-0ee54ae90412"). InnerVolumeSpecName "kube-api-access-4ngqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:30:44.304071 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:44.304040 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ngqc\" (UniqueName: \"kubernetes.io/projected/a574535c-98b0-45e2-af8e-0ee54ae90412-kube-api-access-4ngqc\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:30:45.045536 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:45.045505 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl" Jul 09 14:30:45.064276 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:45.064243 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl"] Jul 09 14:30:45.068046 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:45.068020 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a8a58b-29726790-d8wtl"] Jul 09 14:30:46.301704 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:46.301668 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a574535c-98b0-45e2-af8e-0ee54ae90412" path="/var/lib/kubelet/pods/a574535c-98b0-45e2-af8e-0ee54ae90412/volumes" Jul 09 14:30:55.831129 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:55.831037 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq"] Jul 09 14:30:55.831525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:55.831258 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" containerID="cri-o://9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae" gracePeriod=30 Jul 09 14:30:57.073002 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:57.072960 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf"] Jul 09 14:30:57.073489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:30:57.073231 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" podUID="92e33e5e-9b29-4009-b253-7f743e0141bf" containerName="cleanup" containerID="cri-o://53963f9521c610995349f8e5a65f6a10748c562bf6e271f52968699ddb29b641" gracePeriod=30 Jul 09 14:31:00.012475 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:00.012435 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d"] Jul 09 14:31:00.012954 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:00.012712 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" podUID="2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" containerName="cleanup" containerID="cri-o://c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5" gracePeriod=30 Jul 09 14:31:01.093946 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.093881 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:31:01.143098 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.143065 2553 generic.go:356] "Generic (PLEG): container finished" podID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerID="9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae" exitCode=0 Jul 09 14:31:01.143258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.143126 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" Jul 09 14:31:01.143258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.143146 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" event={"ID":"d193f707-8ff8-4dba-b2d4-c2e738b67967","Type":"ContainerDied","Data":"9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae"} Jul 09 14:31:01.143258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.143208 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq" event={"ID":"d193f707-8ff8-4dba-b2d4-c2e738b67967","Type":"ContainerDied","Data":"1c6ee9338c61adcb28fdd80309ac7839246c3e8b42afa173d5275fcb82da665f"} Jul 09 14:31:01.143258 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.143239 2553 scope.go:117] "RemoveContainer" containerID="9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae" Jul 09 14:31:01.152244 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.152232 2553 scope.go:117] "RemoveContainer" containerID="c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57" Jul 09 14:31:01.160253 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.160232 2553 scope.go:117] "RemoveContainer" containerID="9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae" Jul 09 14:31:01.160497 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:01.160479 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae\": container with ID starting with 9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae not found: ID does not exist" containerID="9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae" Jul 09 14:31:01.160549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.160508 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae"} err="failed to get container status \"9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae\": rpc error: code = NotFound desc = could not find container \"9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae\": container with ID starting with 9f5a52233ab1f933dfe984e75212f426b6895850c52d18098461c313666a10ae not found: ID does not exist" Jul 09 14:31:01.160549 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.160525 2553 scope.go:117] "RemoveContainer" containerID="c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57" Jul 09 14:31:01.160744 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:01.160726 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57\": container with ID starting with c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57 not found: ID does not exist" containerID="c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57" Jul 09 14:31:01.160782 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.160748 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57"} err="failed to get container status \"c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57\": rpc error: code = NotFound desc = could not find container \"c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57\": container with ID starting with c66f72b9a8b5fb3e982e308e9c326a189a32f94b1a7af54ed4b1b62505de9c57 not found: ID does not exist" Jul 09 14:31:01.241380 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241359 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-socket\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241471 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241384 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-data\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241471 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241412 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-credential-socket\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241471 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241452 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-certs\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241492 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-podinfo\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241533 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-token\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241574 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d193f707-8ff8-4dba-b2d4-c2e738b67967-istiod-ca-cert\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241602 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6d4t\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-kube-api-access-g6d4t\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241641 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-envoy\") pod \"d193f707-8ff8-4dba-b2d4-c2e738b67967\" (UID: \"d193f707-8ff8-4dba-b2d4-c2e738b67967\") " Jul 09 14:31:01.241828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241668 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:01.241828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241775 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:01.241828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.241788 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:01.242046 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.242003 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d193f707-8ff8-4dba-b2d4-c2e738b67967-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:31:01.242046 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.242023 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.242046 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.242043 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.242248 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.242057 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.242300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.242281 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-data" (OuterVolumeSpecName: "istio-data") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:01.243717 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.243690 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:31:01.243831 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.243812 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:01.243890 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.243817 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-token" (OuterVolumeSpecName: "istio-token") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:01.243890 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.243868 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-kube-api-access-g6d4t" (OuterVolumeSpecName: "kube-api-access-g6d4t") pod "d193f707-8ff8-4dba-b2d4-c2e738b67967" (UID: "d193f707-8ff8-4dba-b2d4-c2e738b67967"). InnerVolumeSpecName "kube-api-access-g6d4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:01.342864 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.342842 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.342864 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.342863 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.342992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.342871 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d193f707-8ff8-4dba-b2d4-c2e738b67967-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.342992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.342879 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6d4t\" (UniqueName: \"kubernetes.io/projected/d193f707-8ff8-4dba-b2d4-c2e738b67967-kube-api-access-g6d4t\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.342992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.342888 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.342992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.342896 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d193f707-8ff8-4dba-b2d4-c2e738b67967-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:01.468076 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.468051 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq"] Jul 09 14:31:01.470503 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:01.470476 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a8a58b-openshift-default-8985ff687-sb2zq"] Jul 09 14:31:02.302519 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:02.302485 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" path="/var/lib/kubelet/pods/d193f707-8ff8-4dba-b2d4-c2e738b67967/volumes" Jul 09 14:31:03.109660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:03.109623 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6"] Jul 09 14:31:03.109908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:03.109883 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" containerID="cri-o://1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f" gracePeriod=30 Jul 09 14:31:04.065918 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.065882 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl"] Jul 09 14:31:04.066484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066462 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" Jul 09 14:31:04.066484 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066482 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" Jul 09 14:31:04.066653 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066495 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a574535c-98b0-45e2-af8e-0ee54ae90412" containerName="cleanup" Jul 09 14:31:04.066653 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066501 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a574535c-98b0-45e2-af8e-0ee54ae90412" containerName="cleanup" Jul 09 14:31:04.066653 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066555 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a574535c-98b0-45e2-af8e-0ee54ae90412" containerName="cleanup" Jul 09 14:31:04.066653 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066563 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" Jul 09 14:31:04.066653 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.066572 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" Jul 09 14:31:04.071361 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.071343 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.076071 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.076050 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-eeeac1-openshift-default-dockercfg-b44cp\"" Jul 09 14:31:04.085384 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.085356 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl"] Jul 09 14:31:04.267749 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267712 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-socket\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.267749 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267749 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-istio-token\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.267979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267773 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-certs\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.267979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267860 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5897b6c2-7543-42a9-ab88-275bba682f28-istio-podinfo\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.267979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267886 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsw6w\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-kube-api-access-tsw6w\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.267979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267910 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-envoy\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.268154 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.267975 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-data\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.268154 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.268001 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5897b6c2-7543-42a9-ab88-275bba682f28-istiod-ca-cert\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.268154 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.268073 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-credential-socket\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368697 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368625 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-socket\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368697 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368660 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-istio-token\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368697 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368689 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-certs\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368875 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5897b6c2-7543-42a9-ab88-275bba682f28-istio-podinfo\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368904 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsw6w\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-kube-api-access-tsw6w\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368993 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-envoy\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.368993 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.368972 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-data\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369000 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5897b6c2-7543-42a9-ab88-275bba682f28-istiod-ca-cert\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369061 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-certs\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369084 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-socket\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369096 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-credential-socket\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369425 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369405 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-data\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369452 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-credential-socket\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.369654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.369637 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5897b6c2-7543-42a9-ab88-275bba682f28-istiod-ca-cert\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.371277 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.371230 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-envoy\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.371424 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.371409 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5897b6c2-7543-42a9-ab88-275bba682f28-istio-podinfo\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.377292 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.377260 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsw6w\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-kube-api-access-tsw6w\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.377409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.377392 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-istio-token\") pod \"e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.381380 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.381361 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:04.523254 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.523223 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl"] Jul 09 14:31:04.523704 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:31:04.523673 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5897b6c2_7543_42a9_ab88_275bba682f28.slice/crio-93dccc9a568efc35a2b8ebdb0c0678198a1d22af7b1a233185f79337c5bac815 WatchSource:0}: Error finding container 93dccc9a568efc35a2b8ebdb0c0678198a1d22af7b1a233185f79337c5bac815: Status 404 returned error can't find the container with id 93dccc9a568efc35a2b8ebdb0c0678198a1d22af7b1a233185f79337c5bac815 Jul 09 14:31:04.525903 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.525873 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:04.526013 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.525938 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:04.526013 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:04.525968 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:05.168888 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:05.168855 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" event={"ID":"5897b6c2-7543-42a9-ab88-275bba682f28","Type":"ContainerStarted","Data":"4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e"} Jul 09 14:31:05.169247 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:05.168912 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" event={"ID":"5897b6c2-7543-42a9-ab88-275bba682f28","Type":"ContainerStarted","Data":"93dccc9a568efc35a2b8ebdb0c0678198a1d22af7b1a233185f79337c5bac815"} Jul 09 14:31:05.196872 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:05.196810 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podStartSLOduration=1.1967946 podStartE2EDuration="1.1967946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:05.194331992 +0000 UTC m=+1965.408558108" watchObservedRunningTime="2026-07-09 14:31:05.1967946 +0000 UTC m=+1965.411020717" Jul 09 14:31:05.381688 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:05.381660 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:05.386445 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:05.386420 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:06.175233 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:06.175205 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:06.176288 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:06.176262 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:08.356181 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.356157 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:31:08.397392 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397336 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istiod-ca-cert\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397392 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397380 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5shww\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-kube-api-access-5shww\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397572 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397421 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-podinfo\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397572 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397532 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-credential-socket\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397572 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397565 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-certs\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397592 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-data\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397635 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-socket\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397680 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-token\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397716 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-envoy\") pod \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\" (UID: \"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8\") " Jul 09 14:31:08.397940 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397732 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:31:08.397940 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397843 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:08.397940 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.397858 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:08.398100 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.398021 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:08.398206 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.398151 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.398206 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.398171 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.398206 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.398186 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.398206 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.398198 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.398582 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.398558 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:08.399942 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.399911 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:08.400052 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.399964 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-kube-api-access-5shww" (OuterVolumeSpecName: "kube-api-access-5shww") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "kube-api-access-5shww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:08.400152 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.400048 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:31:08.400152 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.400074 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" (UID: "2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:08.499218 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.499193 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5shww\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-kube-api-access-5shww\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.499218 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.499216 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.499343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.499225 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.499343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.499233 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:08.499343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:08.499241 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:09.193193 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.193160 2553 generic.go:356] "Generic (PLEG): container finished" podID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerID="1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f" exitCode=0 Jul 09 14:31:09.193343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.193227 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" Jul 09 14:31:09.193343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.193233 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" event={"ID":"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8","Type":"ContainerDied","Data":"1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f"} Jul 09 14:31:09.193438 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.193353 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6" event={"ID":"2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8","Type":"ContainerDied","Data":"7ba1dc1b165c77778158f98068d1aae66329afd52b6423908bb57694ea04cf6b"} Jul 09 14:31:09.193438 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.193377 2553 scope.go:117] "RemoveContainer" containerID="1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f" Jul 09 14:31:09.203700 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.203678 2553 scope.go:117] "RemoveContainer" containerID="aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2" Jul 09 14:31:09.212026 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.212009 2553 scope.go:117] "RemoveContainer" containerID="1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f" Jul 09 14:31:09.212325 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:09.212307 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f\": container with ID starting with 1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f not found: ID does not exist" containerID="1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f" Jul 09 14:31:09.212381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.212334 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f"} err="failed to get container status \"1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f\": rpc error: code = NotFound desc = could not find container \"1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f\": container with ID starting with 1c7c875e54605b6bbf55e69b63ab1df25d59eb2e7b8fa169ea774a461692b81f not found: ID does not exist" Jul 09 14:31:09.212381 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.212351 2553 scope.go:117] "RemoveContainer" containerID="aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2" Jul 09 14:31:09.212597 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:09.212576 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2\": container with ID starting with aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2 not found: ID does not exist" containerID="aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2" Jul 09 14:31:09.212642 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.212604 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2"} err="failed to get container status \"aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2\": rpc error: code = NotFound desc = could not find container \"aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2\": container with ID starting with aa2cc8379d6ab563a548d26d1e9c22d8d6c2d147e593f87d7d2fa3d509a993e2 not found: ID does not exist" Jul 09 14:31:09.217508 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.217486 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6"] Jul 09 14:31:09.221869 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:09.221847 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e75e34-openshift-default-d86bfdd65-b7fd6"] Jul 09 14:31:10.300979 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:10.300944 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" path="/var/lib/kubelet/pods/2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8/volumes" Jul 09 14:31:12.484456 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.484380 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49"] Jul 09 14:31:12.484954 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.484935 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" Jul 09 14:31:12.485045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.484957 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d193f707-8ff8-4dba-b2d4-c2e738b67967" containerName="istio-proxy" Jul 09 14:31:12.485045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.484984 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" Jul 09 14:31:12.485045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.484995 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" Jul 09 14:31:12.485045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.485023 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" Jul 09 14:31:12.485045 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.485032 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" Jul 09 14:31:12.485329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.485154 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" Jul 09 14:31:12.485329 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.485170 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3fe5e8-3e6c-47ed-9e90-69aa5f9097a8" containerName="istio-proxy" Jul 09 14:31:12.489828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.489806 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.493153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.493135 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c02955-openshift-default-dockercfg-ztssn\"" Jul 09 14:31:12.512338 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.512316 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49"] Jul 09 14:31:12.532501 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332404d2-97f2-4986-abab-b14db2ace424-istiod-ca-cert\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532611 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532517 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332404d2-97f2-4986-abab-b14db2ace424-istio-podinfo\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532611 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532540 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-socket\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-istio-token\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532638 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk2wj\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-kube-api-access-vk2wj\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532692 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532667 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-data\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532823 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532697 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-certs\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532823 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532725 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-credential-socket\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.532823 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.532742 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-envoy\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633394 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633364 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-credential-socket\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633400 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-envoy\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633450 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332404d2-97f2-4986-abab-b14db2ace424-istiod-ca-cert\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633479 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332404d2-97f2-4986-abab-b14db2ace424-istio-podinfo\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633668 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633629 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-socket\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633715 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633694 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-istio-token\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633757 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633726 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk2wj\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-kube-api-access-vk2wj\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633810 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633778 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-credential-socket\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633810 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-data\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633918 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633860 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-certs\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.633967 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.633931 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-socket\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.634062 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.634017 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-data\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.634232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.634174 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-certs\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.634232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.634195 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332404d2-97f2-4986-abab-b14db2ace424-istiod-ca-cert\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.636266 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.636242 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-envoy\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.636568 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.636547 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332404d2-97f2-4986-abab-b14db2ace424-istio-podinfo\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.646414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.646387 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-istio-token\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.646578 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.646468 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk2wj\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-kube-api-access-vk2wj\") pod \"e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.800476 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.800402 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:12.946172 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.946144 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49"] Jul 09 14:31:12.947524 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:31:12.947483 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332404d2_97f2_4986_abab_b14db2ace424.slice/crio-a5e0003aedee6e928edf7adde86c27dd429369c1297eb526a16e62a93c2be5f9 WatchSource:0}: Error finding container a5e0003aedee6e928edf7adde86c27dd429369c1297eb526a16e62a93c2be5f9: Status 404 returned error can't find the container with id a5e0003aedee6e928edf7adde86c27dd429369c1297eb526a16e62a93c2be5f9 Jul 09 14:31:12.949728 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.949695 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:12.949813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.949756 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:12.949813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:12.949801 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:13.226125 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:13.226079 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" event={"ID":"332404d2-97f2-4986-abab-b14db2ace424","Type":"ContainerStarted","Data":"45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908"} Jul 09 14:31:13.226271 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:13.226186 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" event={"ID":"332404d2-97f2-4986-abab-b14db2ace424","Type":"ContainerStarted","Data":"a5e0003aedee6e928edf7adde86c27dd429369c1297eb526a16e62a93c2be5f9"} Jul 09 14:31:13.260348 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:13.260296 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podStartSLOduration=1.260280009 podStartE2EDuration="1.260280009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:13.256644244 +0000 UTC m=+1973.470870359" watchObservedRunningTime="2026-07-09 14:31:13.260280009 +0000 UTC m=+1973.474506124" Jul 09 14:31:13.801399 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:13.801368 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:14.805451 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:14.805425 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:15.237256 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:15.237221 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:15.238219 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:15.238200 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:22.217271 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:22.217228 2553 patch_prober.go:28] interesting pod/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 14:31:22.217673 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:22.217284 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 14:31:24.300305 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:24.300267 2553 generic.go:356] "Generic (PLEG): container finished" podID="5897b6c2-7543-42a9-ab88-275bba682f28" containerID="4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e" exitCode=0 Jul 09 14:31:24.301128 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:24.301077 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" event={"ID":"5897b6c2-7543-42a9-ab88-275bba682f28","Type":"ContainerDied","Data":"4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e"} Jul 09 14:31:24.301460 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:24.301444 2553 scope.go:117] "RemoveContainer" containerID="4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e" Jul 09 14:31:24.302378 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:24.302346 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:24.302490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:24.302412 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:24.302490 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:24.302443 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:25.309183 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:25.309139 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" event={"ID":"5897b6c2-7543-42a9-ab88-275bba682f28","Type":"ContainerStarted","Data":"61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9"} Jul 09 14:31:25.381976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:25.381932 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:25.382282 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:25.382259 2553 patch_prober.go:28] interesting pod/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 09 14:31:25.382402 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:25.382311 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 09 14:31:26.382074 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:26.382036 2553 patch_prober.go:28] interesting pod/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 09 14:31:26.382476 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:26.382100 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 09 14:31:27.333909 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.333631 2553 generic.go:356] "Generic (PLEG): container finished" podID="92e33e5e-9b29-4009-b253-7f743e0141bf" containerID="53963f9521c610995349f8e5a65f6a10748c562bf6e271f52968699ddb29b641" exitCode=137 Jul 09 14:31:27.333909 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.333751 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" event={"ID":"92e33e5e-9b29-4009-b253-7f743e0141bf","Type":"ContainerDied","Data":"53963f9521c610995349f8e5a65f6a10748c562bf6e271f52968699ddb29b641"} Jul 09 14:31:27.333909 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.333800 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" event={"ID":"92e33e5e-9b29-4009-b253-7f743e0141bf","Type":"ContainerDied","Data":"38d53dfe25d1f6b87e7918f891921aa6e2755ecda6ce8c702626db1d154c4f23"} Jul 09 14:31:27.333909 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.333826 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38d53dfe25d1f6b87e7918f891921aa6e2755ecda6ce8c702626db1d154c4f23" Jul 09 14:31:27.377529 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.377504 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:31:27.381833 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.381809 2553 patch_prober.go:28] interesting pod/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 09 14:31:27.381966 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.381847 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 09 14:31:27.475865 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.475835 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cssm9\" (UniqueName: \"kubernetes.io/projected/92e33e5e-9b29-4009-b253-7f743e0141bf-kube-api-access-cssm9\") pod \"92e33e5e-9b29-4009-b253-7f743e0141bf\" (UID: \"92e33e5e-9b29-4009-b253-7f743e0141bf\") " Jul 09 14:31:27.479250 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.479223 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e33e5e-9b29-4009-b253-7f743e0141bf-kube-api-access-cssm9" (OuterVolumeSpecName: "kube-api-access-cssm9") pod "92e33e5e-9b29-4009-b253-7f743e0141bf" (UID: "92e33e5e-9b29-4009-b253-7f743e0141bf"). InnerVolumeSpecName "kube-api-access-cssm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:27.577489 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:27.577453 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cssm9\" (UniqueName: \"kubernetes.io/projected/92e33e5e-9b29-4009-b253-7f743e0141bf-kube-api-access-cssm9\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:28.342806 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:28.342089 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf" Jul 09 14:31:28.369647 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:28.369616 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf"] Jul 09 14:31:28.372405 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:28.372385 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e75e34-29726790-rhhgf"] Jul 09 14:31:28.382424 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:28.382399 2553 patch_prober.go:28] interesting pod/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 09 14:31:28.382511 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:28.382446 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 09 14:31:29.382375 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:29.382335 2553 patch_prober.go:28] interesting pod/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 09 14:31:29.382759 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:29.382404 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 09 14:31:30.199670 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.199641 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:31:30.301344 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.301254 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92e33e5e-9b29-4009-b253-7f743e0141bf" path="/var/lib/kubelet/pods/92e33e5e-9b29-4009-b253-7f743e0141bf/volumes" Jul 09 14:31:30.304798 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.304773 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff9l6\" (UniqueName: \"kubernetes.io/projected/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3-kube-api-access-ff9l6\") pod \"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3\" (UID: \"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3\") " Jul 09 14:31:30.306707 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.306678 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3-kube-api-access-ff9l6" (OuterVolumeSpecName: "kube-api-access-ff9l6") pod "2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" (UID: "2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3"). InnerVolumeSpecName "kube-api-access-ff9l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:30.355522 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.355497 2553 generic.go:356] "Generic (PLEG): container finished" podID="2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" containerID="c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5" exitCode=137 Jul 09 14:31:30.355621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.355525 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" event={"ID":"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3","Type":"ContainerDied","Data":"c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5"} Jul 09 14:31:30.355621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.355563 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" Jul 09 14:31:30.355621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.355580 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d" event={"ID":"2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3","Type":"ContainerDied","Data":"c4b1a4815f21f66ef76e7cdbe98e948ef269cf1a91c0b42502c235615a158f14"} Jul 09 14:31:30.355621 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.355603 2553 scope.go:117] "RemoveContainer" containerID="c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5" Jul 09 14:31:30.364201 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.364183 2553 scope.go:117] "RemoveContainer" containerID="c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5" Jul 09 14:31:30.364478 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:30.364460 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5\": container with ID starting with c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5 not found: ID does not exist" containerID="c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5" Jul 09 14:31:30.364527 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.364485 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5"} err="failed to get container status \"c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5\": rpc error: code = NotFound desc = could not find container \"c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5\": container with ID starting with c0d5edf25d6a923bfbd297adebc2920e3af8af252d65d40e4d80c6ab192115c5 not found: ID does not exist" Jul 09 14:31:30.386748 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.386726 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:30.387025 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.387006 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:30.387802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.387787 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:30.388394 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.388373 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d"] Jul 09 14:31:30.394646 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.394627 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-brb4d"] Jul 09 14:31:30.406047 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:30.406024 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff9l6\" (UniqueName: \"kubernetes.io/projected/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3-kube-api-access-ff9l6\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:31.278241 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:31.278207 2553 patch_prober.go:28] interesting pod/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 14:31:31.278403 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:31.278272 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 14:31:32.301736 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.301703 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" path="/var/lib/kubelet/pods/2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3/volumes" Jul 09 14:31:32.369790 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.369763 2553 generic.go:356] "Generic (PLEG): container finished" podID="332404d2-97f2-4986-abab-b14db2ace424" containerID="45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908" exitCode=0 Jul 09 14:31:32.369934 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.369836 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" event={"ID":"332404d2-97f2-4986-abab-b14db2ace424","Type":"ContainerDied","Data":"45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908"} Jul 09 14:31:32.370413 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.370392 2553 scope.go:117] "RemoveContainer" containerID="45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908" Jul 09 14:31:32.371384 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.371354 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:32.371442 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.371422 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:32.371492 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:32.371453 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:33.376662 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:33.376629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" event={"ID":"332404d2-97f2-4986-abab-b14db2ace424","Type":"ContainerStarted","Data":"d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215"} Jul 09 14:31:33.800796 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:33.800756 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:33.800975 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:33.800932 2553 patch_prober.go:28] interesting pod/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 09 14:31:33.801024 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:33.800981 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 09 14:31:34.681772 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:34.681738 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl"] Jul 09 14:31:34.682202 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:34.681942 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" containerID="cri-o://61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9" gracePeriod=30 Jul 09 14:31:34.801001 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:34.800967 2553 patch_prober.go:28] interesting pod/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 09 14:31:34.801214 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:34.801029 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 09 14:31:35.801650 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:35.801615 2553 patch_prober.go:28] interesting pod/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 09 14:31:35.802058 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:35.801664 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 09 14:31:36.801048 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:36.801016 2553 patch_prober.go:28] interesting pod/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 09 14:31:36.801259 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:36.801068 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 09 14:31:37.804238 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:37.804203 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:37.804709 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:37.804478 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:37.805354 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:37.805335 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:39.928934 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:39.928911 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:40.098902 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.098821 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-credential-socket\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.098902 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.098900 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-socket\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099133 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.098933 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-certs\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099133 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.098987 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5897b6c2-7543-42a9-ab88-275bba682f28-istio-podinfo\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099133 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099016 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-envoy\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099133 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099065 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-istio-token\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099133 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099092 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5897b6c2-7543-42a9-ab88-275bba682f28-istiod-ca-cert\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099143 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:40.099409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099176 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-data\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099219 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsw6w\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-kube-api-access-tsw6w\") pod \"5897b6c2-7543-42a9-ab88-275bba682f28\" (UID: \"5897b6c2-7543-42a9-ab88-275bba682f28\") " Jul 09 14:31:40.099409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099267 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:40.099409 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099338 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:40.099690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099543 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5897b6c2-7543-42a9-ab88-275bba682f28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:31:40.099690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099622 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.099690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099642 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.099690 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099656 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.100017 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.099995 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-data" (OuterVolumeSpecName: "istio-data") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:40.101426 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.101388 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:40.101552 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.101453 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-kube-api-access-tsw6w" (OuterVolumeSpecName: "kube-api-access-tsw6w") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "kube-api-access-tsw6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:40.101726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.101707 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5897b6c2-7543-42a9-ab88-275bba682f28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:31:40.101726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.101712 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-istio-token" (OuterVolumeSpecName: "istio-token") pod "5897b6c2-7543-42a9-ab88-275bba682f28" (UID: "5897b6c2-7543-42a9-ab88-275bba682f28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:40.200560 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.200535 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5897b6c2-7543-42a9-ab88-275bba682f28-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.200560 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.200556 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.200560 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.200565 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.200721 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.200573 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5897b6c2-7543-42a9-ab88-275bba682f28-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.200721 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.200580 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5897b6c2-7543-42a9-ab88-275bba682f28-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.200721 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.200587 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsw6w\" (UniqueName: \"kubernetes.io/projected/5897b6c2-7543-42a9-ab88-275bba682f28-kube-api-access-tsw6w\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:40.417518 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.417490 2553 generic.go:356] "Generic (PLEG): container finished" podID="5897b6c2-7543-42a9-ab88-275bba682f28" containerID="61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9" exitCode=0 Jul 09 14:31:40.417628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.417540 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" event={"ID":"5897b6c2-7543-42a9-ab88-275bba682f28","Type":"ContainerDied","Data":"61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9"} Jul 09 14:31:40.417628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.417553 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" Jul 09 14:31:40.417628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.417592 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl" event={"ID":"5897b6c2-7543-42a9-ab88-275bba682f28","Type":"ContainerDied","Data":"93dccc9a568efc35a2b8ebdb0c0678198a1d22af7b1a233185f79337c5bac815"} Jul 09 14:31:40.417628 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.417621 2553 scope.go:117] "RemoveContainer" containerID="61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9" Jul 09 14:31:40.427419 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.427402 2553 scope.go:117] "RemoveContainer" containerID="4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e" Jul 09 14:31:40.435688 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.435670 2553 scope.go:117] "RemoveContainer" containerID="61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9" Jul 09 14:31:40.435953 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:40.435933 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9\": container with ID starting with 61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9 not found: ID does not exist" containerID="61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9" Jul 09 14:31:40.435997 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.435961 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9"} err="failed to get container status \"61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9\": rpc error: code = NotFound desc = could not find container \"61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9\": container with ID starting with 61d41af68b0005510132736dc0323f606ea92948e23a5cb60d40d1021de94da9 not found: ID does not exist" Jul 09 14:31:40.435997 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.435978 2553 scope.go:117] "RemoveContainer" containerID="4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e" Jul 09 14:31:40.436350 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:40.436330 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e\": container with ID starting with 4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e not found: ID does not exist" containerID="4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e" Jul 09 14:31:40.436400 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.436357 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e"} err="failed to get container status \"4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e\": rpc error: code = NotFound desc = could not find container \"4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e\": container with ID starting with 4f95fe61777b62692ad87fadbacf3569a8d4d98247e89782c02280ab694da84e not found: ID does not exist" Jul 09 14:31:40.442090 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.442067 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl"] Jul 09 14:31:40.444800 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:40.444774 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-eeeac1-openshift-default-bc76bfc75-4rvgl"] Jul 09 14:31:41.982674 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:41.982643 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49"] Jul 09 14:31:41.983061 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:41.982835 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" containerID="cri-o://d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215" gracePeriod=30 Jul 09 14:31:42.300483 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.300411 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" path="/var/lib/kubelet/pods/5897b6c2-7543-42a9-ab88-275bba682f28/volumes" Jul 09 14:31:42.880405 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880364 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x"] Jul 09 14:31:42.880850 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880832 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" Jul 09 14:31:42.880896 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880854 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" Jul 09 14:31:42.880896 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880875 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e33e5e-9b29-4009-b253-7f743e0141bf" containerName="cleanup" Jul 09 14:31:42.880896 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880880 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e33e5e-9b29-4009-b253-7f743e0141bf" containerName="cleanup" Jul 09 14:31:42.880896 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880888 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" containerName="cleanup" Jul 09 14:31:42.880896 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880894 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" containerName="cleanup" Jul 09 14:31:42.881053 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880956 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" Jul 09 14:31:42.881053 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880965 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fbb53a8-b5a6-4d90-9d64-6c70d081b4e3" containerName="cleanup" Jul 09 14:31:42.881053 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880973 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" Jul 09 14:31:42.881053 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.880981 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e33e5e-9b29-4009-b253-7f743e0141bf" containerName="cleanup" Jul 09 14:31:42.883975 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.883955 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:42.886927 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.886905 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5a8685-openshift-default-dockercfg-ch75d\"" Jul 09 14:31:42.901000 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:42.900979 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x"] Jul 09 14:31:43.023185 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023155 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-certs\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023196 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-envoy\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023253 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-data\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b706ccb-9751-4672-abe9-14df920959cc-istio-podinfo\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023315 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-istio-token\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023346 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphhg\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-kube-api-access-pphhg\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b706ccb-9751-4672-abe9-14df920959cc-istiod-ca-cert\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-socket\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.023600 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.023441 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-credential-socket\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124100 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-data\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124134 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b706ccb-9751-4672-abe9-14df920959cc-istio-podinfo\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124163 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-istio-token\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124189 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphhg\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-kube-api-access-pphhg\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124206 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b706ccb-9751-4672-abe9-14df920959cc-istiod-ca-cert\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-socket\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124300 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124275 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-credential-socket\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124610 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124354 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-certs\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124610 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124388 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-envoy\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124610 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124576 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-data\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124766 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124710 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-credential-socket\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.124915 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124881 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-certs\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.125036 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124895 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-socket\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.125036 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.124946 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b706ccb-9751-4672-abe9-14df920959cc-istiod-ca-cert\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.126560 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.126540 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b706ccb-9751-4672-abe9-14df920959cc-istio-podinfo\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.126672 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.126650 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-envoy\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.138599 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.138549 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-istio-token\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.138811 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.138781 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphhg\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-kube-api-access-pphhg\") pod \"e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.194564 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.194540 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:43.339437 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.339413 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x"] Jul 09 14:31:43.340567 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:31:43.340533 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b706ccb_9751_4672_abe9_14df920959cc.slice/crio-9b00893e48601f25c5c9f32e45023b9391636e2e402781359ef7ec207ee8aef8 WatchSource:0}: Error finding container 9b00893e48601f25c5c9f32e45023b9391636e2e402781359ef7ec207ee8aef8: Status 404 returned error can't find the container with id 9b00893e48601f25c5c9f32e45023b9391636e2e402781359ef7ec207ee8aef8 Jul 09 14:31:43.342737 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.342707 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:43.342814 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.342771 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:43.342814 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.342798 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:43.437666 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.437629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" event={"ID":"9b706ccb-9751-4672-abe9-14df920959cc","Type":"ContainerStarted","Data":"ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735"} Jul 09 14:31:43.437824 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.437698 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" event={"ID":"9b706ccb-9751-4672-abe9-14df920959cc","Type":"ContainerStarted","Data":"9b00893e48601f25c5c9f32e45023b9391636e2e402781359ef7ec207ee8aef8"} Jul 09 14:31:43.462947 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:43.462899 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podStartSLOduration=1.462884141 podStartE2EDuration="1.462884141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:43.45971123 +0000 UTC m=+2003.673937368" watchObservedRunningTime="2026-07-09 14:31:43.462884141 +0000 UTC m=+2003.677110256" Jul 09 14:31:44.195207 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:44.195172 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:44.200032 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:44.200007 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:44.443380 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:44.443351 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:44.444098 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:44.444075 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:31:47.236763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.236742 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:47.367783 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367693 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-certs\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.367783 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367750 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-data\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367802 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk2wj\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-kube-api-access-vk2wj\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367892 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-envoy\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367927 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-credential-socket\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367956 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332404d2-97f2-4986-abab-b14db2ace424-istiod-ca-cert\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367962 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:47.368018 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.367987 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-istio-token\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368097 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-socket\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368168 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332404d2-97f2-4986-abab-b14db2ace424-istio-podinfo\") pod \"332404d2-97f2-4986-abab-b14db2ace424\" (UID: \"332404d2-97f2-4986-abab-b14db2ace424\") " Jul 09 14:31:47.368423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368185 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:47.368423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368334 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:47.368423 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368398 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/332404d2-97f2-4986-abab-b14db2ace424-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:31:47.368685 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368599 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.368685 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368618 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332404d2-97f2-4986-abab-b14db2ace424-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.368685 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368632 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.368685 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368645 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.368899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.368684 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-data" (OuterVolumeSpecName: "istio-data") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:47.370153 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.370100 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:31:47.370280 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.370238 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-istio-token" (OuterVolumeSpecName: "istio-token") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:47.370280 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.370244 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-kube-api-access-vk2wj" (OuterVolumeSpecName: "kube-api-access-vk2wj") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "kube-api-access-vk2wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:31:47.370382 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.370354 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/332404d2-97f2-4986-abab-b14db2ace424-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "332404d2-97f2-4986-abab-b14db2ace424" (UID: "332404d2-97f2-4986-abab-b14db2ace424"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:31:47.462093 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.462064 2553 generic.go:356] "Generic (PLEG): container finished" podID="332404d2-97f2-4986-abab-b14db2ace424" containerID="d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215" exitCode=0 Jul 09 14:31:47.462221 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.462150 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" Jul 09 14:31:47.462221 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.462153 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" event={"ID":"332404d2-97f2-4986-abab-b14db2ace424","Type":"ContainerDied","Data":"d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215"} Jul 09 14:31:47.462221 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.462211 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49" event={"ID":"332404d2-97f2-4986-abab-b14db2ace424","Type":"ContainerDied","Data":"a5e0003aedee6e928edf7adde86c27dd429369c1297eb526a16e62a93c2be5f9"} Jul 09 14:31:47.462327 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.462234 2553 scope.go:117] "RemoveContainer" containerID="d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215" Jul 09 14:31:47.469706 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.469570 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.469706 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.469588 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk2wj\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-kube-api-access-vk2wj\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.469706 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.469596 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332404d2-97f2-4986-abab-b14db2ace424-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.469706 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.469606 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332404d2-97f2-4986-abab-b14db2ace424-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.469706 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.469613 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332404d2-97f2-4986-abab-b14db2ace424-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:31:47.471431 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.471415 2553 scope.go:117] "RemoveContainer" containerID="45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908" Jul 09 14:31:47.479775 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.479756 2553 scope.go:117] "RemoveContainer" containerID="d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215" Jul 09 14:31:47.480033 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:47.480017 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215\": container with ID starting with d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215 not found: ID does not exist" containerID="d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215" Jul 09 14:31:47.480083 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.480040 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215"} err="failed to get container status \"d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215\": rpc error: code = NotFound desc = could not find container \"d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215\": container with ID starting with d3305c26d2e376285b58c921ce5fea90b4564e9e58c277e69d75ea1467e92215 not found: ID does not exist" Jul 09 14:31:47.480083 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.480055 2553 scope.go:117] "RemoveContainer" containerID="45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908" Jul 09 14:31:47.480300 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:31:47.480281 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908\": container with ID starting with 45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908 not found: ID does not exist" containerID="45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908" Jul 09 14:31:47.480359 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.480312 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908"} err="failed to get container status \"45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908\": rpc error: code = NotFound desc = could not find container \"45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908\": container with ID starting with 45359b330a790b3b41c4380072aafb728401b9ee34b567928fd59bcd34e8c908 not found: ID does not exist" Jul 09 14:31:47.496610 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.496585 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49"] Jul 09 14:31:47.502980 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:47.502959 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c02955-openshift-default-6b9c698cc7-xht49"] Jul 09 14:31:48.308081 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:48.308044 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="332404d2-97f2-4986-abab-b14db2ace424" path="/var/lib/kubelet/pods/332404d2-97f2-4986-abab-b14db2ace424/volumes" Jul 09 14:31:50.507581 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.507536 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb"] Jul 09 14:31:50.507952 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.507936 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" Jul 09 14:31:50.508006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.507954 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" Jul 09 14:31:50.508006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.507973 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" Jul 09 14:31:50.508006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.507978 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5897b6c2-7543-42a9-ab88-275bba682f28" containerName="istio-proxy" Jul 09 14:31:50.508128 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.508040 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" Jul 09 14:31:50.508128 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.508049 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" Jul 09 14:31:50.510976 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.510957 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.514478 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.514459 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a4b0c9-openshift-default-dockercfg-gxjds\"" Jul 09 14:31:50.532647 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.532625 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb"] Jul 09 14:31:50.695441 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695412 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-socket\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695447 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-data\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695474 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfw2j\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-kube-api-access-kfw2j\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695562 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-envoy\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695602 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-credential-socket\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695659 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f172d47-8b1d-4827-a764-71be12cc833c-istiod-ca-cert\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695705 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-istio-token\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695751 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-certs\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.695847 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.695767 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f172d47-8b1d-4827-a764-71be12cc833c-istio-podinfo\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797066 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-istio-token\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797174 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-certs\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797179 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f172d47-8b1d-4827-a764-71be12cc833c-istio-podinfo\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797253 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-socket\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797280 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-data\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797313 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfw2j\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-kube-api-access-kfw2j\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797397 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797383 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-envoy\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797431 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-credential-socket\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797486 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f172d47-8b1d-4827-a764-71be12cc833c-istiod-ca-cert\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797576 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-certs\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797826 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797783 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-data\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797826 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797780 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-credential-socket\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.797933 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.797829 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-socket\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.798197 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.798176 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f172d47-8b1d-4827-a764-71be12cc833c-istiod-ca-cert\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.799537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.799512 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-envoy\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.799826 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.799805 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f172d47-8b1d-4827-a764-71be12cc833c-istio-podinfo\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.807089 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.807065 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-istio-token\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.807368 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.807348 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfw2j\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-kube-api-access-kfw2j\") pod \"e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.820725 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.820704 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:50.961517 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.961492 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb"] Jul 09 14:31:50.963013 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:31:50.962986 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f172d47_8b1d_4827_a764_71be12cc833c.slice/crio-a6a44160890530b4d168185753c607998335870362e55f645c9e7d8728c2a3b2 WatchSource:0}: Error finding container a6a44160890530b4d168185753c607998335870362e55f645c9e7d8728c2a3b2: Status 404 returned error can't find the container with id a6a44160890530b4d168185753c607998335870362e55f645c9e7d8728c2a3b2 Jul 09 14:31:50.965640 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.965605 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:50.965754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.965667 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:50.965754 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:50.965692 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:31:51.487272 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:51.487241 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" event={"ID":"6f172d47-8b1d-4827-a764-71be12cc833c","Type":"ContainerStarted","Data":"058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467"} Jul 09 14:31:51.487433 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:51.487297 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" event={"ID":"6f172d47-8b1d-4827-a764-71be12cc833c","Type":"ContainerStarted","Data":"a6a44160890530b4d168185753c607998335870362e55f645c9e7d8728c2a3b2"} Jul 09 14:31:51.508627 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:51.508581 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podStartSLOduration=1.508564406 podStartE2EDuration="1.508564406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:51.508000031 +0000 UTC m=+2011.722226175" watchObservedRunningTime="2026-07-09 14:31:51.508564406 +0000 UTC m=+2011.722790526" Jul 09 14:31:51.821170 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:51.821080 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:52.825681 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:52.825654 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:53.497723 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:53.497695 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:31:53.498578 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:31:53.498561 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:32:00.485267 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:00.485227 2553 patch_prober.go:28] interesting pod/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 14:32:00.485756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:00.485293 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 14:32:01.546816 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:01.546780 2553 generic.go:356] "Generic (PLEG): container finished" podID="9b706ccb-9751-4672-abe9-14df920959cc" containerID="ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735" exitCode=0 Jul 09 14:32:01.547266 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:01.546853 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" event={"ID":"9b706ccb-9751-4672-abe9-14df920959cc","Type":"ContainerDied","Data":"ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735"} Jul 09 14:32:01.547367 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:01.547348 2553 scope.go:117] "RemoveContainer" containerID="ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735" Jul 09 14:32:01.548488 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:01.548454 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:32:01.548586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:01.548531 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:32:01.548586 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:01.548565 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:32:02.554598 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:02.554566 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" event={"ID":"9b706ccb-9751-4672-abe9-14df920959cc","Type":"ContainerStarted","Data":"9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b"} Jul 09 14:32:03.194862 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:03.194828 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:32:03.195048 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:03.194928 2553 patch_prober.go:28] interesting pod/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 09 14:32:03.195048 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:03.194974 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 09 14:32:04.195198 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:04.195167 2553 patch_prober.go:28] interesting pod/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 09 14:32:04.195654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:04.195628 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 09 14:32:05.195237 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:05.195210 2553 patch_prober.go:28] interesting pod/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 09 14:32:05.195570 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:05.195271 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 09 14:32:06.195834 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:06.195803 2553 patch_prober.go:28] interesting pod/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 09 14:32:06.196266 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:06.195857 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 09 14:32:07.198222 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:07.198194 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:32:07.198633 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:07.198610 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:32:07.199364 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:07.199342 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:32:08.499836 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.499809 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 09 14:32:08.500172 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.499860 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 09 14:32:08.598651 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.598599 2553 generic.go:356] "Generic (PLEG): container finished" podID="6f172d47-8b1d-4827-a764-71be12cc833c" containerID="058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467" exitCode=0 Jul 09 14:32:08.598757 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.598673 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" event={"ID":"6f172d47-8b1d-4827-a764-71be12cc833c","Type":"ContainerDied","Data":"058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467"} Jul 09 14:32:08.599245 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.599228 2553 scope.go:117] "RemoveContainer" containerID="058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467" Jul 09 14:32:08.600221 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.600192 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:32:08.600296 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.600277 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:32:08.600335 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:08.600324 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 14:32:09.606545 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:09.606512 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" event={"ID":"6f172d47-8b1d-4827-a764-71be12cc833c","Type":"ContainerStarted","Data":"d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30"} Jul 09 14:32:09.820938 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:09.820896 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:32:09.821309 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:09.821278 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 09 14:32:09.821532 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:09.821506 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 09 14:32:10.821411 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:10.821316 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 09 14:32:10.821411 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:10.821374 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 09 14:32:11.821060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:11.821022 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 09 14:32:11.821396 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:11.821364 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 09 14:32:12.821336 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:12.821298 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 09 14:32:12.821813 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:12.821375 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 09 14:32:13.824886 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:13.824851 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:32:13.825383 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:13.825222 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:32:13.825885 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:32:13.825865 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:33:20.432537 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:33:20.432507 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:33:20.441370 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:33:20.441349 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:36:20.516425 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:36:20.516390 2553 scope.go:117] "RemoveContainer" containerID="53963f9521c610995349f8e5a65f6a10748c562bf6e271f52968699ddb29b641" Jul 09 14:36:20.525480 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:36:20.525462 2553 scope.go:117] "RemoveContainer" containerID="2b38e15f3fa5acb9678a41f2f19740ab7e704d38d33116e306ff16a01498ad80" Jul 09 14:37:48.852053 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:48.852020 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x"] Jul 09 14:37:48.852541 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:48.852239 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" containerID="cri-o://9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b" gracePeriod=30 Jul 09 14:37:52.201263 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:52.201190 2553 patch_prober.go:28] interesting pod/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 14:37:52.201840 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:52.201575 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:37:54.116723 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.116664 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:37:54.220374 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220351 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-certs\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220385 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-socket\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220427 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-credential-socket\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220455 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-data\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220482 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-istio-token\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220527 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-envoy\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220586 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b706ccb-9751-4672-abe9-14df920959cc-istio-podinfo\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.220746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220642 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:54.220746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220654 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:54.220746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220654 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b706ccb-9751-4672-abe9-14df920959cc-istiod-ca-cert\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.221019 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220750 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pphhg\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-kube-api-access-pphhg\") pod \"9b706ccb-9751-4672-abe9-14df920959cc\" (UID: \"9b706ccb-9751-4672-abe9-14df920959cc\") " Jul 09 14:37:54.221019 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.220811 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:54.221163 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.221142 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.221232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.221166 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.221232 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.221180 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.221340 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.221298 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b706ccb-9751-4672-abe9-14df920959cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:37:54.221437 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.221412 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:54.222828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.222797 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b706ccb-9751-4672-abe9-14df920959cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:37:54.222828 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.222811 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-kube-api-access-pphhg" (OuterVolumeSpecName: "kube-api-access-pphhg") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "kube-api-access-pphhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:54.223091 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.223063 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:54.223091 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.223070 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b706ccb-9751-4672-abe9-14df920959cc" (UID: "9b706ccb-9751-4672-abe9-14df920959cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:54.322507 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.322488 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.322507 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.322509 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.322630 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.322518 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b706ccb-9751-4672-abe9-14df920959cc-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.322630 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.322526 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b706ccb-9751-4672-abe9-14df920959cc-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.322630 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.322534 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b706ccb-9751-4672-abe9-14df920959cc-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.322630 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.322542 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pphhg\" (UniqueName: \"kubernetes.io/projected/9b706ccb-9751-4672-abe9-14df920959cc-kube-api-access-pphhg\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:37:54.580913 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.580887 2553 generic.go:356] "Generic (PLEG): container finished" podID="9b706ccb-9751-4672-abe9-14df920959cc" containerID="9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b" exitCode=0 Jul 09 14:37:54.581041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.580940 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" Jul 09 14:37:54.581041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.580955 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" event={"ID":"9b706ccb-9751-4672-abe9-14df920959cc","Type":"ContainerDied","Data":"9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b"} Jul 09 14:37:54.581041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.580998 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x" event={"ID":"9b706ccb-9751-4672-abe9-14df920959cc","Type":"ContainerDied","Data":"9b00893e48601f25c5c9f32e45023b9391636e2e402781359ef7ec207ee8aef8"} Jul 09 14:37:54.581041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.581021 2553 scope.go:117] "RemoveContainer" containerID="9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b" Jul 09 14:37:54.590752 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.590734 2553 scope.go:117] "RemoveContainer" containerID="ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735" Jul 09 14:37:54.602660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.602639 2553 scope.go:117] "RemoveContainer" containerID="9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b" Jul 09 14:37:54.602931 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:37:54.602904 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b\": container with ID starting with 9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b not found: ID does not exist" containerID="9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b" Jul 09 14:37:54.602992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.602937 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b"} err="failed to get container status \"9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b\": rpc error: code = NotFound desc = could not find container \"9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b\": container with ID starting with 9c185038fe9e6686f52894b1d2eb1f190412a16bdd8f659df84b881d77f16c7b not found: ID does not exist" Jul 09 14:37:54.602992 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.602954 2553 scope.go:117] "RemoveContainer" containerID="ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735" Jul 09 14:37:54.603191 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:37:54.603170 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735\": container with ID starting with ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735 not found: ID does not exist" containerID="ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735" Jul 09 14:37:54.603243 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.603196 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735"} err="failed to get container status \"ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735\": rpc error: code = NotFound desc = could not find container \"ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735\": container with ID starting with ade5612e886ef61cf958c3840db5f039559722e92c3a664451c0e470f8734735 not found: ID does not exist" Jul 09 14:37:54.603763 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.603749 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x"] Jul 09 14:37:54.606288 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:54.606180 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5a8685-openshift-default-777fcb4b7-txp2x"] Jul 09 14:37:56.307013 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:56.306978 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b706ccb-9751-4672-abe9-14df920959cc" path="/var/lib/kubelet/pods/9b706ccb-9751-4672-abe9-14df920959cc/volumes" Jul 09 14:37:56.539868 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:56.539838 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb"] Jul 09 14:37:56.540052 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:56.540028 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" containerID="cri-o://d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30" gracePeriod=30 Jul 09 14:37:58.828217 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:58.828177 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 14:37:58.828598 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:37:58.828250 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:38:01.791173 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.791147 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:38:01.883957 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.883904 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-envoy\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.883957 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.883939 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f172d47-8b1d-4827-a764-71be12cc833c-istiod-ca-cert\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884152 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.883964 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-socket\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884152 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884085 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfw2j\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-kube-api-access-kfw2j\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884170 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-data\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884213 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-credential-socket\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884251 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884220 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:38:01.884414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884247 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f172d47-8b1d-4827-a764-71be12cc833c-istio-podinfo\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884288 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-istio-token\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884320 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f172d47-8b1d-4827-a764-71be12cc833c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:38:01.884414 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884330 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-certs\") pod \"6f172d47-8b1d-4827-a764-71be12cc833c\" (UID: \"6f172d47-8b1d-4827-a764-71be12cc833c\") " Jul 09 14:38:01.884625 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884525 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:38:01.884819 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.884773 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:38:01.885205 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.885104 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.885205 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.885150 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f172d47-8b1d-4827-a764-71be12cc833c-istiod-ca-cert\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.885205 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.885163 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-workload-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.885205 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.885174 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-credential-socket\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.885205 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.885104 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:38:01.886386 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.886360 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:38:01.886582 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.886561 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:38:01.886671 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.886651 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f172d47-8b1d-4827-a764-71be12cc833c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:38:01.886711 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.886657 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-kube-api-access-kfw2j" (OuterVolumeSpecName: "kube-api-access-kfw2j") pod "6f172d47-8b1d-4827-a764-71be12cc833c" (UID: "6f172d47-8b1d-4827-a764-71be12cc833c"). InnerVolumeSpecName "kube-api-access-kfw2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:38:01.986162 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.986139 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-envoy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.986162 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.986159 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfw2j\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-kube-api-access-kfw2j\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.986284 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.986169 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f172d47-8b1d-4827-a764-71be12cc833c-istio-data\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.986284 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.986179 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f172d47-8b1d-4827-a764-71be12cc833c-istio-podinfo\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:01.986284 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:01.986186 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f172d47-8b1d-4827-a764-71be12cc833c-istio-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jul 09 14:38:02.627271 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.627180 2553 generic.go:356] "Generic (PLEG): container finished" podID="6f172d47-8b1d-4827-a764-71be12cc833c" containerID="d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30" exitCode=0 Jul 09 14:38:02.627271 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.627249 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" Jul 09 14:38:02.627448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.627270 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" event={"ID":"6f172d47-8b1d-4827-a764-71be12cc833c","Type":"ContainerDied","Data":"d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30"} Jul 09 14:38:02.627448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.627367 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb" event={"ID":"6f172d47-8b1d-4827-a764-71be12cc833c","Type":"ContainerDied","Data":"a6a44160890530b4d168185753c607998335870362e55f645c9e7d8728c2a3b2"} Jul 09 14:38:02.627448 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.627400 2553 scope.go:117] "RemoveContainer" containerID="d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30" Jul 09 14:38:02.637667 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.637646 2553 scope.go:117] "RemoveContainer" containerID="058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467" Jul 09 14:38:02.646802 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.646779 2553 scope.go:117] "RemoveContainer" containerID="d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30" Jul 09 14:38:02.647067 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:38:02.647043 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30\": container with ID starting with d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30 not found: ID does not exist" containerID="d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30" Jul 09 14:38:02.647157 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.647077 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30"} err="failed to get container status \"d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30\": rpc error: code = NotFound desc = could not find container \"d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30\": container with ID starting with d331b0f05f70bce1640b15524df9c9b859bd18a1a6ef79931042c671c3491f30 not found: ID does not exist" Jul 09 14:38:02.647157 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.647097 2553 scope.go:117] "RemoveContainer" containerID="058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467" Jul 09 14:38:02.647423 ip-10-0-132-27 kubenswrapper[2553]: E0709 14:38:02.647396 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467\": container with ID starting with 058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467 not found: ID does not exist" containerID="058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467" Jul 09 14:38:02.647485 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.647432 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467"} err="failed to get container status \"058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467\": rpc error: code = NotFound desc = could not find container \"058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467\": container with ID starting with 058dfda578febe8b4755e87b3781f6da3e558946139216b8a505b1dcfac9e467 not found: ID does not exist" Jul 09 14:38:02.648620 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.648591 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb"] Jul 09 14:38:02.654380 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:02.654355 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a4b0c9-openshift-default-5f7c7987f9-wgvsb"] Jul 09 14:38:03.978933 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:03.978894 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-zmssg_2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f/copy-manifests/0.log" Jul 09 14:38:03.986186 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:03.986156 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-zmssg_2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f/manager/0.log" Jul 09 14:38:04.301099 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:04.301021 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" path="/var/lib/kubelet/pods/6f172d47-8b1d-4827-a764-71be12cc833c/volumes" Jul 09 14:38:05.290741 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.290711 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn_c7df4f2b-8066-44c1-bc83-d78c7009659f/util/0.log" Jul 09 14:38:05.297937 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.297908 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn_c7df4f2b-8066-44c1-bc83-d78c7009659f/pull/0.log" Jul 09 14:38:05.304123 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.304094 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn_c7df4f2b-8066-44c1-bc83-d78c7009659f/extract/0.log" Jul 09 14:38:05.414860 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.414834 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb_d0b9e1a0-677b-4926-b091-d0548a191fdc/extract/0.log" Jul 09 14:38:05.421019 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.420992 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb_d0b9e1a0-677b-4926-b091-d0548a191fdc/util/0.log" Jul 09 14:38:05.427342 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.427320 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb_d0b9e1a0-677b-4926-b091-d0548a191fdc/pull/0.log" Jul 09 14:38:05.545761 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.545664 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m_11e50e1f-bfb7-4a04-8a70-659115adea4e/extract/0.log" Jul 09 14:38:05.552156 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.552127 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m_11e50e1f-bfb7-4a04-8a70-659115adea4e/util/0.log" Jul 09 14:38:05.561809 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.561788 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m_11e50e1f-bfb7-4a04-8a70-659115adea4e/pull/0.log" Jul 09 14:38:05.680981 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.680960 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf_bad7a7da-31ce-474f-8683-5a849d52ff91/pull/0.log" Jul 09 14:38:05.688286 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.688269 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf_bad7a7da-31ce-474f-8683-5a849d52ff91/extract/0.log" Jul 09 14:38:05.695275 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:05.695255 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf_bad7a7da-31ce-474f-8683-5a849d52ff91/util/0.log" Jul 09 14:38:07.084345 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:07.084300 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qq5g4_c86075e0-aa2f-4ec4-84ab-8b4678156b7a/istio-proxy/0.log" Jul 09 14:38:07.208699 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:07.208671 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nxdfz_572489cc-7bb4-4040-b657-06616906727f/discovery/0.log" Jul 09 14:38:07.572884 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:07.572855 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/1.log" Jul 09 14:38:07.826316 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:07.826246 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zbh4h_dbfed569-6e30-4b55-a18c-38048ef669a0/payload-processing/0.log" Jul 09 14:38:07.945726 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:07.945705 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-598c56748b-jjshs_d5840237-f1e6-4287-8890-6dd0fc4d82e0/router/0.log" Jul 09 14:38:08.316353 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:08.316322 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-28mvq_df01c6c6-451b-4ac8-8ab7-0044fe5624a0/main/0.log" Jul 09 14:38:13.154359 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154325 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4mx2l/must-gather-q6rn4"] Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154685 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154697 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="332404d2-97f2-4986-abab-b14db2ace424" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154712 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154718 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154727 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154734 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154746 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" Jul 09 14:38:13.154750 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154752 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" Jul 09 14:38:13.155006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154770 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" Jul 09 14:38:13.155006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154775 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" Jul 09 14:38:13.155006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154830 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" Jul 09 14:38:13.155006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154838 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" Jul 09 14:38:13.155006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154844 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b706ccb-9751-4672-abe9-14df920959cc" containerName="istio-proxy" Jul 09 14:38:13.155006 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.154852 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f172d47-8b1d-4827-a764-71be12cc833c" containerName="istio-proxy" Jul 09 14:38:13.158202 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.158174 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.161756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.161734 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4mx2l\"/\"openshift-service-ca.crt\"" Jul 09 14:38:13.163015 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.162990 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4mx2l\"/\"default-dockercfg-hwwlv\"" Jul 09 14:38:13.163165 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.163144 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4mx2l\"/\"kube-root-ca.crt\"" Jul 09 14:38:13.166057 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.166026 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mx2l/must-gather-q6rn4"] Jul 09 14:38:13.183680 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.183657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce7e3b6c-8253-4fda-a8fb-d4995f8362de-must-gather-output\") pod \"must-gather-q6rn4\" (UID: \"ce7e3b6c-8253-4fda-a8fb-d4995f8362de\") " pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.183776 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.183731 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx74f\" (UniqueName: \"kubernetes.io/projected/ce7e3b6c-8253-4fda-a8fb-d4995f8362de-kube-api-access-gx74f\") pod \"must-gather-q6rn4\" (UID: \"ce7e3b6c-8253-4fda-a8fb-d4995f8362de\") " pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.284283 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.284259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx74f\" (UniqueName: \"kubernetes.io/projected/ce7e3b6c-8253-4fda-a8fb-d4995f8362de-kube-api-access-gx74f\") pod \"must-gather-q6rn4\" (UID: \"ce7e3b6c-8253-4fda-a8fb-d4995f8362de\") " pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.284462 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.284304 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce7e3b6c-8253-4fda-a8fb-d4995f8362de-must-gather-output\") pod \"must-gather-q6rn4\" (UID: \"ce7e3b6c-8253-4fda-a8fb-d4995f8362de\") " pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.284633 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.284616 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce7e3b6c-8253-4fda-a8fb-d4995f8362de-must-gather-output\") pod \"must-gather-q6rn4\" (UID: \"ce7e3b6c-8253-4fda-a8fb-d4995f8362de\") " pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.291985 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.291964 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx74f\" (UniqueName: \"kubernetes.io/projected/ce7e3b6c-8253-4fda-a8fb-d4995f8362de-kube-api-access-gx74f\") pod \"must-gather-q6rn4\" (UID: \"ce7e3b6c-8253-4fda-a8fb-d4995f8362de\") " pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.469180 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.469152 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mx2l/must-gather-q6rn4" Jul 09 14:38:13.598342 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.598314 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mx2l/must-gather-q6rn4"] Jul 09 14:38:13.600059 ip-10-0-132-27 kubenswrapper[2553]: W0709 14:38:13.600026 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce7e3b6c_8253_4fda_a8fb_d4995f8362de.slice/crio-fcd9304d6440df08e4714a34626e878bf93d0ed80695434e4103d77f4c14bb39 WatchSource:0}: Error finding container fcd9304d6440df08e4714a34626e878bf93d0ed80695434e4103d77f4c14bb39: Status 404 returned error can't find the container with id fcd9304d6440df08e4714a34626e878bf93d0ed80695434e4103d77f4c14bb39 Jul 09 14:38:13.601968 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.601951 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:38:13.689899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:13.689873 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/must-gather-q6rn4" event={"ID":"ce7e3b6c-8253-4fda-a8fb-d4995f8362de","Type":"ContainerStarted","Data":"fcd9304d6440df08e4714a34626e878bf93d0ed80695434e4103d77f4c14bb39"} Jul 09 14:38:14.699548 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:14.699450 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/must-gather-q6rn4" event={"ID":"ce7e3b6c-8253-4fda-a8fb-d4995f8362de","Type":"ContainerStarted","Data":"11d1994f3cfceb396cab8d688fe46d1992fc4e29e458cc94000944b144f2553d"} Jul 09 14:38:14.699548 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:14.699495 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/must-gather-q6rn4" event={"ID":"ce7e3b6c-8253-4fda-a8fb-d4995f8362de","Type":"ContainerStarted","Data":"39deefbb514f193c654981dac8ec7ab1b23cd2ad5a8add7c7ee6ac3547510383"} Jul 09 14:38:14.716077 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:14.716025 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4mx2l/must-gather-q6rn4" podStartSLOduration=0.900372195 podStartE2EDuration="1.716005219s" totalImagesPullingTime="815.633024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:14.715483918 +0000 UTC m=+2394.929710026" watchObservedRunningTime="2026-07-09 14:38:14.716005219 +0000 UTC m=+2394.930231362" Jul 09 14:38:15.996934 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:15.996899 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ftsfn_863e7fcd-75f6-437a-8094-d5a450a7d826/global-pull-secret-syncer/0.log" Jul 09 14:38:16.206067 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:16.206036 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q9nh8_605f0eef-837a-498b-a85b-98ce8216fb78/konnectivity-agent/0.log" Jul 09 14:38:16.231584 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:16.231559 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-27.ec2.internal_2fba6338be0b99866e9d3da952db4f50/haproxy/0.log" Jul 09 14:38:20.265480 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.265449 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn_c7df4f2b-8066-44c1-bc83-d78c7009659f/extract/0.log" Jul 09 14:38:20.293774 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.293748 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn_c7df4f2b-8066-44c1-bc83-d78c7009659f/util/0.log" Jul 09 14:38:20.350341 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.350313 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dv8jn_c7df4f2b-8066-44c1-bc83-d78c7009659f/pull/0.log" Jul 09 14:38:20.389615 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.389458 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb_d0b9e1a0-677b-4926-b091-d0548a191fdc/extract/0.log" Jul 09 14:38:20.412603 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.412563 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb_d0b9e1a0-677b-4926-b091-d0548a191fdc/util/0.log" Jul 09 14:38:20.436689 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.436625 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tj5gb_d0b9e1a0-677b-4926-b091-d0548a191fdc/pull/0.log" Jul 09 14:38:20.470130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.469062 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m_11e50e1f-bfb7-4a04-8a70-659115adea4e/extract/0.log" Jul 09 14:38:20.495567 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.495542 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m_11e50e1f-bfb7-4a04-8a70-659115adea4e/util/0.log" Jul 09 14:38:20.526360 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.526161 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hhb9m_11e50e1f-bfb7-4a04-8a70-659115adea4e/pull/0.log" Jul 09 14:38:20.529297 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.529265 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:38:20.531901 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.531874 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:38:20.555509 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.555488 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf_bad7a7da-31ce-474f-8683-5a849d52ff91/extract/0.log" Jul 09 14:38:20.586002 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.585621 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf_bad7a7da-31ce-474f-8683-5a849d52ff91/util/0.log" Jul 09 14:38:20.612314 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:20.612275 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f74lf_bad7a7da-31ce-474f-8683-5a849d52ff91/pull/0.log" Jul 09 14:38:22.868910 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:22.868874 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/alertmanager/0.log" Jul 09 14:38:22.894936 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:22.894880 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/config-reloader/0.log" Jul 09 14:38:22.919130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:22.919091 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/kube-rbac-proxy-web/0.log" Jul 09 14:38:22.948981 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:22.948950 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/kube-rbac-proxy/0.log" Jul 09 14:38:22.971897 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:22.971826 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/kube-rbac-proxy-metric/0.log" Jul 09 14:38:23.002375 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.002351 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/prom-label-proxy/0.log" Jul 09 14:38:23.030735 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.030691 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87974fc2-6517-4e5f-8da8-e61fa1a2130d/init-config-reloader/0.log" Jul 09 14:38:23.085684 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.085647 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-6v6dc_ed0a9e05-e63a-4057-975f-24f38ac5d823/cluster-monitoring-operator/0.log" Jul 09 14:38:23.218606 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.218577 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b4b4b6dc-h28f7_782ed496-56cb-4d5f-839e-352e02a349c0/metrics-server/0.log" Jul 09 14:38:23.252264 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.252231 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-c4tbc_d36f3de2-0d16-4ea0-ac57-3cdebff7ad28/monitoring-plugin/0.log" Jul 09 14:38:23.484173 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.484065 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xkq7z_a4a0156d-417c-4f3e-851f-cf8feeb6604b/node-exporter/0.log" Jul 09 14:38:23.504132 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.504083 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xkq7z_a4a0156d-417c-4f3e-851f-cf8feeb6604b/kube-rbac-proxy/0.log" Jul 09 14:38:23.528880 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.528779 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xkq7z_a4a0156d-417c-4f3e-851f-cf8feeb6604b/init-textfile/0.log" Jul 09 14:38:23.930614 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.930579 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-zkmqh_d805b128-c321-4f15-a5a3-cc9b1c8e60fa/prometheus-operator/0.log" Jul 09 14:38:23.953022 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:23.952989 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-zkmqh_d805b128-c321-4f15-a5a3-cc9b1c8e60fa/kube-rbac-proxy/0.log" Jul 09 14:38:24.009205 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.009169 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6795566f6f-gpg76_1c3c1ce1-1050-4be6-be23-c85bd15279e8/telemeter-client/0.log" Jul 09 14:38:24.032899 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.032869 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6795566f6f-gpg76_1c3c1ce1-1050-4be6-be23-c85bd15279e8/reload/0.log" Jul 09 14:38:24.060191 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.060165 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6795566f6f-gpg76_1c3c1ce1-1050-4be6-be23-c85bd15279e8/kube-rbac-proxy/0.log" Jul 09 14:38:24.089599 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.089561 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5bfdd544-599cv_0366765f-b092-482f-b94b-d037c431a69a/thanos-query/0.log" Jul 09 14:38:24.112660 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.112622 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5bfdd544-599cv_0366765f-b092-482f-b94b-d037c431a69a/kube-rbac-proxy-web/0.log" Jul 09 14:38:24.138390 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.138352 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5bfdd544-599cv_0366765f-b092-482f-b94b-d037c431a69a/kube-rbac-proxy/0.log" Jul 09 14:38:24.161993 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.161968 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5bfdd544-599cv_0366765f-b092-482f-b94b-d037c431a69a/prom-label-proxy/0.log" Jul 09 14:38:24.186603 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.186518 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5bfdd544-599cv_0366765f-b092-482f-b94b-d037c431a69a/kube-rbac-proxy-rules/0.log" Jul 09 14:38:24.208912 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:24.208835 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5bfdd544-599cv_0366765f-b092-482f-b94b-d037c431a69a/kube-rbac-proxy-metrics/0.log" Jul 09 14:38:25.386403 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:25.386372 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-lncf8_d31b41c0-f645-486c-82ce-1c4c85afe3a7/networking-console-plugin/0.log" Jul 09 14:38:26.355121 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.355073 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw"] Jul 09 14:38:26.360967 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.360936 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.369766 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.369498 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw"] Jul 09 14:38:26.422924 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.422895 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-podres\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.423398 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.423020 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-sys\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.423398 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.423205 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-proc\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.423398 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.423337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-lib-modules\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.423398 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.423380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f29xd\" (UniqueName: \"kubernetes.io/projected/20843370-3adf-4dac-8990-43ea83e34173-kube-api-access-f29xd\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.521707 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.521676 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76c68ffdd5-xm9vz_9e1e30b8-b6d7-492a-97c6-c962e3844f53/console/0.log" Jul 09 14:38:26.524768 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524738 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-proc\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.524908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524793 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-lib-modules\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.524908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29xd\" (UniqueName: \"kubernetes.io/projected/20843370-3adf-4dac-8990-43ea83e34173-kube-api-access-f29xd\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.524908 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524867 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-proc\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.525034 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524958 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-podres\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.525034 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-sys\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.525144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.525063 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-podres\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.525144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.525085 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-sys\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.525144 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.524999 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20843370-3adf-4dac-8990-43ea83e34173-lib-modules\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.535025 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.535005 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f29xd\" (UniqueName: \"kubernetes.io/projected/20843370-3adf-4dac-8990-43ea83e34173-kube-api-access-f29xd\") pod \"perf-node-gather-daemonset-mrdlw\" (UID: \"20843370-3adf-4dac-8990-43ea83e34173\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.561387 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.561353 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-shg9p_297792fb-edb3-4f2e-b529-2456eb00b69c/download-server/0.log" Jul 09 14:38:26.678667 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.678637 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:26.837011 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:26.835596 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw"] Jul 09 14:38:27.807257 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:27.807216 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" event={"ID":"20843370-3adf-4dac-8990-43ea83e34173","Type":"ContainerStarted","Data":"593db71b1b43d45397568b86645ab515998f3ed9cdadb9b2a8015c04cefd2362"} Jul 09 14:38:27.807745 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:27.807286 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" event={"ID":"20843370-3adf-4dac-8990-43ea83e34173","Type":"ContainerStarted","Data":"629477991a559b9e37c583feb4e07607c02fb3d0a7a47167b4204d0a38db178b"} Jul 09 14:38:27.807894 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:27.807848 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:27.826724 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:27.826681 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" podStartSLOduration=1.826668516 podStartE2EDuration="1.826668516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:27.823911613 +0000 UTC m=+2408.038137726" watchObservedRunningTime="2026-07-09 14:38:27.826668516 +0000 UTC m=+2408.040894631" Jul 09 14:38:28.195665 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:28.195630 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bwk8l_b861d323-e422-48e5-a5e2-d0f9455aa881/dns/0.log" Jul 09 14:38:28.219592 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:28.219567 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bwk8l_b861d323-e422-48e5-a5e2-d0f9455aa881/kube-rbac-proxy/0.log" Jul 09 14:38:28.396099 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:28.396069 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p477f_cfac2c63-25e1-4469-b164-1546ec46a98b/dns-node-resolver/0.log" Jul 09 14:38:28.971171 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:28.971139 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9pfvf_5e9c1943-279e-42bf-a186-47c16d6b88aa/node-ca/0.log" Jul 09 14:38:29.943497 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:29.943440 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qq5g4_c86075e0-aa2f-4ec4-84ab-8b4678156b7a/istio-proxy/0.log" Jul 09 14:38:30.081510 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:30.081478 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nxdfz_572489cc-7bb4-4040-b657-06616906727f/discovery/0.log" Jul 09 14:38:30.174649 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:30.174623 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/0.log" Jul 09 14:38:30.210579 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:30.210507 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/1.log" Jul 09 14:38:30.307130 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:30.307084 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zbh4h_dbfed569-6e30-4b55-a18c-38048ef669a0/payload-processing/0.log" Jul 09 14:38:30.331057 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:30.331037 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-598c56748b-jjshs_d5840237-f1e6-4287-8890-6dd0fc4d82e0/router/0.log" Jul 09 14:38:31.017394 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:31.017338 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bkx2n_702ca2b3-c17e-41b3-af44-5fd6a31cfd88/serve-healthcheck-canary/0.log" Jul 09 14:38:31.710525 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:31.710493 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qljpd_df64ac93-a9da-4297-8458-2cc4cd1b73df/kube-rbac-proxy/0.log" Jul 09 14:38:31.733671 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:31.733647 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qljpd_df64ac93-a9da-4297-8458-2cc4cd1b73df/exporter/0.log" Jul 09 14:38:31.763377 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:31.763349 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qljpd_df64ac93-a9da-4297-8458-2cc4cd1b73df/extractor/0.log" Jul 09 14:38:34.579773 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:34.579741 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-zmssg_2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f/manager/0.log" Jul 09 14:38:34.599767 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:34.599736 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-zmssg_2ca2ead9-2c3c-44a6-98a2-7acdf1d6f71f/copy-manifests/0.log" Jul 09 14:38:34.834060 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:34.833971 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-mrdlw" Jul 09 14:38:35.718850 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:35.718820 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86df669b44-kt9wj_a9d3e484-9744-487d-8acb-5054f401db48/manager/0.log" Jul 09 14:38:36.135041 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:36.134917 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qq5g4_c86075e0-aa2f-4ec4-84ab-8b4678156b7a/istio-proxy/0.log" Jul 09 14:38:36.276914 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:36.276889 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nxdfz_572489cc-7bb4-4040-b657-06616906727f/discovery/0.log" Jul 09 14:38:36.321746 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:36.321300 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/0.log" Jul 09 14:38:36.360293 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:36.360262 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/1.log" Jul 09 14:38:36.452132 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:36.451891 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zbh4h_dbfed569-6e30-4b55-a18c-38048ef669a0/payload-processing/0.log" Jul 09 14:38:36.467471 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:36.467445 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-598c56748b-jjshs_d5840237-f1e6-4287-8890-6dd0fc4d82e0/router/0.log" Jul 09 14:38:37.803343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:37.803317 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qq5g4_c86075e0-aa2f-4ec4-84ab-8b4678156b7a/istio-proxy/0.log" Jul 09 14:38:37.951343 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:37.951316 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nxdfz_572489cc-7bb4-4040-b657-06616906727f/discovery/0.log" Jul 09 14:38:38.002186 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:38.002117 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/0.log" Jul 09 14:38:38.044758 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:38.044728 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-n4zk2_38b75831-c044-4b15-a092-d43fcd2ff011/istio-proxy/1.log" Jul 09 14:38:38.123576 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:38.123546 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zbh4h_dbfed569-6e30-4b55-a18c-38048ef669a0/payload-processing/0.log" Jul 09 14:38:38.140183 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:38.140157 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-598c56748b-jjshs_d5840237-f1e6-4287-8890-6dd0fc4d82e0/router/0.log" Jul 09 14:38:41.003907 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:41.003879 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bjxpn_fbd99120-6e92-47a6-a9ca-292f43c4f51a/migrator/0.log" Jul 09 14:38:41.027756 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:41.027726 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bjxpn_fbd99120-6e92-47a6-a9ca-292f43c4f51a/graceful-termination/0.log" Jul 09 14:38:42.434595 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.434570 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9j65w_e7345eb7-e6ab-47db-bfdf-f4b75d39b4fb/kube-multus/0.log" Jul 09 14:38:42.628654 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.628553 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/kube-multus-additional-cni-plugins/0.log" Jul 09 14:38:42.651434 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.651409 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/egress-router-binary-copy/0.log" Jul 09 14:38:42.673601 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.673580 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/cni-plugins/0.log" Jul 09 14:38:42.695523 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.695502 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/bond-cni-plugin/0.log" Jul 09 14:38:42.723725 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.723704 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/routeoverride-cni/0.log" Jul 09 14:38:42.747814 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.747794 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/whereabouts-cni-bincopy/0.log" Jul 09 14:38:42.771583 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:42.771560 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-klgkj_a5f66f5f-2878-4162-ae66-44837b44b6ce/whereabouts-cni/0.log" Jul 09 14:38:43.027695 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:43.027663 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6pjbl_b224c32b-7b3b-4d25-84ce-868d610a2ae0/network-metrics-daemon/0.log" Jul 09 14:38:43.048539 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:43.048522 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6pjbl_b224c32b-7b3b-4d25-84ce-868d610a2ae0/kube-rbac-proxy/0.log" Jul 09 14:38:43.951943 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:43.951897 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-controller/0.log" Jul 09 14:38:43.970465 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:43.970438 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/1.log" Jul 09 14:38:43.970695 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:43.970669 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovn-acl-logging/0.log" Jul 09 14:38:43.990459 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:43.990440 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/kube-rbac-proxy-node/0.log" Jul 09 14:38:44.017758 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:44.017739 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 14:38:44.041884 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:44.041862 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/northd/0.log" Jul 09 14:38:44.063442 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:44.063423 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/nbdb/0.log" Jul 09 14:38:44.084761 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:44.084745 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/sbdb/0.log" Jul 09 14:38:44.149120 ip-10-0-132-27 kubenswrapper[2553]: I0709 14:38:44.149086 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48d8p_d640e396-5035-4aab-9fe7-06964070c2fb/ovnkube-controller/0.log"